| LangSmith |
Traces: one end-to-end run tree, however many calls it contains |
Hosted; self-hosting and hybrid only on Enterprise |
Teams inside the LangChain and LangGraph ecosystem whose main loop is offline evaluation and prompt iteration. |
| Braintrust |
Gigabytes of processed data plus scores |
Hosted; on-prem or hosted deployment on Enterprise |
Teams who write their own scorers and want evaluation results beside the trace, with unlimited seats. |
| Agent Ping (ours) |
Runs, within a flat monthly allowance |
Hosted; SDKs for Python, TypeScript, Go and Laravel are open source, and OpenTelemetry is accepted |
Teams running agents for paying customers who need to know what each run cost, whether the scheduled ones ran, and whether the output is still good, without building the evaluation pipeline. |
| Arize Phoenix and AX |
Trace spans and gigabytes |
Phoenix open source and local-first; AX hosted or self-hosted on Enterprise |
Teams already on OpenTelemetry who want a credible open-source tracing and evaluation layer they can run locally. |
| Laminar |
Gigabytes of trace data after compression |
Source on GitHub; on-premise only on Enterprise |
Small teams that want cheap, framework-agnostic tracing with search and a low monthly floor. |
| LangWatch |
Events: every LLM call, tool call, retrieval, evaluation or simulation step |
Apache 2.0 open source; self-host with Docker Compose on your own ClickHouse |
European teams that want an open-source platform with simulation-based testing and a per-seat price they can predict. |
| Pydantic Logfire |
Spans, logs and metrics (records) |
Hosted; the SDK is open source |
Python teams on Pydantic AI or FastAPI who want one observability tool for the whole application, not just the model calls. |
| Lunary |
Events |
Hosted; self-hosting listed as an Enterprise option |
Small teams that want prompt management and human review alongside traces at a low per-user price. |
| Datadog LLM Observability |
LLM spans; tool, retrieval and agent spans are free |
Hosted |
Teams already running Datadog who want model calls in the same pane as their APM and logs. |