| Langfuse |
Units: every trace, observation and score counts as one |
MIT open source, self-host on Docker Compose or Kubernetes, or Langfuse Cloud |
Teams that want to own the data and have the people to run it, or a cheap hosted tier with an honest free plan. |
| Braintrust |
Gigabytes of processed data plus scores |
Hosted; on-prem or hosted deployment on Enterprise |
Teams who write their own scorers and want evaluation results beside the trace, with unlimited seats. |
| Agent Ping (ours) |
Runs, within a flat monthly allowance |
Hosted; SDKs for Python, TypeScript, Go and Laravel are open source, and OpenTelemetry is accepted |
Teams running agents for paying customers who need to know what each run cost, whether the scheduled ones ran, and whether the output is still good, without building the evaluation pipeline. |
| Arize Phoenix and AX |
Trace spans and gigabytes |
Phoenix open source and local-first; AX hosted or self-hosted on Enterprise |
Teams already on OpenTelemetry who want a credible open-source tracing and evaluation layer they can run locally. |
| Laminar |
Gigabytes of trace data after compression |
Source on GitHub; on-premise only on Enterprise |
Small teams that want cheap, framework-agnostic tracing with search and a low monthly floor. |
| LangWatch |
Events: every LLM call, tool call, retrieval, evaluation or simulation step |
Apache 2.0 open source; self-host with Docker Compose on your own ClickHouse |
European teams that want an open-source platform with simulation-based testing and a per-seat price they can predict. |
| Pydantic Logfire |
Spans, logs and metrics (records) |
Hosted; the SDK is open source |
Python teams on Pydantic AI or FastAPI who want one observability tool for the whole application, not just the model calls. |
| Lunary |
Events |
Hosted; self-hosting listed as an Enterprise option |
Small teams that want prompt management and human review alongside traces at a low per-user price. |
| Datadog LLM Observability |
LLM spans; tool, retrieval and agent spans are free |
Hosted |
Teams already running Datadog who want model calls in the same pane as their APM and logs. |