</>macrostackBrowse all
Tool profile · LLM Observability & Evaluation

OpenLLMetry

Apache-2.0 OpenTelemetry instrumentation — send traces anywhere you already send them.

92
sovereignty

OpenLLMetry takes the opposite approach to a platform: it is a set of Apache-2.0 OpenTelemetry extensions that emit LLM traces in a standard format, so they flow into whatever you already run — Grafana, Datadog, Honeycomb, Jaeger or Traceloop's own hosted backend. If you already have observability infrastructure, this adds LLM visibility to it rather than asking you to adopt a second, parallel system. It is also the strongest hedge against lock-in: standard telemetry moves between backends by configuration.

OPEN SOURCEApache-2.0SELF-HOSTLOCAL-FIRST
LicenseApache-2.0
PricingFree — Apache-2.0 instrumentation libraries. You pay only whatever backend you already send telemetry to; a hosted Traceloop backend is available separately.
Open sourceYes
Self-hostableYes
Local-first dataYes

What it does well

  • +Apache-2.0 throughout — no enterprise-directory carve-out
  • +Standard OpenTelemetry: traces go to a backend you already operate
  • +The best protection against lock-in — switching backends is configuration
  • +Reuses your existing observability stack instead of adding a parallel one

Where it falls short

  • Instrumentation, not a platform — no evaluation or prompt-management UI
  • You need a trace backend already, or you are choosing one anyway
  • Generic backends render LLM traces less legibly than a purpose-built UI
  • Smaller project (about 7k stars) than Langfuse

OpenLLMetry as an alternative to

Where OpenLLMetry shows up in our comparisons, and how it ranked.

OpenLLMetry head-to-head

Straight comparisons against the tools people weigh it against.

The Macrostack brief

New swaps, worth your inbox.

A short, occasional email when we add a high-intent alternative or ship a new head-to-head. No spam, no selling your address — unsubscribe in one click.