OpenLLMetry

Open-source OpenTelemetry tracing for LLM apps

Code & Dev Tools Open Source Has API Open Source
Researched · Published · Reviewed
RECATOOLS Score
7 / 10
Capability
7
Value for money
8
Ease of use
6
ASEAN readiness
6
API quality
7
Founded
2023
HQ
Tel Aviv, Israel
Developer
ServiceNow

Overview

OpenLLMetry is an Apache-2.0 set of OpenTelemetry extensions that trace LLM calls, vector-database queries and agent frameworks, sending standard OTLP data to backends such as Datadog, Grafana, Honeycomb, New Relic, Sentry or Splunk. It was built by Traceloop, a Tel Aviv Y Combinator company that ServiceNow acquired in 2026; the library remains open source.

Advertisement

Pricing

Pricing shown for reference only. These figures reflect RECATOOLS research as of 12 Oct 2026 and may be out of date or incomplete. This is not financial or purchasing advice — always confirm the current price on the provider’s official website before making any decision.

Free
Free
OpenLLMetry is free and open source (Apache-2.0); Traceloop's hosted free tier covers up to 50K spans a month with 24-hour retention

Use cases

LLM tracing OpenTelemetry integration Multi-backend observability

What you can produce with OpenLLMetry

  • Tracing of OpenAI, Anthropic, Gemini, Bedrock, Mistral, Ollama and other model calls with one line
  • Standard OTLP export to Datadog, Grafana, Honeycomb, New Relic, Sentry, Splunk and more
  • Prompts, completions, token usage and latency for every model call
  • Step-by-step tracing of LangChain, LlamaIndex, CrewAI, LangGraph and OpenAI Agents SDK workflows
  • Instrumentation for Pinecone, Chroma, Qdrant, Milvus and other vector databases
  • SDKs for Python, TypeScript, Go and Ruby
  • An optional hosted viewer in Traceloop, free up to 50K spans a month
Advertisement
RECATOOLS Verdict

OpenLLMetry is the sensible default if you already run OpenTelemetry: a pip install and one init line, and your LLM calls show up as standard spans in the backend you already use. Coverage of providers, vector databases and agent frameworks is wide, and the Python project ships often.

It is instrumentation, not an analytics product, so you still need a backend or Traceloop's hosted platform to read the data. Traceloop's 2026 acquisition by ServiceNow leaves the library open source, but buyers of the hosted product should watch how it evolves.

Desk research by RECATOOLS from public sources, written with AI assistance — not a hands-on test. How we review

What we found

OpenLLMetry is an open-source set of extensions to OpenTelemetry, licensed Apache-2.0, that records what an LLM application does: prompts, completions, token usage and latency for each model call, plus calls to vector databases and agent frameworks. Because it emits standard OpenTelemetry data, the traces go wherever you already send telemetry. The README lists more than 20 tested destinations, including Datadog, Grafana, Honeycomb, New Relic, Sentry, Splunk, Dynatrace, Google Cloud and Tencent Cloud, with SDKs in Python, TypeScript, Go and Ruby.

Coverage is broad. The README lists 16 model providers, among them OpenAI, Anthropic, Gemini, Bedrock, Mistral, Groq and Ollama; seven vector databases including Pinecone, Chroma, Qdrant and Milvus; and frameworks from LangChain and LlamaIndex to CrewAI, LangGraph and the OpenAI Agents SDK, plus MCP. Getting started is a pip install and one initialisation line. The Python project is active, with release 0.62.4 published on 29 September 2026.

Ownership changed in 2026. Traceloop, the Tel Aviv start-up that built it and a Y Combinator Winter 2023 company, announced in March that it was joining ServiceNow, which described the acquisition as completed in May and folded the technology into its AI Control Tower. Co-founder and chief executive Nir Gazit wrote that OpenLLMetry will remain open source. Earlier versions of this page placed Traceloop in San Francisco and listed no owner.

OpenLLMetry has no interface of its own, so you need a backend to read the traces. Traceloop's hosted platform still lists a free tier of up to 50,000 spans a month with 24-hour retention and an Enterprise plan priced on request, also sold through the AWS, Google Cloud and Azure marketplaces. How long Traceloop continues as a separate product under ServiceNow is the open question; the open-source library does not depend on the answer.

Compiled by RECATOOLS from public sources: vendor documentation and pricing, code repositories and published reporting.

About this listing

Researched on
Published on
Last reviewed

This entry was compiled from publicly available data including OpenLLMetry's official website, press releases, documentation, and reputable third-party publications. RECATOOLS is not affiliated with OpenLLMetry unless explicitly stated.

Data accuracy

Third-party AI tools update their pricing, features, availability, and policies frequently. Information here may be outdated by the time you read this — we make reasonable efforts to keep listings current, but cannot guarantee absolute accuracy.

For the latest details, please refer to OpenLLMetry directly →

Spotted something out of date? Suggest an update →

Advertisement