OpenLLMetry

OpenTelemetry instrumentation that traces LLM, vector database, and framework calls to any backend.

Open SourceSelf HostedOffline Capable
0.0 (0)

About

Rather than inventing a new telemetry format, OpenLLMetry extends OpenTelemetry with instrumentation for the LLM stack, and its gen_ai semantic conventions were later adopted into OpenTelemetry itself. The Python SDK installs with pip install traceloop-sdk and auto-instruments calls to OpenAI, Anthropic, Bedrock, Gemini, Mistral, Ollama, and a dozen other providers, vector databases including Pinecone, Qdrant, Chroma, Milvus, and Weaviate, and frameworks such as LangChain, LlamaIndex, LangGraph, CrewAI, and LiteLLM, with MCP support and a separate OpenLLMetry-JS package covering TypeScript. Because the output is plain OTel spans, traces export to more than 20 destinations including Datadog, Honeycomb, Grafana, New Relic, Splunk, and SigNoz, or to Traceloop's own hosted platform, so there is no vendor lock-in on the storage side. Everything is Apache-2.0 licensed and maintained by Traceloop. It suits teams that already run OpenTelemetry and want LLM calls, token counts, and prompts to appear in the same tracing backend as the rest of their services.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Freemium
Platform
Local/Desktop
Difficulty
Easy (2/5)
License
Apache-2.0
Added
Jul 29, 2026

Related Tools

UK AI Security Institute framework for large language model evaluations and benchmarks.

Open SourceSelf HostedOffline
Easy
0.0 (0)
Featured

ML experiment tracking, visualization, and collaboration

Open Source
Easy
0.0 (0)
Featured

Open source LLM engineering platform for tracing and analytics

Open SourceSelf Hosted
Easy
0.0 (0)

Open-source library for evaluating and tracking LLM applications.

Open SourceSelf Hosted
Easy
0.0 (0)

Open-source AI metadata tracker for logging and comparing ML experiments.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Python framework for unit testing and evaluating LLM applications with metrics like G-Eval.

Open SourceSelf HostedOffline
Easy
0.0 (0)
Browse all AI Observability & Evaluation tools