OpenLLMetry
OpenTelemetry instrumentation that traces LLM, vector database, and framework calls to any backend.
About
Rather than inventing a new telemetry format, OpenLLMetry extends OpenTelemetry with instrumentation for the LLM stack, and its gen_ai semantic conventions were later adopted into OpenTelemetry itself. The Python SDK installs with pip install traceloop-sdk and auto-instruments calls to OpenAI, Anthropic, Bedrock, Gemini, Mistral, Ollama, and a dozen other providers, vector databases including Pinecone, Qdrant, Chroma, Milvus, and Weaviate, and frameworks such as LangChain, LlamaIndex, LangGraph, CrewAI, and LiteLLM, with MCP support and a separate OpenLLMetry-JS package covering TypeScript. Because the output is plain OTel spans, traces export to more than 20 destinations including Datadog, Honeycomb, Grafana, New Relic, Splunk, and SigNoz, or to Traceloop's own hosted platform, so there is no vendor lock-in on the storage side. Everything is Apache-2.0 licensed and maintained by Traceloop. It suits teams that already run OpenTelemetry and want LLM calls, token counts, and prompts to appear in the same tracing backend as the rest of their services.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Observability & Evaluation
- Price
- Freemium
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Jul 29, 2026
Related Tools
UK AI Security Institute framework for large language model evaluations and benchmarks.
ML experiment tracking, visualization, and collaboration
Open source LLM engineering platform for tracing and analytics
Open-source library for evaluating and tracking LLM applications.
Open-source AI metadata tracker for logging and comparing ML experiments.
Python framework for unit testing and evaluating LLM applications with metrics like G-Eval.