OpenLIT
Self-hosted OpenTelemetry platform for LLM observability, GPU monitoring, guardrails, and prompts.
About
OpenLIT bundles most of the operational tooling an LLM application needs into one self-hosted, OpenTelemetry-native platform: tracing and metrics, GPU monitoring, real-time guardrails, eleven built-in evaluation types including hallucination and toxicity detection, a versioned Prompt Hub, a Vault for API keys, and an OpenGround playground for side-by-side model comparison. SDKs for Python, TypeScript, and Go auto-instrument more than 50 LLM providers, agent frameworks, and vector databases, emitting standard gen_ai semantic conventions so data can flow to OpenLIT's own ClickHouse-backed UI or to any existing OpenTelemetry collector and backend. Deployment is a Docker Compose file for quick starts or a Helm chart for Kubernetes, and everything runs on your own infrastructure with no external service required. The whole stack is Apache-2.0 licensed with no paid tier. Teams pick it over point solutions when they want observability, evaluation, and prompt management consolidated behind one open deployment instead of several hosted dashboards.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Observability & Evaluation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Added
- Jul 29, 2026
Related Tools
UK AI Security Institute framework for large language model evaluations and benchmarks.
ML experiment tracking, visualization, and collaboration
Open source LLM engineering platform for tracing and analytics
Open-source library for evaluating and tracking LLM applications.
Open-source AI metadata tracker for logging and comparing ML experiments.
Python framework for unit testing and evaluating LLM applications with metrics like G-Eval.