Phoenix
Arize's self-hosted tracing, evaluation and experiment UI for LLM apps, built on OpenTelemetry.
About
Arize built Phoenix as a self-hosted workbench for debugging LLM and agent apps through their traces. Instrumentation comes from the companion OpenInference project, OpenTelemetry-based and Apache-2.0, with auto-instrumentors for OpenAI, Anthropic, LangGraph, LlamaIndex, CrewAI and many others across Python, JavaScript, Java and Go. Collected spans land in a web UI where you inspect tool calls and retrieval steps, attach LLM-judged or code-based evaluations, turn traces into versioned datasets, compare prompts or models in experiments, replay calls in a playground and keep prompt versions; a remote MCP endpoint exposes the same data to coding agents. To try it, pip install arize-phoenix and run phoenix serve; production setups use the Docker image or Helm chart, with SQLite by default and PostgreSQL 14+ for multi-user installs. Its license, Elastic 2.0 (ELv2), lets companies run and modify it internally at no cost but forbids reselling it as a hosted service, so it is source-available rather than OSI open source. UI analytics are on by default but optional. Suits teams wanting a local alternative to hosted tracing tools.
Should you use Phoenix?
Pick it when
Pick Phoenix when you want a local UI to inspect traces, prompt-response pairs, and embedding visualizations while running evals on captured data, with auto-instrumentation for OpenAI, Bedrock, LangGraph, DSPy, and more.
Look elsewhere when
Skip it if you plan to offer it to others as a hosted service, which the Elastic License 2.0 forbids. Langfuse (MIT) or Opik (Apache-2.0) are permissive, and OpenLLMetry fits if traces must go to an existing APM.
Alternatives to Phoenix
- Langfuse
MIT licensed with a hosted free tier and a self-hosted edition at feature parity; no embedding visualization like Phoenix offers.
- Opik
Apache-2.0 tracing and evaluation with automatic prompt optimization and similar Docker self-hosting.
- TruLens
Library-first scoring of groundedness and relevance tracked across app versions; less general tracing and visualization.
- OpenLLMetry
Sends LLM spans to the Datadog, Grafana, or Honeycomb you already run; no eval UI of its own.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Observability & Evaluation
- Price
- Free
- Platform
- Hybrid
- Difficulty
- Easy (2/5)
- License
- Elastic-2.0
- Added
- Jan 29, 2026
Tags
Related Tools
Browse all AI Observability & Evaluation toolsMentioned in
The LLM Evaluation Stack: Ragas, LightEval, OpenCompass
A working guide to the 2026 LLM evaluation stack: Ragas for RAG metrics, LightEval and OpenCompass for...
Billy C
LLM Gateways in Production: LiteLLM vs Portkey vs Bifrost
A working comparison of LiteLLM, Portkey, and Bifrost on routing, caching, budgets, observability, and real...
Max P
15 Open-Source AI Dev Tools You Should Know About
The best free and open-source AI tools for developers that deserve more attention.
Max P