LiteLLM
Unified API to call 100+ LLM providers with OpenAI format
About
LiteLLM is an open-source AI gateway that exposes a single OpenAI-format interface for calling more than a hundred LLM providers including OpenAI, Anthropic, Gemini, Bedrock, and Azure. It works as a Python SDK for direct integration or as a proxy server that centralizes routing, load balancing, fallbacks, and spend tracking for a team. It standardizes multi-provider access behind one API. Released under the MIT license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- LLM Inference & Serving
- Price
- Free
- Platform
- Hybrid
- Difficulty
- Easy (2/5)
- License
- MIT
- Added
- Jan 29, 2026
Related Tools
Open-source ChatGPT alternative that runs 100% offline on your computer.
Port of Meta's LLaMA model in C/C++ for efficient CPU inference
Fast LLM inference on consumer GPUs using neuron-aware sparse computation.
High-throughput LLM serving engine with PagedAttention
Easy-to-use local AI inference with built-in web UI and API.
Minimalist machine learning framework for Rust focused on performance and serverless inference.
Mentioned in
The Best Self-Hosted AI Stack for Small Teams in 2026
An opinionated reference architecture for self-hosted team AI in 2026: vLLM, Open WebUI, LiteLLM, Qdrant, and...
Billy C
Securing Self-Hosted AI Stacks in 2026: A Defensive Playbook
175,000 exposed Ollama hosts, an RCE chain in Triton, memory corruption in vLLM, and prompt injection...
Billy C
LLM Gateways in Production: LiteLLM vs Portkey vs Bifrost
A working comparison of LiteLLM, Portkey, and Bifrost on routing, caching, budgets, observability, and real...
Max P