OmniRoute
Free AI gateway giving one endpoint for 350 providers with auto-fallback and token compression.
About
One endpoint in front of 350 model providers, more than 90 of them with free tiers, is the pitch behind OmniRoute, an MIT-licensed AI gateway that trended on GitHub through 2026 and now exceeds 54,000 stars with hundreds of contributors. It exposes over 1,200 models through an OpenAI-compatible REST API plus an MCP server with 110 tools and A2A agent protocol support, and drops into more than 35 clients including Claude Code, Cursor, Cline, Copilot, Aider, Goose, and OpenCode. A quota-aware four-tier fallback cascade routes each request from subscription to API to cheap to free capacity so coding sessions survive rate limits and outages, while a twelve-engine token compression pipeline claims savings between 15 and 95 percent depending on workload. Everything runs self-hosted: npm install -g omniroute starts the Node.js gateway, with Docker, an Electron desktop build, a PWA, and Termux on Android as alternatives. The project documents around 1.5 billion free tokens per month across provider pools. Routing still depends on hosted providers, so it is a traffic manager rather than an inference engine.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- LLM Inference & Serving
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- MIT
- Added
- Aug 24, 2026
Related Tools
Open-source ChatGPT alternative that runs 100% offline on your computer.
Port of Meta's LLaMA model in C/C++ for efficient CPU inference
Fast LLM inference on consumer GPUs using neuron-aware sparse computation.
High-throughput LLM serving engine with PagedAttention
Easy-to-use local AI inference with built-in web UI and API.
Minimalist machine learning framework for Rust focused on performance and serverless inference.