OmniRoute

Free AI gateway giving one endpoint for 350 providers with auto-fallback and token compression.

Open SourceSelf Hosted
0.0 (0)

About

One endpoint in front of 350 model providers, more than 90 of them with free tiers, is the pitch behind OmniRoute, an MIT-licensed AI gateway that trended on GitHub through 2026 and now exceeds 54,000 stars with hundreds of contributors. It exposes over 1,200 models through an OpenAI-compatible REST API plus an MCP server with 110 tools and A2A agent protocol support, and drops into more than 35 clients including Claude Code, Cursor, Cline, Copilot, Aider, Goose, and OpenCode. A quota-aware four-tier fallback cascade routes each request from subscription to API to cheap to free capacity so coding sessions survive rate limits and outages, while a twelve-engine token compression pipeline claims savings between 15 and 95 percent depending on workload. Everything runs self-hosted: npm install -g omniroute starts the Node.js gateway, with Docker, an Electron desktop build, a PWA, and Termux on Android as alternatives. The project documents around 1.5 billion free tokens per month across provider pools. Routing still depends on hosted providers, so it is a traffic manager rather than an inference engine.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Easy (2/5)
License
MIT
Added
Aug 24, 2026

Related Tools

Open-source ChatGPT alternative that runs 100% offline on your computer.

Open SourceSelf HostedOffline
Beginner
Featured

Port of Meta's LLaMA model in C/C++ for efficient CPU inference

Open SourceSelf HostedOffline
Intermediate

Fast LLM inference on consumer GPUs using neuron-aware sparse computation.

Open SourceSelf HostedOfflineGPU 4GB+
Advanced
Featured

High-throughput LLM serving engine with PagedAttention

Open SourceSelf HostedOfflineGPU 16GB+
Intermediate

Easy-to-use local AI inference with built-in web UI and API.

Open SourceSelf HostedOffline
Beginner

Minimalist machine learning framework for Rust focused on performance and serverless inference.

Open SourceSelf HostedOffline
Intermediate
Browse all LLM Inference & Serving tools