Onyx
Self-hosted application layer for LLMs with chat, RAG, web search, code execution, and agents.
About
Onyx is an open source application layer for LLMs that teams self-host as a full chat workspace. The interface supports agentic retrieval-augmented generation over connected knowledge, multi-step deep research, custom agents with their own instructions and knowledge, and web search through providers such as Serper, Google PSE, Brave, and SearXNG, plus sandboxed code execution, document generation, and a voice mode. More than 50 indexing connectors ingest sources out of the box, with additional integrations available through the Model Context Protocol. It connects to most LLM backends, from self-hosted Ollama, vLLM, and LiteLLM to OpenAI, Anthropic, and Gemini. Deployments range from Onyx Lite, a lightweight chat and agents build that runs in under 1 GB of memory, to the full stack with vector and keyword indexing, background workers, Redis, and MinIO, installable via Docker, Kubernetes, Helm, or Terraform. The Community Edition is MIT licensed, and an Enterprise Edition serves larger organizations.
Should you use Onyx?
Pick it when
Pick Onyx when a company wants one self-hosted assistant over many internal sources through 50+ built-in connectors, with agents, deep research, and web search, and someone on staff can run Docker, Kubernetes, or Helm.
Look elsewhere when
Skip it if one person just wants to chat with a folder of files; the full stack brings Redis, MinIO, and workers, and AnythingLLM or Open WebUI are lighter. Onyx Lite trims it down to chat and agents.
Alternatives to Onyx
- AnythingLLM
Desktop app or a single Docker container with workspaces, far easier for a small team, but not built around syncing dozens of company sources the way Onyx is.
- Open WebUI
Lighter multi-user chat UI with RAG over uploaded documents, good for general chat, rather than continuous indexing of company sources through connectors.
- Khoj
Personal-scale assistant with Obsidian, Emacs, and phone clients plus automations, suited to individuals more than org-wide search, and AGPL-3.0.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Hybrid
- Difficulty
- Intermediate (3/5)
- License
- MIT
- Added
- May 7, 2026
Tags
Related Tools
Browse all RAG & Document Retrieval toolsMentioned in
The Best Self-Hosted AI Stack for Small Teams in 2026
An opinionated reference architecture for self-hosted team AI in 2026: vLLM, Open WebUI, LiteLLM, Qdrant, and...
Billy C
RAG Is Dead, Long Live RAG: Where Retrieval Is Going
The 'RAG is dead' meme misses what is actually happening. Hybrid retrieval, late-interaction models, agentic...
Max P
Building a Private RAG Stack with Ollama, Qdrant, and AnythingLLM
An end-to-end blueprint for a fully self-hosted RAG system using Ollama for inference, Qdrant for the vector...
Billy C