Kotaemon
Self-hosted document chat app and RAG toolkit with hybrid search, citations and multi-user collections.
About
Cinnamon's open source app gives you a web interface for asking questions about PDFs and other files, plus a Python framework for building the retrieval pipeline behind it. By default it indexes documents into a vector store and a full-text index, merges both at query time with reranking, and answers with citations that open in a built-in PDF viewer with matched passages highlighted. It offers multi-user login with private and shared collections, question decomposition and ReAct or ReWOO agents for multi-hop questions, and optional GraphRAG, NanoGraphRAG or LightRAG indexing. Models can be hosted APIs such as OpenAI, Azure OpenAI, Cohere or Groq, or local ones served by Ollama or llama-cpp-python, so fully offline use is possible. Parsing can be upgraded with Docling locally or Azure and Adobe cloud services for tables, figures and OCR, and storage options include Chroma, LanceDB, Milvus, Qdrant and Elasticsearch. The quickest start is a lite, full or Ollama-bundled Docker image on port 7860; a manual install needs Python 3.10+. Apache-2.0 licensed. Ideal for teams wanting a private, extensible document assistant.
Should you use Kotaemon?
Pick it when
Pick Kotaemon when you want a clean self-hosted web UI for document QA that end users can operate, with hybrid and multimodal retrieval, while developers keep the option to extend it into a custom RAG pipeline.
Look elsewhere when
Skip it if non-technical users need a one-click desktop install, where AnythingLLM is simpler, or if you want visual chunk previews and template-based parsing for complex documents, where RAGFlow goes further.
Alternatives to Kotaemon
- AnythingLLM
Desktop installers, plus multi-user workspaces and a no-code agent builder on Docker, easier to roll out, though less geared to extending the retrieval code.
- RAGFlow
Template-based chunking with visual chunk previews and chunk-level citations, stronger on messy business documents where parsing is the bottleneck.
- Open WebUI
Broader chat interface with RAG as one feature and multi-user roles, better when general chat matters more than document QA depth.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026