AnythingLLM
All-in-one desktop and Docker app for private LLM chat with your documents.
About
AnythingLLM from Mintplex Labs is an all-in-one application for private chat over your own documents, running locally by default with minimal setup. It ingests PDFs, DOCX, TXT, and other formats into workspaces, then answers questions against them using either local models through Ollama or LM Studio or cloud APIs from more than 40 providers including OpenAI, Anthropic, Google Gemini, Mistral, Groq, and AWS Bedrock. LanceDB is the default vector database, with support for Pinecone, Chroma, Weaviate, Qdrant, Milvus, PGVector, and others. Beyond retrieval chat it offers multi-user workspaces with access controls, a no-code AI agent builder with web browsing, scheduled tasks, embeddable chat widgets, and a developer API for custom integrations. It ships as a desktop app for Windows, macOS, and Linux plus a Docker image for server deployment on platforms like AWS, GCP, and Railway, and is open source under the MIT license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Beginner (1/5)
- License
- MIT
- Added
- Apr 3, 2026
Related Tools
Modular open-source RAG framework for building production document retrieval applications.
Open-source data extraction and indexing engine for RAG applications.
Open-source embedding database for AI applications
Web scraping API that turns websites into clean LLM-ready markdown.
Chat with documents locally using any open-source LLM without data leaving your device.
Cloud-native vector database for scalable similarity search
Mentioned in
RAG Is Dead, Long Live RAG: Where Retrieval Is Going
The 'RAG is dead' meme misses what is actually happening. Hybrid retrieval, late-interaction models, agentic...
Max P
Building a Private RAG Stack with Ollama, Qdrant, and AnythingLLM
An end-to-end blueprint for a fully self-hosted RAG system using Ollama for inference, Qdrant for the vector...
Billy C