Devstral
Agentic coding model from Mistral AI and All Hands AI that runs on a single high-end consumer GPU.
About
Devstral targets agentic coding: Mistral AI built it with All Hands AI, the team behind OpenHands, to explore codebases, edit multiple files, and drive software engineering agent scaffolds rather than autocomplete snippets. Devstral Small, a 24B-parameter model with a 128K context window, scores 53.6 percent on SWE-Bench Verified, which made it the top open-source model on that benchmark at release, ahead of much larger models such as DeepSeek-V3-0324 under the same scaffold, and it is light enough to run on a single RTX 4090 or a Mac with 32 GB of RAM. Weights are Apache-2.0 on Hugging Face, so commercial use and fine-tuning are unrestricted, and deployment is supported through vLLM (recommended), Ollama, llama.cpp, LM Studio, mistral-inference, and Transformers, with a published system prompt file tuned for agent-based interactions. Paired with OpenHands or similar agent frameworks it handles automated issue resolution, multi-file edits, and repository-scale code exploration, making it one of the most practical models to run locally for software engineering agents rather than chat-style code assistance.
Should you use Devstral?
Pick it when
Pick this when you want a local model to drive OpenHands or a similar agent scaffold for issue resolution and multi-file edits on one RTX 4090 or a 32 GB Mac, with Apache-2.0 terms for commercial use and fine-tuning.
Look elsewhere when
Skip it for inline autocomplete or general chat: it is tuned for agent loops, not snippet completion. DeepSeek-Coder or Qwen-Coder fit editor completion better, and GLM-5 or Kimi K2 go further on agents if you can host them.
Alternatives to Devstral
- Muse Glimmer
Also Apache-2.0 and sized for one 24 GB card, but a general agent model with vision and 100+ languages rather than a coding specialist.
- GLM-5
MIT MoE for which Z.ai reports 77.8 percent on SWE-bench Verified, built for agentic coding, but it needs eight GPUs or the hosted API.
- DeepSeek-Coder
Fill-in-the-middle completion from 1.3B to 33B for editor plugins, lighter to run, but not built to drive multi-file agent scaffolds.
- Qwen3.8
Qwen3.8-27B is Apache-2.0, fits one consumer GPU at 4-bit, and adds image and video input with strong coding scores at a similar size.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Large Language Models (LLMs)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Minimum VRAM
- 24 GB
- Added
- Jul 29, 2026
Tags
Related Tools
Browse all Large Language Models (LLMs) toolsMentioned in
How to Evaluate Open Source AI Tools: The Checklist We Use
How BuilderAI.tools vets and maintains its 787 listings, plus a reusable checklist for maintenance, licenses,...
BuilderAI Editorial Team
Best Local LLM Setups by GPU Budget: 8GB, 16GB, 24GB, Multi-GPU
Exact model, quant, and engine picks for every VRAM tier in 2026, from an 8GB laptop GPU to a dual-3090...
Billy C