Devstral

Agentic coding model from Mistral AI and All Hands AI that runs on a single high-end consumer GPU.

Open SourceSelf HostedOffline CapableGPU Required (24GB+ VRAM)
0.0 (0)

About

Devstral targets agentic coding: Mistral AI built it with All Hands AI, the team behind OpenHands, to explore codebases, edit multiple files, and drive software engineering agent scaffolds rather than autocomplete snippets. Devstral Small, a 24B-parameter model with a 128K context window, scores 53.6 percent on SWE-Bench Verified, which made it the top open-source model on that benchmark at release, ahead of much larger models such as DeepSeek-V3-0324 under the same scaffold, and it is light enough to run on a single RTX 4090 or a Mac with 32 GB of RAM. Weights are Apache-2.0 on Hugging Face, so commercial use and fine-tuning are unrestricted, and deployment is supported through vLLM (recommended), Ollama, llama.cpp, LM Studio, mistral-inference, and Transformers, with a published system prompt file tuned for agent-based interactions. Paired with OpenHands or similar agent frameworks it handles automated issue resolution, multi-file edits, and repository-scale code exploration, making it one of the most practical models to run locally for software engineering agents rather than chat-style code assistance.

Should you use Devstral?

Pick it when

Pick this when you want a local model to drive OpenHands or a similar agent scaffold for issue resolution and multi-file edits on one RTX 4090 or a 32 GB Mac, with Apache-2.0 terms for commercial use and fine-tuning.

Look elsewhere when

Skip it for inline autocomplete or general chat: it is tuned for agent loops, not snippet completion. DeepSeek-Coder or Qwen-Coder fit editor completion better, and GLM-5 or Kimi K2 go further on agents if you can host them.

Alternatives to Devstral

  • Muse Glimmer

    Also Apache-2.0 and sized for one 24 GB card, but a general agent model with vision and 100+ languages rather than a coding specialist.

  • GLM-5

    MIT MoE for which Z.ai reports 77.8 percent on SWE-bench Verified, built for agentic coding, but it needs eight GPUs or the hosted API.

  • DeepSeek-Coder

    Fill-in-the-middle completion from 1.3B to 33B for editor plugins, lighter to run, but not built to drive multi-file agent scaffolds.

  • Qwen3.8

    Qwen3.8-27B is Apache-2.0, fits one consumer GPU at 4-bit, and adds image and video input with strong coding scores at a similar size.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!