Phi-3

Microsoft's 2024 small open-weight model family, 3.8B to 14B, built on synthetic training data.

Open SourceSelf HostedOffline CapableGPU Required (4GB+ VRAM)
0.0 (0)

About

Microsoft's Phi-3 family, first published in April 2024 with a June 2024 refresh of the Mini model, consists of dense decoder-only models: Mini at 3.8B parameters, Small at 7B and Medium at 14B, each offered with a short context (4K or 8K tokens) and a 128K version, plus a 4.2B vision model built on Mini. The bet behind the family was that heavily filtered web text combined with synthetic, textbook-style material buys reasoning ability per parameter; Mini saw 4.9 trillion training tokens and was then aligned with supervised fine-tuning and DPO. Weights are on Hugging Face for Transformers, with official ONNX builds for CPU, CUDA and DirectML and GGUF files for llama.cpp, and Ollama carries phi3 tags. A quantized Mini runs comfortably on an ordinary laptop, while Medium needs a reasonably capable GPU even at 4-bit. The MIT license allows commercial use without extra terms. Expect English-first behavior, thin factual recall, and code skills limited mostly to common Python packages. Later Phi-3.5 and Phi-4 releases beat it, so Phi-3 now makes most sense for constrained edge deployments and existing pipelines already tuned around it.

Should you use Phi-3?

Pick it when

Pick this when you need an MIT-licensed small model for a 4 GB-class GPU, especially Phi-3 Mini at 3.8B with the 128K context variant for summarizing or querying long documents on modest hardware.

Look elsewhere when

Skip it if you can fit 14B: Phi-4 supersedes Phi-3 Medium with stronger reasoning under the same MIT terms. For multilingual work or image input, Gemma 3 or Llama 3.2 cover more languages and add vision.

Alternatives to Phi-3

  • Phi-4

    Same MIT license and successor recipe, a 14B with stronger math and reasoning, at roughly double the VRAM floor.

  • Gemma 3

    1B to 27B with 128K context, image input, and 35+ languages, but under the Gemma license instead of MIT.

  • Llama 3.2

    1B and 3B edge models with quantized phone builds plus 11B and 90B vision models, under the Llama 3.2 Community license.

  • SmolLM

    Smaller, CPU-friendly Apache-2.0 models with open training data, at a clear step down in capability.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Easy (2/5)
License
MIT
Minimum VRAM
4 GB
Added
Apr 3, 2026

Tags