gpt-oss
OpenAI's Apache-2.0 open-weight reasoning models at 120B and 20B, its first open release since GPT-2.
About
gpt-oss is OpenAI's first open-weight release since GPT-2: two Apache-2.0 mixture-of-experts reasoning models shipped in August 2025. gpt-oss-120b has 117B total and 5.1B active parameters and fits a single 80 GB GPU such as an H100 or MI300X, while gpt-oss-20b (21B total, 3.6B active) runs within 16 GB of memory on consumer hardware. MoE weights are natively quantized to MXFP4 with everything else in BF16, and the models expose configurable reasoning effort at low, medium, or high, plus function calling, structured outputs, and built-in browsing and Python tools. They require the harmony response format to work correctly, and the repository provides educational PyTorch, Triton, and Metal reference implementations along with the tool code, while support landed quickly in Ollama, LM Studio, vLLM, and llama.cpp. Apache-2.0 licensing means no copyleft or usage restrictions for commercial deployment. With over 20k GitHub stars and a dedicated OpenAI cookbook section, gpt-oss rapidly became a default choice for local reasoning and agent experiments.
Should you use gpt-oss?
Pick it when
Pick this for local reasoning and agent experiments: the 20b runs in 16 GB on consumer hardware and the 120b on one 80 GB GPU, with adjustable reasoning effort, structured outputs, and Apache-2.0 terms.
Look elsewhere when
Skip it if your serving stack cannot handle the required harmony response format, or you need image input, which this text-only family lacks. Gemma 4 or Qwen3.8-27B add vision under Apache-2.0.
Alternatives to gpt-oss
- DeepSeek-R1
MIT reasoning with distilled dense sizes from 1.5B to 70B, more hardware choices, and no harmony format requirement.
- Qwen 2.5 / Qwen 3
Apache-2.0 hybrid thinking and non-thinking modes across many dense and MoE sizes, without the harmony format requirement.
- Muse Glimmer
Apache-2.0 30B built for function calling and failure recovery with image input, but it needs a 24 GB card versus 16 GB for gpt-oss-20b.
- Trinity Large
Apache-2.0 400B sparse MoE with a thinking variant and 256K context, more capacity for agents but well beyond one 80 GB GPU.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Large Language Models (LLMs)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Minimum VRAM
- 16 GB
- Added
- Jul 29, 2026
Tags
Related Tools
Browse all Large Language Models (LLMs) toolsMentioned in
The Best Self-Hosted AI Stack for Small Teams in 2026
An opinionated reference architecture for self-hosted team AI in 2026: vLLM, Open WebUI, LiteLLM, Qdrant, and...
Billy C
Best Local LLM Setups by GPU Budget: 8GB, 16GB, 24GB, Multi-GPU
Exact model, quant, and engine picks for every VRAM tier in 2026, from an 8GB laptop GPU to a dual-3090...
Billy C