MaxText
Google's open JAX framework for LLM training on Cloud TPUs and GPUs, from one host to tens of thousands of chips.
About
Written in pure Python and JAX, MaxText is Google's open reference framework for training LLMs on Cloud TPUs and GPUs, part of the AI Hypercomputer stack. It leans on the XLA compiler rather than hand-written kernels to reach high model FLOPs utilization, and Google has demonstrated pretraining runs spanning tens of thousands of chips. Model coverage includes the Gemma, Llama, DeepSeek, Qwen, Mistral, Mixtral, and GPT-OSS families along with Moonshot Kimi models, with both pretraining and post-training paths: supervised fine-tuning recipes plus GRPO and GSPO reinforcement learning, including RL for Qwen3-scale MoE models in recent releases. The framework installs from PyPI, configuration is YAML driven, and documentation at maxtext.readthedocs.io walks through single-host getting-started runs up to multi-pod cluster jobs. Everything is Apache-2.0 licensed. Around 2,400 GitHub stars understate its influence: it serves as the canonical demonstration of JAX scaling practice and a starting point that teams fork to build their own TPU or GPU training stacks.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Model Training & Fine-Tuning
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- Apache-2.0
- Added
- Jul 29, 2026
Related Tools
Framework for generating synthetic data and AI feedback through composable LLM pipelines.
Subject-driven fine-tuning technique for personalizing diffusion models.
Video model fine-tuning toolkit by Hugging Face Diffusers team.
Efficient LLM quantization preserving important weight channels.
All-in-one Stable Diffusion fine-tuning tool with intuitive GUI.
No-code tool by Hugging Face for training ML models automatically.