InternLM 2.5
Shanghai AI Lab's open-weight base and chat LLMs from 1.8B to 20B parameters, plus a 1M-token chat variant.
About
Shanghai AI Laboratory's 2.5 generation of InternLM arrived in mid 2024 as base and chat checkpoints at 1.8B, 7B and 20B parameters, the chat versions tuned with supervised fine-tuning and RLHF for instruction following and function calling. A 7B-Chat-1M build stretches context to roughly one million tokens; Transformers cannot run that length, so the card points to LMDeploy and says the full window needs four 80 GB A100s. The GitHub repo gathers the whole family: model cards, OpenCompass benchmark tables, reward models, and runnable recipes for Transformers, LMDeploy, vLLM, SGLang and Ollama, several exposing an OpenAI-style endpoint, with weights on Hugging Face and ModelScope. Baseline requirements are Python 3.8+, PyTorch and Transformers 4.38+; weights should load in float16 to avoid memory errors, and a 4-bit bitsandbytes load brings the newer InternLM3 8B to roughly 8 GB of VRAM. Code is Apache-2.0; the 2.5 weight cards permit free commercial use but ask companies to file an application form, whereas InternLM3-8B-Instruct ships under plain Apache-2.0. Suits teams wanting bilingual Chinese and English models with long context.
Should you use InternLM 2.5?
Pick it when
Pick this when you need tool use and very long inputs, up to roughly one million tokens, at 7B or 20B sizes that keep hardware modest, with Apache-2.0 terms for commercial deployment.
Look elsewhere when
Skip it if you want the current generation or wider community adoption: the line has moved on to InternLM3, and Qwen 2.5 / Qwen 3 offers more sizes, 100+ languages, and up to 1M context under the same license.
Alternatives to InternLM 2.5
- Qwen 2.5 / Qwen 3
Same Apache-2.0 terms with 0.5B to 235B sizes, thinking modes, and 256K context expandable to 1M, plus much wider fine-tune adoption.
- GLM-4
Apache-2.0 9B and 32B with function calling, code execution, and multimodal input, for when tool use matters more than million-token context.
- Jamba
Apache-2.0 hybrid Mamba-Transformer built for efficient long-context inference, though its 256K maximum is shorter than InternLM's.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Large Language Models (LLMs)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Minimum VRAM
- 8 GB
- Added
- Apr 3, 2026