Falcon

TII's family of downloadable language models, from tiny edge builds to hybrid Mamba and transformer chat models.

Open SourceSelf HostedOffline CapableGPU Required (8GB+ VRAM)
0.0 (0)

About

Abu Dhabi's Technology Innovation Institute publishes Falcon as downloadable weights on Hugging Face, and the family now reaches far past its 2023 debut. Falcon 7B and 40B used Apache-2.0, while the gated 180B license bars offering it as a hosted service without TII approval. Falcon 3 followed with dense models from 1B to 10B plus a Mamba variant, and Falcon-H1 introduced a hybrid design that runs attention alongside Mamba2 state-space layers, in sizes from 0.5B to 34B covering 18 languages. Later additions include Falcon-H1R-7B, tuned with GRPO reinforcement learning to work through a problem before replying, Falcon-E models stored at 1.58 bits for edge devices, Falcon-H1-Tiny models near 90M parameters, and GPTQ, AWQ, and GGUF quantized builds. Recent checkpoints run in Transformers, vLLM, SGLang, or llama.cpp. Newer releases use the TII Falcon License, an Apache-2.0 derivative that is royalty free for commercial work but requires passing TII's acceptable use policy on to anyone you redistribute to. Pick Falcon for self-hosted chat, reasoning, or compact on-device models.

Should you use Falcon?

Pick it when

Pick this when you want a plain Apache-2.0 base at 7B or 40B for research or fine-tuning experiments, or want to study a model family trained mainly on the RefinedWeb web corpus.

Look elsewhere when

Skip it if you need long context, tool calling, or broad multilingual coverage, none of which Falcon is built around, and note the 180B uses its own license with a use policy. Llama 3.1 or Qwen 2.5 / Qwen 3 are better starting points.

Alternatives to Falcon

  • MPT

    Apache-2.0 7B and 30B base models with a 65K-context StoryWriter variant via ALiBi, a better fit when long inputs matter.

  • Llama 3.1

    128K context, tool calling, and 8B to 405B sizes, but under a community license with a use policy where Falcon 7B and 40B are plain Apache-2.0.

  • OLMo

    Apache-2.0 with fully open data, code, and checkpoints, a stronger research choice if you need to inspect training, not just the weights.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
TII Falcon License
Minimum VRAM
8 GB
Added
Apr 3, 2026

Tags