Tencent Hunyuan Hy3

Tencent's 295B mixture-of-experts LLM activating 21B per token with a 256K context window.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Tencent's entry in the open MoE race, Hy3 packs 295B parameters into 192 experts and routes each token through 8 of them, so only about 21B activate per step, while a 3.8B multi-token-prediction layer accelerates decoding through speculative execution. Context stretches to 256K tokens, a reasoning_effort switch moves between deep chain-of-thought and a no_think mode for direct answers, and tool calling is built in. The summer 2026 open-sourcing, following an April preview, includes BF16 and FP8 weights on Hugging Face and ModelScope under Apache-2.0, serving recipes for vLLM and SGLang with speculative decoding enabled, TensorRT-LLM support, a fine-tuning pipeline, GRPO reinforcement learning via the verl framework, and the AngelSlim quantization toolkit. Tencent recommends eight large-memory GPUs such as H20-3e class hardware for full-precision serving, placing self-hosting firmly in cluster territory, though hosted endpoints picked it up quickly and it climbed OpenRouter usage rankings soon after launch.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Advanced (4/5)
License
Apache-2.0
Added
Aug 24, 2026

Related Tools

Featured

Lightweight open-weight LLM by Google available in 1B to 27B sizes.

Open SourceSelf HostedOfflineGPU 4GB+
Easy

Open-source code LLM family by IBM for enterprise code generation.

Open SourceSelf HostedOfflineGPU 8GB+
Intermediate

Open-weight LLM by Meta in 8B and 70B sizes with strong general capabilities.

Open SourceSelf HostedOfflineGPU 8GB+
Intermediate
Featured

High-performance open-weight MoE LLM with 671B total parameters.

Open SourceSelf HostedOfflineGPU 24GB+
Advanced

Hybrid SSM-Transformer model by AI21 Labs combining Mamba with attention layers.

Open SourceSelf HostedOfflineGPU 12GB+
Intermediate

Open-weight code LLM trained on 2 trillion tokens of code and natural language.

Open SourceSelf HostedOfflineGPU 8GB+
Intermediate
Browse all Large Language Models (LLMs) tools