WeNet
End-to-end speech recognition toolkit unifying streaming and non-streaming inference for production.
About
WeNet positions itself as a production-first end-to-end speech recognition toolkit, and its defining trick is the U2 family of Conformer models that serve streaming and non-streaming recognition from a single network, letting one trained model power both live captioning and batch transcription. The Python side covers data pipelines and training recipes for standard corpora, while the runtime side ships libtorch-based deployments for x86 servers and Android, a gRPC service, and ONNX and TensorRT export paths for optimized serving. Pretrained checkpoints include WenetSpeech Chinese models alongside support for Whisper, Paraformer, and FireRed models within the same tooling. Basic usage installs with pip from the repository, but the intended workflow, training or fine-tuning a model and then compiling the runtime, assumes GPU training capacity and some systems comfort. WeNet is heavily deployed in Chinese industry and is the framework underneath Rev's Reverb ASR release. Everything is Apache-2.0 licensed, the repository has about 5,200 stars, and documentation lives at wenet-e2e.github.io.
Should you use WeNet?
Pick it when
Pick WeNet when you train or fine-tune your own models and need one Conformer network to serve both live streaming and batch transcription, deployed through libtorch on servers or Android, gRPC, ONNX, or TensorRT.
Look elsewhere when
Skip it if you just want a pretrained model to run; the intended workflow assumes GPU training and compiling a runtime. Qwen3-ASR, Whisper, or Sherpa-ONNX are faster paths to working transcripts.
Alternatives to WeNet
- ESPnet
Broader research toolkit covering TTS and translation too, better for reproducing papers but less focused on deployment runtimes.
- FunASR (Paraformer)
Ready pretrained Chinese pipelines with VAD, punctuation, and serving, less training work than WeNet's train-then-compile flow.
- Sherpa-ONNX STT
Prebuilt streaming models on mobile, embedded, and web through ONNX Runtime, without training anything yourself.
- NVIDIA NeMo ASR
NVIDIA recipes with more English and multilingual pretrained checkpoints, while WeNet's pretrained focus is Chinese, but training is tied to NVIDIA GPUs.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- Apache-2.0
- Added
- Jul 29, 2026