Sherpa-ONNX STT
Offline speech recognition library on ONNX Runtime for servers, phones, embedded boards, and browsers.
About
From the k2-fsa group behind next-generation Kaldi, sherpa-onnx packages speech models as ONNX files and runs them through ONNX Runtime offline on servers, phones, single-board computers, and in browsers through WebAssembly. For recognition it supports both streaming mode, with text appearing mid-sentence, and decoding of finished recordings, with prebuilt models that include Zipformer transducers, Paraformer, Whisper, NVIDIA NeMo models such as Parakeet, SenseVoice, Moonshine, and others across many languages. Voice activity detection, keyword spotting, punctuation, speaker diarization, and language identification come in the same library, which also does text-to-speech. APIs cover a dozen languages, from C++ and Python to Swift, Kotlin, Dart, and Rust, and a WebSocket server is included. CPU inference is the norm, with optional acceleration on Jetson boards and several NPUs (Rockchip, Qualcomm, Ascend, Axera, Intel). Install via pip install sherpa-onnx or prebuilt binaries. The code is Apache 2.0, while each model keeps its own license. Aimed at developers needing private, on-device transcription.
Should you use Sherpa-ONNX STT?
Pick it when
Pick Sherpa-ONNX when you ship offline speech recognition inside Android, iOS, desktop, embedded, or WebAssembly apps and want streaming and non-streaming models plus VAD and TTS in one Apache 2.0 runtime.
Look elsewhere when
Skip it if you want one strong model rather than a runtime, or you work only in Python on a server, where faster-whisper or Parakeet are simpler. Apple-only apps can use WhisperKit's Core ML path instead.
Alternatives to Sherpa-ONNX STT
- Whisper.cpp
Whisper accuracy and about 99 languages in a C/C++ library with Metal and CUDA paths, but one model family instead of Sherpa's broader catalog.
- Vosk
Simpler API with compact models and runtime vocabularies for command grammars, but accuracy below large modern models.
- Moonshine
MIT models built for edge streaming with packages for iOS, Android, and Windows, a tighter package but fewer model choices.
- WhisperKit
Core ML and Neural Engine acceleration tuned for Apple hardware, but no Android, Linux, or web support.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026