Granite Speech

IBM's speech-aware Granite LLMs for transcription and speech translation in six languages.

Open SourceSelf HostedOffline Capable
0.0 (0)

About

IBM approaches ASR by grafting ears onto its Granite LLMs: Granite Speech 4.1 2B pairs a 16-block Conformer encoder trained with CTC and a window query transformer projector with a Granite 4.0 1B base model carrying 128K context, so one checkpoint both transcribes speech and translates it across its language set. Coverage spans English, French, German, Spanish, Portuguese, and Japanese, and the April 2026 release took a top spot on the Hugging Face Open ASR Leaderboard with a 5.33 mean word error rate at a 231 real-time factor, unusually strong numbers for a 2B model. Everything ships under Apache 2.0 with no usage restrictions, consistent with the wider Granite family's enterprise positioning. Inference paths include transformers 4.52.1 or newer, vLLM for serving, and llama.cpp and mlx-audio for local and Apple silicon use, so the model runs on modest hardware with no hosted API involved. For teams that want permissively licensed multilingual transcription with an LLM-style prompt interface, it is one of the cleanest current options.

Should you use Granite Speech?

Pick it when

Pick Granite Speech when you want top-tier transcription plus speech translation in English, French, German, Spanish, Portuguese, or Japanese under Apache 2.0, running on modest local hardware via llama.cpp or mlx-audio.

Look elsewhere when

Skip it if your languages fall outside its six, since Cohere Transcribe covers 14 and Whisper about 99, or if you need speaker labels; pair it with Pyannote or use MOSS-Transcribe for that.

Alternatives to Granite Speech

  • Cohere Transcribe

    Broader 14-language coverage including Mandarin, Korean, and Arabic at a near-identical WER (5.42 vs 5.33), but no speech translation and it expects a GPU.

  • Canary (NVIDIA NeMo)

    Also transcribes and translates, but needs NeMo and an NVIDIA GPU, and the original 1B weights are non-commercial.

  • Whisper

    About 99 languages and translation into English under MIT with a far larger tool ecosystem, but large-v3 averages 7.44 WER on the leaderboard where Granite posts 5.33.

  • Voxtral

    Also LLM-backed, adding summaries, Q&A, and function calls from audio, but the 24B version needs far more hardware than Granite's 2B.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0
Added
Aug 24, 2026

Tags