Whisper JAX

JAX-based Whisper implementation optimized for TPU/GPU with 70x+ speedup.

Open SourceSelf HostedOffline CapableGPU Required (8GB+ VRAM)
0.0 (0)

About

Whisper JAX reimplements OpenAI's Whisper in JAX and Flax on top of the Hugging Face Transformers codebase, targeting raw transcription throughput on accelerator hardware. Its speed comes from JIT compilation, data parallelism across devices via JAX's pmap, optional float16 or bfloat16 computation, and a batching strategy that splits long audio into 30 second chunks transcribed in parallel rather than sequentially. Benchmarks in the repository show a single A100 GPU transcribing an hour of audio in about 75 seconds against roughly 1,000 seconds for the original PyTorch version, and a TPU v4-8 doing the same in under 14 seconds, the source of its headline claim of over 70 times faster inference. All Whisper checkpoints from tiny through large-v2 are supported for multilingual transcription, translation, and timestamps, and the code runs on CPU, GPU, or TPU, standalone or as a Gradio inference endpoint. Open source under the Apache 2.0 license, it suits researchers and services that batch-process large audio archives on TPU or GPU infrastructure.

Should you use Whisper JAX?

Pick it when

Pick Whisper JAX when you batch-transcribe large audio archives on TPUs or multi-GPU JAX infrastructure and want parallel chunked decoding, about 75 seconds per hour of audio on one A100 in the repo's benchmarks.

Look elsewhere when

Skip it if you are not already on JAX or TPUs, or you need Whisper large-v3, since the project documents checkpoints only through large-v2. faster-whisper or Insanely Fast Whisper reach large speedups with PyTorch-friendly setups.

Alternatives to Whisper JAX

  • Insanely Fast Whisper

    Batched Flash Attention CLI on CUDA or Apple MPS with large-v3 and diarization, easier than JAX but with no TPU path.

  • faster-whisper

    CTranslate2 engine with 8-bit quantization on CPU or GPU, simpler to deploy and lighter on memory, without TPU scaling.

  • Distil-Whisper

    Smaller English checkpoints about six times faster than Whisper, a cheaper route to throughput if you do not need other languages.

  • WhisperX

    VAD batching at around 70x realtime plus word alignment and diarization, richer output, but no TPU support.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Advanced (4/5)
License
Apache-2.0
Minimum VRAM
8 GB
Added
Apr 3, 2026

Tags