IndexTTS
Bilibili zero-shot voice cloning TTS with emotion, speed, and pronunciation control in five languages.
About
Bilibili's IndexTeam builds this zero-shot speech synthesizer, which copies a speaker's timbre from one reference clip with no fine-tuning. The current IndexTTS-2.5 model, released in August 2026 on a GPT backbone of roughly 0.8 billion parameters, covers Arabic, Chinese, English, Japanese, and Spanish, keeps voice identity separate from emotion, and takes emotion cues from a second audio clip, an eight-value vector, or a written description. Pronunciation can be pinned with Pinyin, CMU phonemes, or Kana, and a duration factor stretches or compresses delivery between half and double length; IndexTTS-2 and 1.5 remain loadable. The repo ships a browser web UI, a Python API, and a vLLM recipe for production serving. Setup runs through the uv package manager with weights from Hugging Face or ModelScope, a CUDA 12.8 or newer toolkit on NVIDIA hardware, and optional DeepSpeed and half-precision modes. Licensing follows bilibili's custom Model Use License Agreement, royalty-free for commercial work, except that firms above 100 million monthly users or RMB 1 billion revenue need a separate grant. Good for dubbing and narration builders.
Should you use IndexTTS?
Pick it when
Pick IndexTTS when you dub video and need zero-shot cloned speech whose duration you can control to match on-screen timing, with emotionally expressive delivery from IndexTTS2, on a GPU with about 6 GB.
Look elsewhere when
Skip it if you need a standard open license: it ships under bilibili's own Model Use License, which makes very large companies request a separate grant. To fix words inside existing takes instead, ViiTorVoice-NAR fits better.
Alternatives to IndexTTS
- ViiTorVoice-NAR
Apache-2.0 model that resynthesizes only the edited span of finished narration with about 60 ms first-frame latency, better for post-production fixes.
- MaskGCT
Zero-shot cloning with controllable duration from a non-autoregressive design, but its weights are non-commercial and setup runs through Amphion.
- CosyVoice
Apache-2.0 cloning with streaming in nine languages and clear licensing, but it controls speaking rate rather than an exact target duration.
- VoiceCraft
Edits existing recordings or clones voices on in-the-wild audio, useful for patching dialogue, but needs about 8 GB and its code and weights are non-commercial.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Text-to-Speech (TTS)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- bilibili Model Use License Agreement
- Minimum VRAM
- 6 GB
- Added
- Apr 3, 2026