IndexTTS

Bilibili zero-shot voice cloning TTS with emotion, speed, and pronunciation control in five languages.

Open SourceSelf HostedOffline CapableGPU Required (6GB+ VRAM)
0.0 (0)

About

Bilibili's IndexTeam builds this zero-shot speech synthesizer, which copies a speaker's timbre from one reference clip with no fine-tuning. The current IndexTTS-2.5 model, released in August 2026 on a GPT backbone of roughly 0.8 billion parameters, covers Arabic, Chinese, English, Japanese, and Spanish, keeps voice identity separate from emotion, and takes emotion cues from a second audio clip, an eight-value vector, or a written description. Pronunciation can be pinned with Pinyin, CMU phonemes, or Kana, and a duration factor stretches or compresses delivery between half and double length; IndexTTS-2 and 1.5 remain loadable. The repo ships a browser web UI, a Python API, and a vLLM recipe for production serving. Setup runs through the uv package manager with weights from Hugging Face or ModelScope, a CUDA 12.8 or newer toolkit on NVIDIA hardware, and optional DeepSpeed and half-precision modes. Licensing follows bilibili's custom Model Use License Agreement, royalty-free for commercial work, except that firms above 100 million monthly users or RMB 1 billion revenue need a separate grant. Good for dubbing and narration builders.

Should you use IndexTTS?

Pick it when

Pick IndexTTS when you dub video and need zero-shot cloned speech whose duration you can control to match on-screen timing, with emotionally expressive delivery from IndexTTS2, on a GPU with about 6 GB.

Look elsewhere when

Skip it if you need a standard open license: it ships under bilibili's own Model Use License, which makes very large companies request a separate grant. To fix words inside existing takes instead, ViiTorVoice-NAR fits better.

Alternatives to IndexTTS

  • ViiTorVoice-NAR

    Apache-2.0 model that resynthesizes only the edited span of finished narration with about 60 ms first-frame latency, better for post-production fixes.

  • MaskGCT

    Zero-shot cloning with controllable duration from a non-autoregressive design, but its weights are non-commercial and setup runs through Amphion.

  • CosyVoice

    Apache-2.0 cloning with streaming in nine languages and clear licensing, but it controls speaking rate rather than an exact target duration.

  • VoiceCraft

    Edits existing recordings or clones voices on in-the-wild audio, useful for patching dialogue, but needs about 8 GB and its code and weights are non-commercial.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
bilibili Model Use License Agreement
Minimum VRAM
6 GB
Added
Apr 3, 2026

Tags