VITS
End-to-end TTS model combining a conditional VAE, adversarial training, and normalizing flows.
About
Few TTS codebases have been forked as often as VITS, the ICML 2021 reference implementation of a conditional variational autoencoder with adversarial training and normalizing flows that made single-stage end-to-end speech synthesis practical. A stochastic duration predictor lets it speak the same text with varied rhythm and pitch, and at release it produced more natural audio than the two-stage text-to-spectrogram-plus-vocoder pipelines that were standard at the time. The repository provides training recipes for single-speaker LJ Speech and multi-speaker VCTK at 22050 Hz, pretrained checkpoints via Google Drive, and an interactive Colab inference notebook; setup requires PyTorch, espeak for phonemization, and compiling the Cython monotonic alignment search module. Training realistically requires a CUDA GPU, while inference of pretrained models can run on CPU. The MIT license allows commercial use. Its architecture underpins a large share of the modern open TTS ecosystem, including the Coqui, so-vits-svc, and Bert-VITS2 lineages, and the original repo remains a research baseline at roughly 7.9k GitHub stars.
Should you use VITS?
Pick it when
Pick VITS when you are training a single or multi-speaker voice from scratch, need a well known MIT baseline to compare a new method against, or want to understand the architecture under Piper, Coqui, and Bert-VITS2.
Look elsewhere when
Skip it if you just want speech output: setup means compiling a Cython alignment module, checkpoints come from Google Drive, and there is no cloning. Piper packages VITS-style voices ready to run, and MeloTTS adds multilingual voices.
Alternatives to VITS
- Piper TTS
Production packaging of VITS-based voices with a CLI, HTTP server, and dozens of languages, the practical choice when you need to deploy.
- MeloTTS
Builds on VITS, VITS2, and Bert-VITS2 with a Python API, web UI, and real-time CPU inference in six languages under MIT, a product library rather than a research baseline.
- Matcha-TTS
Newer flow matching baseline with pip install, ONNX export, and speed versus quality controls, an alternative reference for research comparisons.
- StyleTTS 2
Reports human-level naturalness on LJSpeech and VCTK using style diffusion, a stronger quality baseline but more involved to train.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Text-to-Speech (TTS)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- MIT
- Added
- Jul 29, 2026