GPT-SoVITS
Few-shot voice cloning and TTS combining GPT and SoVITS architectures.
About
GPT-SoVITS pairs a GPT-style semantic model with SoVITS voice synthesis for few-shot voice cloning and text-to-speech. Given only about five seconds of reference audio it performs zero-shot cloning, and with roughly one minute of data it can be fine-tuned for markedly better speaker similarity; it also does voice conversion between speakers. The system covers Chinese, English, Japanese, Korean, and Cantonese and can speak languages different from the reference voice's training data. A WebUI bundles the whole workflow, including tools for vocal separation, audio slicing, ASR-based labeling, and dataset preparation, so non-experts can train a voice end to end. Pretrained on around 5,000 hours of speech, it runs fastest on NVIDIA GPUs, with real-time factors near 0.03 on an RTX 4060 Ti, but also supports CPU and Apple Silicon. Released under the MIT license, it is a common choice for character voices, dubbing, and hobbyist voice cloning.
Should you use GPT-SoVITS?
Pick it when
Pick GPT-SoVITS to build a custom character or dubbing voice end to end in one WebUI, from vocal separation to labeling, cloning from 5 seconds or fine-tuning on about a minute of Chinese, English, Japanese, Korean, or Cantonese.
Look elsewhere when
Skip it if you need languages beyond its five or a model aimed at production serving rather than hobbyist training workflows. CosyVoice offers nine languages with streaming, and Fish Speech covers 80-plus.
Alternatives to GPT-SoVITS
- RVC (Retrieval-based Voice Conversion)
Converts existing recordings into a target voice, including singing, with a real-time mode, the better fit when you have source audio rather than text.
- Fish Speech
Zero-shot cloning across 80-plus languages with no fine-tuning step, far wider reach than five languages, but its weights carry a research license.
- CosyVoice
Apache-2.0 zero-shot cloning with streaming and dialect control in nine languages, built for production APIs more than hobbyist voice training.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Text-to-Speech (TTS)
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- Minimum VRAM
- 6 GB
- Added
- Apr 3, 2026