Amphion
Research toolkit with reference implementations for speech, singing, voice conversion and audio generation.
About
Hosted under the OpenMMLab organization on GitHub, Amphion collects reference implementations of many speech and audio generation models in one PyTorch codebase for reproducible comparison. Recipes cover text-to-speech (FastSpeech2, VITS, VALL-E, NaturalSpeech2, MaskGCT), zero-shot voice and accent conversion through the Vevo family, singing voice synthesis and conversion, latent-diffusion text-to-audio, neural codecs like DualCodec, and GAN, flow, diffusion and autoregressive vocoders. It also bundles objective metrics such as F0 error, speaker similarity and FAD, dataset preprocessing, the Emilia pipeline for turning in-the-wild recordings into training data, and SingVisio, an interactive view into a diffusion-based singing converter. Setup is a conda environment plus a shell script, or a CUDA Docker image; training needs a capable NVIDIA GPU, while Hugging Face checkpoints allow inference-only tests. The code is MIT and usable commercially, but several released weights, including MaskGCT and Vevo, are CC BY-NC, so read each model card. Best for researchers who want comparable baselines rather than a finished app.
Should you use Amphion?
Pick it when
Pick Amphion when you are a researcher or student who wants one Apache-2.0 codebase spanning TTS, singing voice synthesis, voice conversion, and music generation, with reproducible recipes and architecture visualizations to learn from.
Look elsewhere when
Skip it if you just want to make songs or sound effects: it is a research toolkit with steep setup (difficulty 4) and an 8 GB GPU floor. ACE-Step or Stable Audio Open get you usable output with far less work.
Alternatives to Amphion
- AudioCraft
Narrower Meta library focused on music and sound with training code for MusicGen and EnCodec, but its released weights are non-commercial.
- ESPnet
Apache-2.0 speech toolkit that goes deeper on recognition and speech translation, but it does not target music generation and is even harder to set up.
- ACE-Step
Purpose-built song generator that makes full tracks with vocals on 8 GB, without the research scaffolding or the breadth across speech tasks.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Music & Audio Generation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- MIT
- Minimum VRAM
- 8 GB
- Added
- Apr 3, 2026