Amphion

Research toolkit with reference implementations for speech, singing, voice conversion and audio generation.

Open SourceSelf HostedOffline CapableGPU Required (8GB+ VRAM)
0.0 (0)

About

Hosted under the OpenMMLab organization on GitHub, Amphion collects reference implementations of many speech and audio generation models in one PyTorch codebase for reproducible comparison. Recipes cover text-to-speech (FastSpeech2, VITS, VALL-E, NaturalSpeech2, MaskGCT), zero-shot voice and accent conversion through the Vevo family, singing voice synthesis and conversion, latent-diffusion text-to-audio, neural codecs like DualCodec, and GAN, flow, diffusion and autoregressive vocoders. It also bundles objective metrics such as F0 error, speaker similarity and FAD, dataset preprocessing, the Emilia pipeline for turning in-the-wild recordings into training data, and SingVisio, an interactive view into a diffusion-based singing converter. Setup is a conda environment plus a shell script, or a CUDA Docker image; training needs a capable NVIDIA GPU, while Hugging Face checkpoints allow inference-only tests. The code is MIT and usable commercially, but several released weights, including MaskGCT and Vevo, are CC BY-NC, so read each model card. Best for researchers who want comparable baselines rather than a finished app.

Should you use Amphion?

Pick it when

Pick Amphion when you are a researcher or student who wants one Apache-2.0 codebase spanning TTS, singing voice synthesis, voice conversion, and music generation, with reproducible recipes and architecture visualizations to learn from.

Look elsewhere when

Skip it if you just want to make songs or sound effects: it is a research toolkit with steep setup (difficulty 4) and an 8 GB GPU floor. ACE-Step or Stable Audio Open get you usable output with far less work.

Alternatives to Amphion

  • AudioCraft

    Narrower Meta library focused on music and sound with training code for MusicGen and EnCodec, but its released weights are non-commercial.

  • ESPnet

    Apache-2.0 speech toolkit that goes deeper on recognition and speech translation, but it does not target music generation and is even harder to set up.

  • ACE-Step

    Purpose-built song generator that makes full tracks with vocals on 8 GB, without the research scaffolding or the breadth across speech tasks.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Advanced (4/5)
License
MIT
Minimum VRAM
8 GB
Added
Apr 3, 2026

Tags