AudioCraft
PyTorch library for deep learning research on audio generation including MusicGen and AudioGen.
About
AudioCraft is Meta's PyTorch library for research on generative audio. It bundles inference and training code for a family of models: MusicGen for controllable text-to-music, AudioGen for text-to-sound generation, the EnCodec neural audio codec for high-fidelity compression, MAGNeT for non-autoregressive music and sound generation, Multi Band Diffusion decoding, the AudioSeal watermarking tool, and JASCO, which conditions music generation on chords, melodies, and drum patterns. Training pipelines are included for EnCodec, MusicGen, Multi Band Diffusion, and JASCO, so researchers can train or fine-tune their own variants rather than only run released checkpoints. The library requires Python 3.9 and PyTorch 2.1.0, with ffmpeg for audio handling. The code is MIT licensed, while the released model weights carry a CC-BY-NC 4.0 non-commercial license, a distinction that matters for anyone planning production use. Its main audience is deep learning researchers and developers experimenting with audio generation.
Should you use AudioCraft?
Pick it when
Pick AudioCraft when you are researching or prototyping text-to-music and want training code, not just inference: it bundles MusicGen, AudioGen, EnCodec, MAGNeT, and JASCO's chord and melody conditioning in one PyTorch library.
Look elsewhere when
Skip it for commercial products: the code is MIT but the released weights are CC-BY-NC 4.0. None of its models take lyrics or sing, so for songs with vocals look at ACE-Step or DiffRhythm instead.
Alternatives to AudioCraft
- MusicGPT
Runs the same MusicGen models as a single Rust binary with a web UI and no Python, but it is inference only, with no training or JASCO conditioning.
- Stable Audio Open
Latent diffusion training stack with multi-node and DeepSpeed support, better for diffusion research, while AudioCraft centers on token-based models.
- ACE-Step
Full songs with vocals and lyrics on an 8 GB GPU, which AudioCraft cannot do, but it is one model rather than a library with codecs and watermarking.
- InspireMusic
Apache-2.0 repo code with multi-minute text-to-music at 48 kHz, but it requires NVIDIA plus flash-attn and covers fewer model families.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Music & Audio Generation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- MIT
- Added
- May 7, 2026