AudioCraft

PyTorch library for deep learning research on audio generation including MusicGen and AudioGen.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

AudioCraft is Meta's PyTorch library for research on generative audio. It bundles inference and training code for a family of models: MusicGen for controllable text-to-music, AudioGen for text-to-sound generation, the EnCodec neural audio codec for high-fidelity compression, MAGNeT for non-autoregressive music and sound generation, Multi Band Diffusion decoding, the AudioSeal watermarking tool, and JASCO, which conditions music generation on chords, melodies, and drum patterns. Training pipelines are included for EnCodec, MusicGen, Multi Band Diffusion, and JASCO, so researchers can train or fine-tune their own variants rather than only run released checkpoints. The library requires Python 3.9 and PyTorch 2.1.0, with ffmpeg for audio handling. The code is MIT licensed, while the released model weights carry a CC-BY-NC 4.0 non-commercial license, a distinction that matters for anyone planning production use. Its main audience is deep learning researchers and developers experimenting with audio generation.

Should you use AudioCraft?

Pick it when

Pick AudioCraft when you are researching or prototyping text-to-music and want training code, not just inference: it bundles MusicGen, AudioGen, EnCodec, MAGNeT, and JASCO's chord and melody conditioning in one PyTorch library.

Look elsewhere when

Skip it for commercial products: the code is MIT but the released weights are CC-BY-NC 4.0. None of its models take lyrics or sing, so for songs with vocals look at ACE-Step or DiffRhythm instead.

Alternatives to AudioCraft

  • MusicGPT

    Runs the same MusicGen models as a single Rust binary with a web UI and no Python, but it is inference only, with no training or JASCO conditioning.

  • Stable Audio Open

    Latent diffusion training stack with multi-node and DeepSpeed support, better for diffusion research, while AudioCraft centers on token-based models.

  • ACE-Step

    Full songs with vocals and lyrics on an 8 GB GPU, which AudioCraft cannot do, but it is one model rather than a library with codecs and watermarking.

  • InspireMusic

    Apache-2.0 repo code with multi-minute text-to-music at 48 kHz, but it requires NVIDIA plus flash-attn and covers fewer model families.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
MIT
Added
May 7, 2026

Tags