Magenta RealTime

Google's open-weights model for live music generation, steered in real time by text or audio prompts.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Google DeepMind's live music model generates a continuous stereo stream that can be steered while it plays, using text prompts, audio examples, or weighted blends of both, so a performer can morph between styles mid-jam. The current Magenta RealTime 2 release ships two open-weights checkpoints, a 230M-parameter Small and a 2.4B-parameter Base, with inference libraries in JAX, MLX, and C++ plus macOS example apps including an AUv3 plugin and the Jam and Collider tools. Real-time streaming runs on Apple Silicon, where Small works on any M-series Mac including Airs while Base needs a recent Pro or Max chip; offline generation also runs on any Apple Silicon Mac or on NVIDIA GPUs. Install is a uv pip install of the magenta-rt package followed by an mrt CLI command that pulls weights from Hugging Face. Code is Apache-2.0 and the weights carry CC-BY-4.0, so commercial use is allowed with attribution, and training used licensed stock music rather than scraped catalogs. It stands as the reference open option for latency-sensitive, interactive music generation.

Should you use Magenta RealTime?

Pick it when

Pick Magenta RealTime when you want music that responds live, morphing styles mid-performance from text or audio prompts, especially on an Apple Silicon Mac where the Small model streams in real time and an AUv3 plugin is available.

Look elsewhere when

Skip it if you need finished songs with lyrics and vocals; it is built for continuous jamming, so ACE-Step or MiniMax-Music3 fit better. Real-time streaming is documented only for Apple Silicon, with NVIDIA limited to offline use.

Alternatives to Magenta RealTime

  • Riffusion

    Also does real-time style interpolation and runs on CUDA, Apple Silicon, or CPU, but the project is no longer maintained and has no DAW plugin.

  • ACE-Step 1.5

    Renders complete songs with lyrics on an 8 GB GPU, the better fit when you need a finished track with vocals rather than a live stream.

  • VampNet

    Varies and infills existing audio with a Max/MSP integration for live experiments, but its checkpoints are non-commercial.

  • MusicGPT

    Runs MusicGen from one binary on macOS, Linux, or Windows with a web UI, simpler for prompt-to-clip, but no live steering and non-commercial weights.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0
Added
Aug 24, 2026

Tags