Magenta RealTime

Google's open-weights model for live music generation, steered in real time by text or audio prompts.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Google DeepMind's live music model generates a continuous stereo stream that can be steered while it plays, using text prompts, audio examples, or weighted blends of both, so a performer can morph between styles mid-jam. The current Magenta RealTime 2 release ships two open-weights checkpoints, a 230M-parameter Small and a 2.4B-parameter Base, with inference libraries in JAX, MLX, and C++ plus macOS example apps including an AUv3 plugin and the Jam and Collider tools. Real-time streaming runs on Apple Silicon, where Small works on any M-series Mac including Airs while Base needs a recent Pro or Max chip; offline generation also runs on any Apple Silicon Mac or on NVIDIA GPUs. Install is a uv pip install of the magenta-rt package followed by an mrt CLI command that pulls weights from Hugging Face. Code is Apache-2.0 and the weights carry CC-BY-4.0, so commercial use is allowed with attribution, and training used licensed stock music rather than scraped catalogs. It stands as the reference open option for latency-sensitive, interactive music generation.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0
Added
Aug 24, 2026

Related Tools

Latent diffusion model for text-to-audio, music, and speech generation.

Open SourceSelf HostedOfflineGPU 8GB+
Intermediate

Audio super-resolution model for upsampling audio to higher sample rates.

Open SourceSelf HostedOfflineGPU 6GB+
Intermediate
Featured

State-of-the-art music source separation model by Meta for splitting tracks.

Open SourceSelf HostedOffline
Easy

Fast music generation model producing full songs with lyrics in seconds.

Open SourceSelf HostedOfflineGPU 8GB+
Intermediate

Audio diffusion model by Harmonai for generating music samples.

Open SourceSelf HostedOfflineGPU 8GB+
Advanced

PyTorch library for deep learning research on audio generation including MusicGen and AudioGen.

Open SourceSelf HostedOfflineGPU
Intermediate
Browse all Music & Audio Generation tools