ACE-Step 1.5
Local song generator pairing a planning language model with a diffusion transformer, MIT licensed.
About
The second ACE-Step generation, published in January 2026, divides songwriting between two models: a language model acts as planner, expanding a short request into lyrics, captions, tempo, key and song structure, and a diffusion transformer then renders the audio. That split covers anything from a 10-second loop to a 10-minute piece, and stays quick, finishing a full track in under ten seconds on a 3090-class card. Edits include covers guided by reference audio, regenerating a selected section, stem separation, adding layers to a mix, backing tracks for a solo vocal, and timestamped lyrics. It ships a Gradio interface, a REST server, a CLI, a Python API, portable Windows and macOS bundles, and a separate VST3 plugin for DAWs. Installation uses uv with Python 3.11 or 3.12; CUDA is the main target, though ROCm, Intel XPU, Apple MPS and CPU also work, and the 2B model runs without the planner in about 4 GB of VRAM while the 4B XL variants want 12 to 20 GB. Style LoRAs can be trained from a few songs in the UI. Code and weights are MIT, which suits producers and app builders who need a commercially usable local song generator.
Should you use ACE-Step 1.5?
Pick it when
Pick ACE-Step 1.5 for new lyric-to-song work on a consumer GPU: it fits an 8 GB card, is MIT licensed in its own repo, takes lyrics in 50+ languages, and can learn your own style as a LoRA trained on a few songs.
Look elsewhere when
Skip it if you need the exact v1 checkpoint to reproduce older results, or want the biggest open lyric-to-song stack: MiniMax-Music3 plans five-minute songs with an 8B model but wants about 24 GB at full precision.
Alternatives to ACE-Step 1.5
- ACE-Step
The original v1 checkpoint under Apache-2.0, worth running only to reproduce older results or to compare against the 1.5 update.
- MiniMax-Music3
Hierarchical 8B plus 2.4B stack for five-minute structured songs, heavier at about 24 GB, with a community license capped at 20 million dollars revenue.
- HeartMuLa
Apache-2.0 with standalone codec, lyrics transcription, and music-text alignment models, but its 3B generator runs near real time instead of in seconds.
- YuE
Dedicated 7B variants for English, Japanese, Korean, and Chinese with in-context learning, but it needs 16 GB or more of VRAM and harder setup.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Music & Audio Generation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- MIT
- Minimum VRAM
- 8 GB
- Added
- Apr 3, 2026