VACE
All-in-one video model unifying reference-to-video, video-to-video, and masked editing.
About
One model covering reference-to-video generation, video-to-video editing, and masked video editing is the pitch of VACE, the Alibaba Tongyi vision lab framework accepted to ICCV 2025. Its unifying idea is the Video Condition Unit, an input format that packs text, reference images, source video, and spatiotemporal masks into a single conditional interface, so tasks such as pose transfer, outpainting, object swap, inpainting, and move-anything composition all run through the same weights instead of separate specialist models. Released checkpoints build on Wan2.1 at 1.3B and 14B parameters plus an LTX-Video 0.9 variant, with the 1.3B model aimed at consumer GPUs. Installation is a pip requirements setup on PyTorch 2.5.1 with CUDA 12.4, and the models reach the broader ecosystem through native Diffusers support and Kijai's ComfyUI wrapper, with VACE capabilities folded into the Wan model line. The Apache-2.0 repository, at about 3,900 GitHub stars, also publishes VACE-Benchmark evaluation data, making it the reference open toolkit for controllable video editing.
Should you use VACE?
Pick it when
You want one set of weights for controllable video work, such as pose transfer, outpainting, object swap, inpainting, and reference-to-video on Wan2.1, using the 1.3B model on a consumer GPU or 14B on larger cards.
Look elsewhere when
You only need to erase something from existing footage: ProPainter reuses real pixels instead of generating them. For plain text-to-video or image-to-video, the Wan models directly or WanGP on 6GB cards are simpler.
Alternatives to VACE
- ProPainter
Dedicated video inpainting that reuses real pixels from neighboring frames, more faithful for removal, but non-commercial and no generation.
- Wan 2.1
The base Wan suite, which now includes VACE models; pick it for text or image to video when you do not need masks or references.
- WanGP
Runs Wan models on GPUs down to 6GB with quantization and built-in masking, but under the source-available WanGP Community License.
- FaceFusion
Specialized face swapping across video on CUDA, CoreML, ROCm, or plain CPU, far simpler than VACE when only faces need to change.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Image/Video Editing
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Added
- Jul 29, 2026