MimicMotion
Tencent's pose-guided model for generating long, smooth human motion videos from a single image.
About
A reference photo plus a pose sequence is all MimicMotion needs to produce a video of that person performing the motion, and its ICML 2025 paper focuses on making such videos long and stable. Confidence-aware pose guidance weights the conditioning by pose-estimation confidence, cutting the distortion that creeps in when keypoints are unreliable, regional loss amplification reduces artifacts in high-confidence regions such as hands, and progressive latent fusion stitches overlapping segments so clips can run to arbitrary length, with segments of up to 72 frames at 576x1024 resolution. The implementation builds on Stable Video Diffusion with DWPose for pose extraction; setup is a conda environment from the provided environment.yaml plus weight downloads from Hugging Face, and generation fits in 8 GB of VRAM for the 16-frame model, with 16 GB recommended for the VAE decoder (a 35-second demo takes about 20 minutes on an RTX 4090). Code is Apache-2.0 licensed with about 2,600 stars, and the model is a staple of ComfyUI dance and motion-transfer workflows.
Should you use MimicMotion?
Pick it when
Pick it for long, stable dance or motion-transfer clips from one photo, especially in ComfyUI workflows, with Apache-2.0 code, 8 GB for the 16-frame model, and about 16 GB for comfortable VAE decoding.
Look elsewhere when
Skip it when render time matters: a 35-second clip takes about 20 minutes on an RTX 4090. For big pose changes where body shape must hold, Champ's 3D guidance fits better; for music-driven dance, Wan-Dancer.
Alternatives to MimicMotion
- Champ
3D SMPL guidance holds body shape through large pose changes and weights are MIT, but it needs about 20 GB and more preprocessing.
- Wan-Dancer
Generates choreography from a music track with no pose video needed, at minute-long 720p, but requires datacenter-scale multi-GPU hardware.
- MagicAnimate
ByteDance's DensePose-driven alternative at 12 GB, worth it if your pipeline already produces DensePose rather than DWPose skeletons.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Animation & Motion
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Minimum VRAM
- 8 GB
- Added
- Jul 29, 2026