Pyramid Flow
Efficient video generation using pyramid-shaped flow matching.
About
Pyramid Flow generates video autoregressively using flow matching over a pyramid of resolutions: instead of running every denoising step at full resolution, it interpolates between latents at different scales and noise levels, which cuts compute substantially. A single Diffusion Transformer, trained in about 20,700 A100 GPU hours exclusively on open datasets including WebVid-10M, OpenVid-1M, and Open-Sora Plan, produces 10 second clips at 768p and 24 fps or 5 second clips at 384p, supports image-to-video with text conditioning, and includes a miniFLUX variant for image generation up to 1024p. Inference fits in as little as 8 GB of VRAM with sequential CPU offloading, and on the VBench benchmark the model surpasses the open-source baselines it was compared against while approaching commercial systems such as Kling and Gen-3 Alpha on quality and motion smoothness scores. Code and checkpoints are released under the MIT license, attracting researchers and hobbyists interested in reproducible video generation built on open data.
Should you use Pyramid Flow?
Pick it when
Pick Pyramid Flow when training data provenance matters, since it was trained only on open datasets and ships under MIT, or when you want 10 second 768p clips from an 8 to 12 GB card using sequential CPU offload.
Look elsewhere when
Skip it if you need output above 768p or a soundtrack: Kandinsky 5.0 Pro reaches 1080p under the same MIT terms, and LTX-2.5 or Ovi generate synchronized audio. Sequential offload down to 8 GB also slows each clip.
Alternatives to Pyramid Flow
- FramePack
Generates up to 60 seconds on 6 GB with flat memory use and a one-click Windows package, but centers on image-to-video rather than text prompts.
- Kandinsky 5.0
Also MIT, with a 2B Lite tier for 5 to 10 second clips and a 19B Pro tier up to 1080p plus Diffusers and ComfyUI, though Lite outputs 768x512.
- Wan 2.1
Apache-2.0 with 720p tiers, first-and-last-frame control, and VACE editing, a broader toolset, but without Pyramid Flow's open-dataset training provenance.
- Allegro
Apache-2.0 720p output with first and last frame conditioning, but clips run 6 seconds and take about 20 minutes each on one H100.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- Video Generation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- MIT
- Minimum VRAM
- 12 GB
- Added
- Apr 3, 2026