TeaCache

Training-free cache that speeds up video and image diffusion inference with minimal quality loss.

Open SourceSelf HostedOffline CapableGPU Required
0.0 (0)

About

Consecutive diffusion timesteps often produce similar outputs, and TeaCache exploits that: the Timestep Embedding Aware Cache estimates how much a model's output will change from its timestep embeddings and reuses cached computation when the predicted difference is small, accelerating inference with no retraining. Reported results include up to 4.41x acceleration on Open-Sora-Plan with a negligible 0.07 percent VBench score drop, around 2.1x on HunyuanVideo, and up to 2.25x on FLUX. The official ali-vilab repository ships per-model integrations for more than a dozen systems, spanning video models such as Wan 2.1, CogVideoX, LTX-Video, Mochi, and Cosmos, image models including FLUX, Lumina-Image 2.0, and HiDream-I1, and the TangoFlux audio model, each in its own subdirectory with example scripts, and a single threshold parameter trades speed against fidelity. The paper was accepted to CVPR 2025 as a highlight. Code is Apache-2.0 licensed with around 1,350 stars, and the technique has been adopted by downstream inference stacks such as xDiT and numerous ComfyUI workflows.

Should you use TeaCache?

Pick it when

Pick TeaCache when slow video generation with Wan 2.1, HunyuanVideo, CogVideoX, or LTX-Video is your bottleneck and you can accept a small fidelity tradeoff, set by one threshold, for a speedup with no retraining or new weights.

Look elsewhere when

Skip it if VRAM rather than speed is your limit, since caching does not shrink the model, where Nunchaku or ComfyUI-GGUF help, or if your model has no integration, because each one is a per-model script rather than a drop-in library.

Alternatives to TeaCache

  • Nunchaku

    Cuts VRAM and speeds up FLUX and Qwen-Image through 4-bit quantization, but needs SVDQuant checkpoints and lists no video models.

  • xDiT

    Spreads one generation across multiple GPUs for lower latency and can stack TeaCache on top, but needs a multi-GPU server and a harder setup.

  • ComfyUI-GGUF

    Shrinks FLUX and SD 3.5 Large with quantized files in ComfyUI, the right fix when a model will not load at all rather than when it is slow.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!