fastvideo 0.1.7

FastVideo

| Documentation | Quick Start | Weekly Dev Meeting | 🟣💬 Slack | 🟣💬 WeChat |

FastVideo is a unified post-training and inference framework for accelerated video generation.

NEWS

• 2025/11/19: Release CausalWan2.2 I2V A14B Preview models, Blog and Inference Code!
• 2025/08/04: Release FastWan models and Sparse-Distillation.

More

• 2025/06/14: Release finetuning and inference code for VSA
• 2025/04/24: FastVideo V1 is released!
• 2025/02/18: Release the inference code for Sliding Tile Attention.

Key Features

FastVideo has the following features:

• End-to-end post-training support for bidirectional and autoregressive models:
  • Support full finetuning and LoRA finetuning for state-of-the-art open video DiTs
  • Data preprocessing pipeline for video, image, and text data
  • Distribution Matching Distillation (DMD2) stepwise distillation.
  • Sparse attention with Video Sparse Attention
  • Sparse distillation to achineve >50x denoising speedup
  • Scalable training with FSDP2, sequence parallelism, and selective activation checkpointing.
  • Causal distillation through Self-Forcing
  • See this page for full list of supported models and recipes.
• State-of-the-art performance optimizations for inference
  • Sequence Parallelism for distributed inference
  • Multiple state-of-the-art attention backends
  • User-friendly CLI and Python API
  • See this page for full list of supported optimizations.
• Diverse hardware and OS support
  • Support H100, A100, 4090
  • Support Linux, Windows, MacOS
  • See this page for full list of supported hardware and OS.

Getting Started

We recommend using an environment manager such as Conda to create a clean environment:

# Create and activate a new conda environment
conda create -n fastvideo python=3.12
conda activate fastvideo

# Install FastVideo
pip install fastvideo

Please see our docs for more detailed installation instructions.

Sparse Distillation

For our sparse distillation techniques, please see our distillation docs and check out our blog.

See below for recipes and datasets:

Model	Sparse Distillation	Dataset
FastWan2.1-T2V-1.3B	Recipe	FastVideo Synthetic Wan2.1 480P
FastWan2.1-T2V-14B-Preview	Coming soon!	FastVideo Synthetic Wan2.1 720P
FastWan2.2-TI2V-5B	Recipe	FastVideo Synthetic Wan2.2 720P

Inference

Generating Your First Video

Here's a minimal example to generate a video using the default settings. Make sure VSA kernels are installed. Create a file called example.py with the following code:

import os
from fastvideo import VideoGenerator

def main():
    os.environ["FASTVIDEO_ATTENTION_BACKEND"] = "VIDEO_SPARSE_ATTN"

    # Create a video generator with a pre-trained model
    generator = VideoGenerator.from_pretrained(
        "FastVideo/FastWan2.1-T2V-1.3B-Diffusers",
        num_gpus=1,  # Adjust based on your hardware
    )

    # Define a prompt for your video
    prompt = "A curious raccoon peers through a vibrant field of yellow sunflowers, its eyes wide with interest."

    # Generate the video
    video = generator.generate_video(
        prompt,
        return_frames=True,  # Also return frames from this call (defaults to False)
        output_path="my_videos/",  # Controls where videos are saved
        save_video=True
    )

if __name__ == '__main__':
    main()

Run the script with:

python example.py

For a more detailed guide, please see our inference quick start.

Other docs:

• Design Overview
• Contribution Guide

Distillation and Finetuning

• Distillation Guide

Awesome work using FastVideo or our research projects

• SGLang: SGLang's diffusion inference functionality is based on a fork of FastVideo on Sept. 24, 2025.

• DanceGRPO: A unified framework to adapt Group Relative Policy Optimization (GRPO) to visual generation paradigms. Code based on FastVideo.

• SRPO: A method to directly align the full diffusion trajectory with fine-grained human preference. Code based on FastVideo.

• DCM: Dual-expert consistency model for efficient and high-quality video generation. Code based on FastVideo.

• Hunyuan Video 1.5: A leading lightweight video generation model, where they proposed SSTA based on Sliding Tile Attention.

• Kandinsky-5.0: A family of diffusion models for video & image generation, where their NABLA attention includes a Sliding Tile Attention branch.

• LongCat Video: A foundational video generation model with 13.6B parameters with block-sparse attention similar to Video Sparse Attention.

🤝 Contributing

We welcome all contributions. Please check out our guide here. See details in development roadmap.

Acknowledgement

We learned and reused code from the following projects:

• Wan-Video
• ThunderKittens
• Triton
• DMD2
• diffusers
• xDiT
• vLLM
• SGLang

We thank MBZUAI, Anyscale, and GMI Cloud for their support throughout this project.

Citation

If you find FastVideo useful, please considering citing our work:

@software{fastvideo2024,
  title        = {FastVideo: A Unified Framework for Accelerated Video Generation},
  author       = {The FastVideo Team},
  url          = {https://github.com/hao-ai-lab/FastVideo},
  month        = apr,
  year         = {2024},
}

@article{zhang2025vsa,
  title={Vsa: Faster video diffusion with trainable sparse attention},
  author={Zhang, Peiyuan and Chen, Yongqi and Huang, Haofeng and Lin, Will and Liu, Zhengzhong and Stoica, Ion and Xing, Eric and Zhang, Hao},
  journal={arXiv preprint arXiv:2505.13389},
  year={2025}
}

@article{zhang2025fast,
  title={Fast video generation with sliding tile attention},
  author={Zhang, Peiyuan and Chen, Yongqi and Su, Runlong and Ding, Hangliang and Stoica, Ion and Liu, Zhengzhong and Zhang, Hao},
  journal={arXiv preprint arXiv:2502.04507},
  year={2025}
}