Skip to main content

High-performance streaming video diffusion framework with pluggable model backends

Project description

flashdreams

A high-performance streaming inference framework for video diffusion models with a plugin architecture for model backends.

Features

  • Streaming Inference -- Autoregressive chunk-wise video generation with per-rollout cache state for bounded VRAM and arbitrarily long rollouts
  • Plugin Architecture -- Entry-point-based model discovery; third-party packages register runner configs that appear automatically in the CLI
  • Multi-GPU -- Context parallelism via torchrun with automatic sharding across ranks
  • Performance -- torch.compile support with CUDA graph capture and replay
  • Serving -- WebRTC and gRPC integrations for real-time interactive applications

Supported Models

Wan 2.1/2.2, Cosmos Predict2, and more via first-party integration packages.

Installation

pip install flashdreams

Documentation

https://github.com/NVIDIA/flashdreams

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flashdreams-0.1.0-py3-none-any.whl (232.2 kB view details)

Uploaded Python 3

File details

Details for the file flashdreams-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: flashdreams-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 232.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.18 {"installer":{"name":"uv","version":"0.11.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for flashdreams-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 827f1d5df5a88bcb0a4facf0c27f61abfd1ef27a9ee5954d69ba0edd263e341f
MD5 2d83f657a965448b3af504963cc4965b
BLAKE2b-256 6af9e22f4b65573d21e648cb4d528b07fdc00b27c53eee46eb718a961f8a6b4c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page