Skip to main content

High-performance streaming video diffusion framework with pluggable model backends

Project description

flashdreams

A high-performance streaming inference framework for video diffusion models with a plugin architecture for model backends.

Features

  • Streaming Inference -- Autoregressive chunk-wise video generation with per-rollout cache state for bounded VRAM and arbitrarily long rollouts
  • Plugin Architecture -- Entry-point-based model discovery; third-party packages register runner configs that appear automatically in the CLI
  • Multi-GPU -- Context parallelism via torchrun with automatic sharding across ranks
  • Performance -- torch.compile support with CUDA graph capture and replay
  • Serving -- WebRTC and gRPC integrations for real-time interactive applications

Supported Models

Wan 2.1/2.2, Cosmos Predict2, and more via first-party integration packages.

Installation

pip install flashdreams

Documentation

https://github.com/NVIDIA/flashdreams

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flashdreams-0.1.0rc1-py3-none-any.whl (232.3 kB view details)

Uploaded Python 3

File details

Details for the file flashdreams-0.1.0rc1-py3-none-any.whl.

File metadata

  • Download URL: flashdreams-0.1.0rc1-py3-none-any.whl
  • Upload date:
  • Size: 232.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.18 {"installer":{"name":"uv","version":"0.11.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for flashdreams-0.1.0rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 be8dee43de2289a9e6dc1611aef2340af584d3a942ff870d87dbc1783061d4d8
MD5 0ad7143a9d4851c8f0d3fb9d06c3d807
BLAKE2b-256 ce262c85e3b32880486448c0f1bf6ca63f913b54476e31d37ccf22e37442fc70

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page