flashdreams
A high-performance streaming inference framework for video diffusion models with a plugin architecture for model backends.
Features
- Streaming Inference -- Autoregressive chunk-wise video generation with per-rollout cache state for bounded VRAM and arbitrarily long rollouts
- Plugin Architecture -- Entry-point-based model discovery; third-party packages register runner configs that appear automatically in the CLI
- Multi-GPU -- Context parallelism via torchrun with automatic sharding across ranks
- Performance -- torch.compile support with CUDA graph capture and replay
- Serving -- WebRTC and gRPC integrations for real-time interactive applications
Supported Models
Wan 2.1/2.2, Cosmos Predict2, and more via first-party integration packages.
Installation
pip install flashdreams
Documentation
1 maintainer
Release files for flashdreams 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flashdreams-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Release files / flashdreams-0.1.0-py3-none-any.whl
| Download URL | flashdreams-0.1.0-py3-none-any.whl |
|---|---|
| Size | 232.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
827f1d5df5a88bcb0a4facf0c27f61abfd1ef27a9ee5954d69ba0edd263e341f
|
|
BLAKE2b-256 checksum How to use checksums |
6af9e22f4b65573d21e648cb4d528b07fdc00b27c53eee46eb718a961f8a6b4c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.18 {"installer":{"name":"uv","version":"0.11.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
