Skip to main content

Multi-Modality

Lumiere

Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4

Install

pip install lumiere

Usage

import torch
from lumiere.model import AttentionBasedInflationBlock

# B, T, H, W, D
x = torch.randn(1, 4, 224, 224, 512)

# Model
model = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)

# Forward pass
out = model(x)

# print
print(out.shape)  # Expected shape: [1, 4, 224, 224, 3]

License

MIT

Metadata

Release files for lumiere 0.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lumiere 0.0.4
File Size Uploaded Provenance
lumiere-0.0.4.tar.gz 4.5 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for lumiere 0.0.4
File Interpreter ABI Platform
lumiere-0.0.4-py3-none-any.whl Python 3 none any Details

Total release size: 9.0 kB

Release files / lumiere-0.0.4.tar.gz

Download URL lumiere-0.0.4.tar.gz
Size 4.5 kB
Tags Source
SHA-256 checksum
How to use checksums
06ab58c915a2ebe3326f83d88ad4abf09be0580f884d0766ca6596ca508ccd77
BLAKE2b-256 checksum
How to use checksums
cbce5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0

Release files / lumiere-0.0.4-py3-none-any.whl

Download URL lumiere-0.0.4-py3-none-any.whl
Size 4.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a59a84a9f5d0bffe8c226de5266e2ab8ee49df03fe7f46e1e405519aaf3c5403
BLAKE2b-256 checksum
How to use checksums
1d5bb098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0

Security for lumiere 0.0.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page