Skip to main content

Multi-Modality

Lumiere

Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4

Install

pip install lumiere

Usage

import torch
from lumiere.model import AttentionBasedInflationBlock

# B, T, H, W, D
x = torch.randn(1, 4, 224, 224, 512)

# Model
model = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)

# Forward pass
out = model(x)

# print
print(out.shape)  # Expected shape: [1, 4, 224, 224, 3]

License

MIT

Release files for lumiere 0.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lumiere 0.0.4
File Size Uploaded
lumiere-0.0.4.tar.gz 4.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for lumiere 0.0.4
File Interpreter ABI Platform
lumiere-0.0.4-py3-none-any.whl Python 3 none any Details

Total release size: 9.0 kB

Release files / lumiere-0.0.4.tar.gz

Download URL lumiere-0.0.4.tar.gz
Size 4.5 kB
Tags Source
SHA-256 checksum
How to use checksums
06ab58c915a2ebe3326f83d88ad4abf09be0580f884d0766ca6596ca508ccd77
BLAKE2b-256 checksum
How to use checksums
cbce5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0

Release files / lumiere-0.0.4-py3-none-any.whl

Download URL lumiere-0.0.4-py3-none-any.whl
Size 4.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a59a84a9f5d0bffe8c226de5266e2ab8ee49df03fe7f46e1e405519aaf3c5403
BLAKE2b-256 checksum
How to use checksums
1d5bb098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0

Release history Release notifications | RSS feed

This release

0.0.4 This release

2 release files

0.0.3

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page