Lumiere
Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4
Install
pip install lumiere
Usage
import torch
from lumiere.model import AttentionBasedInflationBlock
# B, T, H, W, D
x = torch.randn(1, 4, 224, 224, 512)
# Model
model = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)
# Forward pass
out = model(x)
# print
print(out.shape) # Expected shape: [1, 4, 224, 224, 3]
License
MIT
Release files for lumiere 0.0.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| lumiere-0.0.4.tar.gz | 4.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| lumiere-0.0.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.0 kB
Release files / lumiere-0.0.4.tar.gz
| Download URL | lumiere-0.0.4.tar.gz |
|---|---|
| Size | 4.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
06ab58c915a2ebe3326f83d88ad4abf09be0580f884d0766ca6596ca508ccd77
|
|
BLAKE2b-256 checksum How to use checksums |
cbce5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
|
Release files / lumiere-0.0.4-py3-none-any.whl
| Download URL | lumiere-0.0.4-py3-none-any.whl |
|---|---|
| Size | 4.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a59a84a9f5d0bffe8c226de5266e2ab8ee49df03fe7f46e1e405519aaf3c5403
|
|
BLAKE2b-256 checksum How to use checksums |
1d5bb098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
|