Lumiere
Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research. I will mostly be implementing the modules from the diagram a and b in figure 4
Install
pip install lumiere
Usage
import torch
from lumiere.model import AttentionBasedInflationBlock
# B, T, H, W, D
x = torch.randn(1, 4, 224, 224, 512)
# Model
model = AttentionBasedInflationBlock(dim=512, heads=4, dropout=0.1)
# Forward pass
out = model(x)
# print
print(out.shape) # Expected shape: [1, 4, 224, 224, 3]
License
MIT
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lumiere-0.0.4.tar.gz
(4.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lumiere-0.0.4.tar.gz.
File metadata
- Download URL: lumiere-0.0.4.tar.gz
- Upload date:
- Size: 4.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
06ab58c915a2ebe3326f83d88ad4abf09be0580f884d0766ca6596ca508ccd77
|
|
| MD5 |
b6571f0ce570912cf2cfa904e661eced
|
|
| BLAKE2b-256 |
cbce5d56fea708bf4e1b42bf79613684d3db2ef53f06820d87c41828d16c1b9e
|
File details
Details for the file lumiere-0.0.4-py3-none-any.whl.
File metadata
- Download URL: lumiere-0.0.4-py3-none-any.whl
- Upload date:
- Size: 4.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a59a84a9f5d0bffe8c226de5266e2ab8ee49df03fe7f46e1e405519aaf3c5403
|
|
| MD5 |
fa83c256bd6bfca39232cf1cb400795e
|
|
| BLAKE2b-256 |
1d5bb098ba8806007b5e923a5910209bf3466da76dc5990b461bd47a67dbe0c4
|
