Griffin - Pytorch
Project description
Griffin
install
$ pip install griffin-torch
usage
import torch
from griffin_torch.main import Griffin
# Forward pass
x = torch.randint(0, 100, (1, 10))
# Model
model = Griffin(
dim=512, # Dimension of the model
num_tokens=100, # Number of tokens in the input
seq_len=10, # Length of the input sequence
depth=8, # Number of transformer blocks
mlp_mult=4, # Multiplier for the hidden dimension in the MLPs
dropout=0.1, # Dropout rate
)
# Forward pass
y = model(x)
print(y)
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
griffin_torch-0.0.3.tar.gz
(4.9 kB
view hashes)
Built Distribution
Close
Hashes for griffin_torch-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc9a42a5bae2b77ef661780a1ca0f5dbd1cde93a3cac668aad8f9dd5388e8d4a |
|
MD5 | 9384d530d99326e3aee800e0a4c4faff |
|
BLAKE2b-256 | 2b56843d2fb58540867cbccff543580d6fd8baa9c0259af015e3b770ecb6ebb8 |