Griffin
install
$ pip install griffin-torch
usage
import torch
from griffin_torch.main import Griffin
# Forward pass
x = torch.randint(0, 100, (1, 10))
# Model
model = Griffin(
dim=512, # Dimension of the model
num_tokens=100, # Number of tokens in the input
seq_len=10, # Length of the input sequence
depth=8, # Number of transformer blocks
mlp_mult=4, # Multiplier for the hidden dimension in the MLPs
dropout=0.1, # Dropout rate
)
# Forward pass
y = model(x)
print(y)
License
MIT
1 maintainer
Metadata
1 maintainer
Release files for griffin-torch 0.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| griffin_torch-0.0.3.tar.gz | 4.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| griffin_torch-0.0.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.8 kB
Release files / griffin_torch-0.0.3.tar.gz
| Download URL | griffin_torch-0.0.3.tar.gz |
|---|---|
| Size | 4.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
61bf1baa51ca906aa0b2785bbdb3e466fae00e2787fd14a32ba182463df6c37d
|
|
BLAKE2b-256 checksum How to use checksums |
88e64c282c5d9bd2dab6e762a2fe10e21655bedaec7288d58ca6b8f0888ac52b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/23.3.0
|
Release files / griffin_torch-0.0.3-py3-none-any.whl
| Download URL | griffin_torch-0.0.3-py3-none-any.whl |
|---|---|
| Size | 4.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dc9a42a5bae2b77ef661780a1ca0f5dbd1cde93a3cac668aad8f9dd5388e8d4a
|
|
BLAKE2b-256 checksum How to use checksums |
2b56843d2fb58540867cbccff543580d6fd8baa9c0259af015e3b770ecb6ebb8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/23.3.0
|
