Paper - Pytorch
Project description
TeraGPT
Train a production grade GPT in less than 400 lines of code. Better than Karpathy's verison and GIGAGPT
Install
pip3 install teragpt
Usage
import torch
from teragpt.main import TeraGPT
model = TeraGPT(
dim=4096,
depth=6,
heads=8,
num_tokens=20000,
)
x = torch.randint(0, 20000, (1, 4096))
out = model(x)
print(out.shape)
Train
from teragpt import train
train()
License
MIT
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
teragpt-0.0.2.tar.gz
(11.0 kB
view hashes)
Built Distribution
teragpt-0.0.2-py3-none-any.whl
(11.0 kB
view hashes)
