Accelerate transformer inference by 7.6-9x. Native to Huggingface and PyTorch.
Project description
The author of this package has not provided a project description
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gptfast-0.3.1.tar.gz
(35.0 kB
view details)
Built Distribution
gptfast-0.3.1-py3-none-any.whl
(48.8 kB
view details)
File details
Details for the file gptfast-0.3.1.tar.gz.
File metadata
- Download URL: gptfast-0.3.1.tar.gz
- Upload date:
- Size: 35.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2b43c65dd8a1cf7af39ee87953f435156e5c92aff0821c2c2403f69fc5600cea |
|
| MD5 | 8b51b7a552a99862ca0a59f0442bf667 |
|
| BLAKE2b-256 | 55c472537eaa5a564030fdc8aec9b994172dd34c82b3bfac2fe7dcf44752a09a |
File details
Details for the file gptfast-0.3.1-py3-none-any.whl.
File metadata
- Download URL: gptfast-0.3.1-py3-none-any.whl
- Upload date:
- Size: 48.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7e4367f257b0cfeb272fe96f7f781816731f0d906f094ac581d68c0207042980 |
|
| MD5 | f3101ee212d6ab5906f9bd1d44c77898 |
|
| BLAKE2b-256 | 8cb03af36aade86c262a9b40a33749e30368cbb52a47b3e4ba85645f739527d4 |
