Accelerate transformer inference by 6-8.5x. Native to Huggingface and PyTorch.
Project description
The author of this package has not provided a project description
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gptfast-0.2.1.tar.gz
(17.5 kB
view details)
Built Distribution
gptfast-0.2.1-py3-none-any.whl
(20.7 kB
view details)
File details
Details for the file gptfast-0.2.1.tar.gz
.
File metadata
- Download URL: gptfast-0.2.1.tar.gz
- Upload date:
- Size: 17.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2982c7e31a4b5992f930e903b27393b83f361e5dd8fc14c11b97f692fc79c6fb |
|
MD5 | 16d55041e5f3c32431a75ceb73c945b1 |
|
BLAKE2b-256 | ccf18f7aa938ba9a34f10c9a0062c9537031f681fe32101cd0d26693cf4bd877 |
File details
Details for the file gptfast-0.2.1-py3-none-any.whl
.
File metadata
- Download URL: gptfast-0.2.1-py3-none-any.whl
- Upload date:
- Size: 20.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2ce95845ca8664373f08e88cc41f4499a67962153356fd14fe35f3785ab02137 |
|
MD5 | c72f1f1d35140d32ea02f09250cda2e3 |
|
BLAKE2b-256 | 430e367ae03606c3a24533b0fec88aed4651e8bf23df26b8372b04a1e72e26ee |