Accelerate transformer inference by 6-8.5x. Native to Huggingface and PyTorch.
Project description
The author of this package has not provided a project description
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gptfast-0.2.0.tar.gz
(13.4 kB
view details)
Built Distribution
gptfast-0.2.0-py3-none-any.whl
(16.5 kB
view details)
File details
Details for the file gptfast-0.2.0.tar.gz.
File metadata
- Download URL: gptfast-0.2.0.tar.gz
- Upload date:
- Size: 13.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | af91ce7a165e963e2a2ab2dff8fe01bcf9c3bb157c85571ff84ef7e3dba2e032 |
|
| MD5 | 4e346914f06e1d44ceef61bdd45dec72 |
|
| BLAKE2b-256 | 80d98cf7616da571ba65925c3b3a99e45d2f3aaaaa6b78818966b62edcf41787 |
File details
Details for the file gptfast-0.2.0-py3-none-any.whl.
File metadata
- Download URL: gptfast-0.2.0-py3-none-any.whl
- Upload date:
- Size: 16.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 979fb3512bda7e78a2363fd460883723687ea4732e6d6c877ecb1bdd5dbfb061 |
|
| MD5 | cf0099243644e4716d20a959032f77ca |
|
| BLAKE2b-256 | dc25663b2aeeb800f9cede9a91cf6d4f97a06beaa72fec9300d0d0cfe5556d39 |
