Attention kernels
Project description
attention-kernels
attention-kernels is a standalone package with the paged attention and
cache reshape kernels from vLLM, with modifications for TGI.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
attention-kernels-0.1.1.tar.gz
(49.7 kB
view details)
File details
Details for the file attention-kernels-0.1.1.tar.gz.
File metadata
- Download URL: attention-kernels-0.1.1.tar.gz
- Upload date:
- Size: 49.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | aff84a6e61e4720c14a2c2a62242b21c271d5d36bb6a0f0f017b762611b2d477 |
|
| MD5 | 5d035c7ad4e74d154ff63f9a30ac44ba |
|
| BLAKE2b-256 | 0a491847d04522158767065d24382b6fe2e0540a63f222113e273745f77ee2c5 |
