kernels
The Kernel Hub allows Python libraries and applications to load compute kernels directly from the Hub. To support this kind of dynamic loading, Hub kernels differ from traditional Python kernel packages in that they are made to be:
- Portable: a kernel can be loaded from paths outside
PYTHONPATH. - Unique: multiple versions of the same kernel can be loaded in the same Python process.
- Compatible: kernels must support all recent versions of Python and the different PyTorch build configurations (various CUDA versions and C++ ABIs). Furthermore, older C library versions must be supported.
🚀 Quick Start
Install the kernels package with pip (requires torch>=2.5 and CUDA):
pip install kernels
Here is how you would use the activation kernels from the Hugging Face Hub:
import torch
from kernels import get_kernel
# Download optimized kernels from the Hugging Face hub
activation = get_kernel("kernels-community/activation")
# Random tensor
x = torch.randn((10, 10), dtype=torch.float16, device="cuda")
# Run the kernel
y = torch.empty_like(x)
activation.gelu_fast(y, x)
print(y)
You can search for kernels on the Hub.
📚 Documentation
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file kernels-0.3.3.tar.gz.
File metadata
- Download URL: kernels-0.3.3.tar.gz
- Upload date:
- Size: 13.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bfc659598361a27e02a9a4a92780cd58b3ecfb3b54fa442f39f05c04ce344161
|
|
| MD5 |
3a52c5475b2bcb31d61f43e6ab1358be
|
|
| BLAKE2b-256 |
36bff3c177e8cf39ba7cc019f5c5792dc9f44818a0394c29dbf83e476540b19b
|
File details
Details for the file kernels-0.3.3-py3-none-any.whl.
File metadata
- Download URL: kernels-0.3.3-py3-none-any.whl
- Upload date:
- Size: 11.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
72961afc82992ad37e75971bb6b7c3e73ababa874735f8be8e5a15441ae6a6b4
|
|
| MD5 |
8b3899f5455527b1c4013b6832375832
|
|
| BLAKE2b-256 |
5b266545d9d5b50594a13dc8fe386fac289d92f7baef618ef44637923a305882
|
