No project description provided
Project description
FBGEMM_GPU
FBGEMM_GPU (FBGEMM GPU Kernels Library) is a collection of high-performance PyTorch GPU operator libraries for training and inference. The library provides efficient table batched embedding bag, data layout transformation, and quantization supports.
FBGEMM_GPU is currently tested with cuda 12.1.0 and 11.8 in CI, and with PyTorch packages (2.1+) that are built against those CUDA versions.
Only Intel/AMD CPUs with AVX2 extensions are currently supported.
See our Documentation for more information.
Installation
The full installation instructions for the CUDA, ROCm, and CPU-only variants of FBGEMM_GPU can be found here. In addition, instructions for running example tests and benchmarks can be found here.
Build Instructions
This section is intended for FBGEMM_GPU developers only. The full build instructions for the CUDA, ROCm, and CPU-only variants of FBGEMM_GPU can be found here.
Join the FBGEMM_GPU Community
For questions, support, news updates, or feature requests, please feel free to:
- File a ticket in GitHub Issues
- Post a discussion in GitHub Discussions
- Reach out to us on the
#fbgemm
channel in PyTorch Slack
For contributions, please see the CONTRIBUTING
file for
ways to help out.
License
FBGEMM_GPU is BSD licensed, as found in the LICENSE
file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp312-cp312-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a6caa5ac5a3ca11b8aae0016047de0f0c74790dfe364759b1b233e426ac7d66 |
|
MD5 | 33ea36e6917ef57b0d558cffe0cad8e2 |
|
BLAKE2b-256 | 7bb0d04aa4347bcb55a84418815f95c6684c57f16127805a9f86bfb3f7826956 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp312-cp312-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 981f02196f2cf91f2d78cde945a1dd1bffec129f5e34c92ffe1eba980bed6779 |
|
MD5 | ef3c954d3527610ca230a88c619caa28 |
|
BLAKE2b-256 | 21eda05ac16e6b8c7503b2b8ede3461c4a03a1f61d1f73671f151dadc5c55be7 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp311-cp311-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b8bd39bcfa6544416678ee98f12fe3c7c6351c2519a88a5dd3a3d9f43fa03c6 |
|
MD5 | a128f81af6c30f6ed913313b873cd94c |
|
BLAKE2b-256 | e1cade28ba2e07c528676be816abb61b5739531e8906239644f6f448335f3671 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp311-cp311-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d686bf7fb4a3fa256b4c29fff08c0a46905aea1acb50cce96063886f10cf7d38 |
|
MD5 | 5702d3d012383ee372caca1b0b484d35 |
|
BLAKE2b-256 | bc0fad64f0d52be89df36f70eb3a7c08569f39342fb713ee83d66324c0befaa5 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp310-cp310-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d9ed1dca875a40be1f110388a44d0c194aa28e0e1ee51d6070bc223aa05c3e7f |
|
MD5 | 6b1b5bd781d8c499937500c31c5057a9 |
|
BLAKE2b-256 | 87d98423896692634c24d7c239c1c1306392a1cee208bd623c0c0bdc3d6e9074 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp310-cp310-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a0f329a5b2d538219f3004e99a44ac754b3521db6cc910b748d5f35b97fbfa94 |
|
MD5 | c0526de49fa1edbabb930fbfd1a15fb8 |
|
BLAKE2b-256 | 145fc136385c98381f0eba2dce49e7c789a5b786cf1161df9221f14ed71be671 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a0c7ec37a4695d537ff882d8b0d517b0a83363d5465de4e853043d46bc8aaa88 |
|
MD5 | afabc16d7443c2494f1076cd3c2612d3 |
|
BLAKE2b-256 | 11b11999fd9460be78b88c728c0c5bb2642715e8e63d1acf29859ab904cbf774 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp39-cp39-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9efcc00432e944e409b1e1203497fc35fca855e858fe7b94b303717e7a96f8a1 |
|
MD5 | 9929b577661b73c9c82e92570459e6ad |
|
BLAKE2b-256 | f4d0a78b5dafb639fdb5ef40927d5c1cf2904e020c4133a0442f9a3902bcf80b |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 52b05f6fd3efd6f9db4265e9c4e5d117f87b861a9fac16271eca1452f9c63c99 |
|
MD5 | f884695bd23b0ca6e2071f6f51a49c2c |
|
BLAKE2b-256 | 9be0066f64c312c6fbd7e121e5824db0a0a9824ad49bafc36d541257db230331 |
Hashes for fbgemm_gpu_cpu-0.6.0rc0-cp38-cp38-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e8268a87f705eb64835cb10bcd6fe9a4e85da0fb71796ec9011bdd7c5a01bc0 |
|
MD5 | 155960d2199137aa2d3e4ee3f9b56dda |
|
BLAKE2b-256 | 4108030ff44ba4d40a054e08a837ecb5c8f18e53338e060e9b7443c3fbd55029 |