No project description provided
Project description
FBGEMM_GPU
FBGEMM_GPU (FBGEMM GPU Kernels Library) is a collection of high-performance PyTorch GPU operator libraries for training and inference. The library provides efficient table batched embedding bag, data layout transformation, and quantization supports.
FBGEMM_GPU is currently tested with cuda 12.1.0 and 11.8 in CI, and with PyTorch packages (2.1+) that are built against those CUDA versions.
Only Intel/AMD CPUs with AVX2 extensions are currently supported.
See our Documentation for more information.
Installation
The full installation instructions for the CUDA, ROCm, and CPU-only variants of FBGEMM_GPU can be found here. In addition, instructions for running example tests and benchmarks can be found here.
Build Instructions
This section is intended for FBGEMM_GPU developers only. The full build instructions for the CUDA, ROCm, and CPU-only variants of FBGEMM_GPU can be found here.
Join the FBGEMM_GPU Community
For questions, support, news updates, or feature requests, please feel free to:
- File a ticket in GitHub Issues
- Post a discussion in GitHub Discussions
- Reach out to us on the
#fbgemm
channel in PyTorch Slack
For contributions, please see the CONTRIBUTING
file for
ways to help out.
License
FBGEMM_GPU is BSD licensed, as found in the LICENSE
file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp312-cp312-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4708c8776c4e76633bf8ebff7e4674b01e68b6d51d7d518ead7f92ce0a62a798 |
|
MD5 | 2cfec9e2d6cb5500fcfcb8c42085747f |
|
BLAKE2b-256 | 2d882b96c889a9286f8838b49865e41250086c9512cd8d9ee431ab4cf1651d09 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp312-cp312-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d3b80dc95fb84f88304769271cdcb35dbff1db275124583e986776acce444cc |
|
MD5 | b991d96bdaec6cbf8d1a89659deb7401 |
|
BLAKE2b-256 | 8ddd89c9f9355ae907dc50be42068ca93ba9a8bc82b0ebb106d65a404432444b |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp311-cp311-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e26c5e0e0f2488a032bd81a505fbb0df7790f9607ecd8205151f14c0cac68fc8 |
|
MD5 | c9aa21ccf0f570b3407c48187342783f |
|
BLAKE2b-256 | 54c3085c9741e967085233a6ea4a77706c314bb4b10ec29135e0260e353dcb30 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp311-cp311-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4d67a9e7d748395e51502a2169b2b5a664240af29a8bfce4d00968eb879ff51 |
|
MD5 | 0779f01367545fc5d374c68820b18f32 |
|
BLAKE2b-256 | d9b66e14f2aef19cda8064b6c05f8f333ce36ad904ad4af0b379fd850c2a8b81 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp310-cp310-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb4c7c343f956c998e489f3180ded7d802361e4753d0379ab9563f91a2662a8f |
|
MD5 | 9a81764a8b2882863b18577e5789a8f5 |
|
BLAKE2b-256 | 9a7d23997100c96eaa58d65b53242fd93d8da6975d72192fd02e6316f9d7d8ad |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp310-cp310-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 964a61a734cde4dd7e63366a20bac30fc6db8d2de7c8615fd68892f161ada2fe |
|
MD5 | 65ef6f91992b8afc085cf45156113bbf |
|
BLAKE2b-256 | e7b9416feac0e3f663fbfc231f4040667ab45d4bf60bf36140012ae417f3f6e0 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37678426bddb8ca54edf1566185ea865dea6d279721d3016ff809a0a7d979114 |
|
MD5 | f977e21c5c9395505b27473ad66bfaeb |
|
BLAKE2b-256 | 985fb1b96b56ccc2f66578300861d62773e74eff5f1f9f17394b8c13df46bc5a |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp39-cp39-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee22c48ce55542baafe2ae54a6bc2d296880527e1fec905ed097f37bbff75cbf |
|
MD5 | afcbd4a09a9e33484c89b29bad54b49c |
|
BLAKE2b-256 | de5a435612815be530be97be816dfb55e95e393d8cc45d73713ad9196c16c1b6 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eae089cffd00a0e343ebde6519007287aba9663294890d1d69b3789321dc9881 |
|
MD5 | ed5cde99abbb7c32251076ec7b400adf |
|
BLAKE2b-256 | 096c6eefec726d449e37d4024c7ee774da676611cd280331b73a6ba131ae03d1 |
Hashes for fbgemm_gpu_cpu-0.6.0rc1-cp38-cp38-manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e9561235531a766e92a2fd689a35ad5d96f8937df4471b69ce107de3b960881 |
|
MD5 | 2113d92cf2b19d37d69fe3c169c2db59 |
|
BLAKE2b-256 | f3b242ddc3ce38ea20f435b6ad06b2bf837fc2072723e0aedd1d2a2bcceccdfc |