bitsandbytes
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
The library includes quantization primitives for 8-bit & 4-bit operations, through bitsandbytes.nn.Linear8bitLt and bitsandbytes.nn.Linear4bit and 8-bit optimizers through bitsandbytes.optim module.
There are ongoing efforts to support further hardware backends, i.e. Intel CPU + GPU, AMD GPU, Apple Silicon. Windows support is quite far along and is on its way as well.
Please head to the official documentation page:
https://huggingface.co/docs/bitsandbytes/main
License
The majority of bitsandbytes is licensed under MIT, however small portions of the project are available under separate license terms, as the parts adapted from Pytorch are licensed under the BSD license.
We thank Fabio Cannizzo for his work on FastBinarySearch which we use for CPU quantization.
2 maintainers
Metadata
2 maintainers
Release files for bitsandbytes 0.43.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| bitsandbytes-0.43.1-py3-none-win_amd64.whl | Python 3 | none | Windows x86-64 | Details |
| bitsandbytes-0.43.1-py3-none-manylinux_2_24_x86_64.whl | Python 3 | none | Linux glibc 2.24+ x86-64 | Details |
Total release size: 221.4 MB
Release files / bitsandbytes-0.43.1-py3-none-win_amd64.whl
| Download URL | bitsandbytes-0.43.1-py3-none-win_amd64.whl |
|---|---|
| Size | 101.6 MB |
| Tags | Python 3 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
52c1c7189a6ca006555a9663e544e75f40520a97a26e075411f9f9aca0771fcd
|
|
BLAKE2b-256 checksum How to use checksums |
32e8ab6c97347c99cf5d18d0750c7336270719b17cb0610eb0a44cf833aa378f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.18
|
Release files / bitsandbytes-0.43.1-py3-none-manylinux_2_24_x86_64.whl
| Download URL | bitsandbytes-0.43.1-py3-none-manylinux_2_24_x86_64.whl |
|---|---|
| Size | 119.8 MB |
| Tags | Linux glibc 2.24+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
a81c826d576d6d691c7b4a7491c8fdc0f37f769795d6ca2e54afa605d2c260a3
|
|
BLAKE2b-256 checksum How to use checksums |
2fa4d8c8c1f69ceb3afdc285d62c65bec8d46900d70e81c9a8b24883001e23f8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.18
|
Security for bitsandbytes 0.43.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
