Skip to main content

vllm-bnb-plugin

Out-of-tree bitsandbytes quantization plugin for vLLM.

Install

uv pip install -e /path/to/vllm-bnb-plugin

The package registers itself through the vllm.general_plugins entry-point group, so quantization="bitsandbytes" and load_format="bitsandbytes" remain available after installation.

What it provides

  • in-flight 4-bit bitsandbytes quantization
  • pre-quantized 4-bit and 8-bit bitsandbytes checkpoint loading
  • bitsandbytes linear and MoE quantization methods

Development

Install and enable the lint hooks:

uv pip install -r requirements/lint.txt
pre-commit install

Run all hooks:

pre-commit run --all-files

Metadata

Release files for vllm-bnb-plugin 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vllm-bnb-plugin 0.0.3
File Size Uploaded Provenance Actions
vllm_bnb_plugin-0.0.3.tar.gz 24.3 kB With provenance Details for vllm_bnb_plugin-0.0.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for vllm-bnb-plugin 0.0.3
File Interpreter ABI Platform Actions
vllm_bnb_plugin-0.0.3-py3-none-any.whl Python 3 none any Details for vllm_bnb_plugin-0.0.3-py3-none-any.whl

Total release size: 48.7 kB

Release files / vllm_bnb_plugin-0.0.3.tar.gz

Download URL vllm_bnb_plugin-0.0.3.tar.gz
Size 24.3 kB
Tags Source
SHA-256 checksum
How to use checksums
e884654a25a8b2a15f41644e0be28b811a176ffbe31a58a9ccc22aefc6525c7c
BLAKE2b-256 checksum
How to use checksums
d8b853c7cc5cbfcc77569d3d6b6f8e4b4f604887dc15ffb379d4ca4e12dc4291
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.

Transparency log

Release files / vllm_bnb_plugin-0.0.3-py3-none-any.whl

Download URL vllm_bnb_plugin-0.0.3-py3-none-any.whl
Size 24.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
46d5ce93018ea8daf92bc15235f19a01078e1f4c16303f5946cc1575404c094c
BLAKE2b-256 checksum
How to use checksums
cd762d56ecab32e131364014fda899bf567163df52a5d9e7b87a03586f1f87ab
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.

Transparency log

Security for vllm-bnb-plugin 0.0.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for vllm_bnb_plugin-0.0.3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 24, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page