This release is a pre-release and may not be stable for production use.
vLLM RBLN Plugin
This repository provides the hardware plugin that enables vLLM on RBLN NPUs, including ATOM and REBEL.
Built on top of vLLM’s Plugin System, it allows seamless integration with the vLLM ecosystem and provides high-throughput, low-latency LLM serving on RBLN hardware. Our plugin supports a wide range of popular LLMs and continues to expand to support all features enabled in vLLM, including advanced attention mechanisms.
🚀 Getting Started
📋 Prerequisites
rebel-compileroptimum-rbln
⚙️ Installation
You can install this project using pip or from source.
Install via PyPI
Using uv
uv pip install vllm-rbln --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --torch-backend cpu
Using pip
pip install vllm-rbln --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --extra-index-url https://download.pytorch.org/whl/cpu
Or from source
Using uv
git clone https://github.com/rbln-sw/vllm-rbln.git
cd vllm-rbln
uv pip install -e .
Using pip
git clone https://github.com/rbln-sw/vllm-rbln.git
cd vllm-rbln
pip install -e . --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --extra-index-url https://download.pytorch.org/whl/cpu
🛠️ Development setup
Building from source? See DEVELOPMENT.md for the uv dev workflow.
📚 Documentation
🤝 Contributing
We welcome all contributions! Whether it's reporting issues, proposing enhancements, or improving docs—your input helps make the project better.
See our CONTRIBUTING.md for more information.
📄 License
This project is licensed under the Apache License 2.0.
See the LICENSE file for more information.
📧 Contact
- Join discussions and get answers in our Developer Community
- Contact maintainers at support@rebellions.ai
1 maintainer
Metadata
1 maintainer
Release files for vllm-rbln 0.12.1.dev0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| vllm_rbln-0.12.1.dev0-py3-none-any.whl | Python 3 | none | any | Details |
Release files / vllm_rbln-0.12.1.dev0-py3-none-any.whl
| Download URL | vllm_rbln-0.12.1.dev0-py3-none-any.whl |
|---|---|
| Size | 606.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
05421a2bdbefecb490cfe26dea666d42eb2f2deb140b13cb05d87ce73db8dda1
|
|
BLAKE2b-256 checksum How to use checksums |
5a9d568ba99690f84e92c93a3988102586d204610489a0b424d24fa307146e6c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
