This release is a pre-release and may not be stable for production use.
vLLM RBLN Plugin
This repository provides the hardware plugin that enables vLLM on RBLN NPUs, including ATOM and REBEL.
Built on top of vLLM’s Plugin System, it allows seamless integration with the vLLM ecosystem and provides high-throughput, low-latency LLM serving on RBLN hardware. Our plugin supports a wide range of popular LLMs and continues to expand to support all features enabled in vLLM, including advanced attention mechanisms.
🚀 Getting Started
📋 Prerequisites
rebel-compileroptimum-rbln
⚙️ Installation
You can install this project using pip or from source.
Install via PyPI
Using uv
uv pip install vllm-rbln --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --torch-backend cpu
Using pip
pip install vllm-rbln --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --extra-index-url https://download.pytorch.org/whl/cpu
Or from source
Using uv
git clone https://github.com/rbln-sw/vllm-rbln.git
cd vllm-rbln
uv pip install -e .
Using pip
git clone https://github.com/rbln-sw/vllm-rbln.git
cd vllm-rbln
pip install -e . --extra-index-url https://wheels.vllm.ai/0.24.0/cpu --extra-index-url https://download.pytorch.org/whl/cpu
🛠️ Development setup
Building from source? See DEVELOPMENT.md for the uv dev workflow.
📚 Documentation
🤝 Contributing
We welcome all contributions! Whether it's reporting issues, proposing enhancements, or improving docs—your input helps make the project better.
See our CONTRIBUTING.md for more information.
📄 License
This project is licensed under the Apache License 2.0.
See the LICENSE file for more information.
📧 Contact
- Join discussions and get answers in our Developer Community
- Contact maintainers at support@rebellions.ai
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vllm_rbln-0.11.2a9-py3-none-any.whl.
File metadata
- Download URL: vllm_rbln-0.11.2a9-py3-none-any.whl
- Upload date:
- Size: 432.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/7.0.0 CPython/3.13.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
52b050f6bb35cecbf2aadbc2e469517d88eabf3c401453fcbb05f10239422b89
|
|
| MD5 |
cbe80934b185f45eaa543fafee3d20ce
|
|
| BLAKE2b-256 |
1fcd9b18c4e539d55534013f3e07a41fb521dae7a51eadc9e8ea6245f7c3640b
|
