Deploy vLLM models to a ray cluster
Project description
ray-vllm
A tool for deploying LLMs to a Ray Serve cluster
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ray_vllm-0.9.2.tar.gz
(3.2 kB
view details)
Built Distribution
File details
Details for the file ray_vllm-0.9.2.tar.gz.
File metadata
- Download URL: ray_vllm-0.9.2.tar.gz
- Upload date:
- Size: 3.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f27f421de61ff6f060653f26f235a3c9e60d00d44c833d5739b6d832410f6585
|
|
| MD5 |
bbd2ca9c3c19535feeb83fdaf085deca
|
|
| BLAKE2b-256 |
5ac811e8c2f9d2bd44d31a4c05ad5ce9fbd06ef63efcc96bc8af134519af8448
|
File details
Details for the file ray_vllm-0.9.2-py3-none-any.whl.
File metadata
- Download URL: ray_vllm-0.9.2-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
072bd8425dde46d6a8384c795e2c62ebc3ac6aa4c8b6b647c57e948c62359511
|
|
| MD5 |
9c388035e97ed9d61f29665986375a8e
|
|
| BLAKE2b-256 |
b91191580dabb31f3a1e6fcbf37193f5ba5fbc739a0af2650bb796fcd86d49d9
|
