A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.5.tar.gz
(1.1 MB
view details)
Built Distribution
File details
Details for the file vllm-0.5.5.tar.gz.
File metadata
- Download URL: vllm-0.5.5.tar.gz
- Upload date:
- Size: 1.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 14abe33243939e18cdc437abfc78543aac62e11a43f66d36ec855a3e40c797dd |
|
| MD5 | ab597f01f85cec8da7170b418aca5b28 |
|
| BLAKE2b-256 | ecf032ea866485d83d1fcde810059a0643ed4726628c17fdac8981606f58219e |
File details
Details for the file vllm-0.5.5-cp38-abi3-manylinux1_x86_64.whl.
File metadata
- Download URL: vllm-0.5.5-cp38-abi3-manylinux1_x86_64.whl
- Upload date:
- Size: 134.6 MB
- Tags: CPython 3.8+
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 64fb5b8a3300af3006a3b9ba4eacdf5f4bd2a85887a695e6587684447c49eb8e |
|
| MD5 | 2bb184e61327556d7403ad275ce4135a |
|
| BLAKE2b-256 | 2924041e3626d7bbf16a9071eef51cda4c46fd5ae563d4afdeaa74abd9aefd48 |
