A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.5.tar.gz
(1.1 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.5.5-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 64fb5b8a3300af3006a3b9ba4eacdf5f4bd2a85887a695e6587684447c49eb8e |
|
MD5 | 2bb184e61327556d7403ad275ce4135a |
|
BLAKE2b-256 | 2924041e3626d7bbf16a9071eef51cda4c46fd5ae563d4afdeaa74abd9aefd48 |