A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.3.tar.gz
(873.8 kB
view hashes)
Built Distribution
Close
Hashes for vllm-0.5.3-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7841072a979d87c023845dbfe429ff650aa90c9a0dc01ad1daf3a0c3000872e4 |
|
MD5 | 0c0d4fb905c738cef76089bd75839104 |
|
BLAKE2b-256 | 64b6ecef721d2011da7ca434f48915f64bf389869b00a501e3360d48e4c96fa5 |