A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.4.tar.gz
(958.6 kB
view hashes)
Built Distribution
Close
Hashes for vllm-0.5.4-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e0722a5451bc32799b27aba7ef16356d31563e3ea2602a4a4ff3ff5ab4e9f9df |
|
MD5 | 79635b3e9b6d4389519a6cb74e869da6 |
|
BLAKE2b-256 | 701255fb724c0109d3447eb30e0e95c79ada20f3451c1925d3a1a7c50a7be30d |