A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.3.post1.tar.gz
(874.1 kB
view hashes)
Built Distribution
Close
Hashes for vllm-0.5.3.post1-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc29055476f527ad11c75d8938a5b40241e6817d546106c4a0234685ebe8b728 |
|
MD5 | 3a4134a67369cfb043298787776d13c2 |
|
BLAKE2b-256 | 93c6c39200a37ccb13f85dcd7aa752e36b9ad7533699586422d36af39b727b4d |