A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.5.2.tar.gz
(824.0 kB
view hashes)
Built Distribution
Close
Hashes for vllm-0.5.2-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac9e366ffad44a8928889871e12b3718476df063e28a1da15a30ba70c1f29df9 |
|
MD5 | d2346a52d4cde7dd53016fb4933fd003 |
|
BLAKE2b-256 | 6784f28a30e6e89405cd6ced3b7fd0fd636e6ecfec0c23af0ab218fea3293767 |