A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.6.1.post1.tar.gz
(1.3 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.6.1.post1-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8dfc716cc0e1b659e93f3c93ee5c389d1c843f7614888ef32587e6d41d18940f |
|
MD5 | 0ebd6d6b6caff84367bb3e9b8957e0bf |
|
BLAKE2b-256 | 414e6341bc794c0d52d6cd0be50dbf4eaca860b29e5d3232113fef8b56a2bb08 |