A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.6.0.tar.gz
(1.2 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.6.0-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d68104d8fd5e5406d1c6f22729d46a9acd2963a00d3452ff7f8a710734c580d |
|
MD5 | 4b69ea778121df5dc9ca3af7ad459ea1 |
|
BLAKE2b-256 | 0c329b170365860d85fca85b27135dbbc1a9cd0fba0cdca0cef574443300da24 |