A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.6.2.tar.gz
(2.6 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.6.2-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 414e2244a6c3a97175e7659f9a6e10c2e295376d1d1e4bec704da18caa237f0b |
|
MD5 | 35ce4dba45167c4e860375b97d0c3fcc |
|
BLAKE2b-256 | 7cb1a521b04c77f50b3b6b7a34cf25affbdbac195e4fc7c87e364c5084d60d47 |