A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.6.1.tar.gz
(1.3 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.6.1-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa93a20d9ba9fa21f0c72d28d225a1b97485a81ab539f1da9226e303736248d3 |
|
MD5 | b8e9549fbb7c16f622f4648fa6a35032 |
|
BLAKE2b-256 | ad9ff41914084507f55152bd231650ca50ad1559b1203f8ef866efe2824a812c |