A high-throughput and memory-efficient inference and serving engine for LLMs
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vllm-0.6.1.post2.tar.gz
(1.3 MB
view hashes)
Built Distribution
Close
Hashes for vllm-0.6.1.post2-cp38-abi3-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d99c8102c719f54171ca014d40232dea7d62756e07e4b0993a8ea99bae3b2866 |
|
MD5 | 40e99641b327735ccbfc517eb77de73b |
|
BLAKE2b-256 | 0ffce218785bf6b93a21843b97dc5a674da58cc8f5364867bd47a26d78f73dba |