A high-throughput and memory-efficient inference and serving engine for LLMs

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for simon-mo from gravatar.com simon-mo Avatar for wskwon from gravatar.com wskwon Avatar for youkaichao from gravatar.com youkaichao Avatar for zhuohan123 from gravatar.com zhuohan123

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: vLLM Team
  • Requires: Python >=3.8
  • Provides-Extra: tensorizer
Classifiers

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for simon-mo from gravatar.com simon-mo Avatar for wskwon from gravatar.com wskwon Avatar for youkaichao from gravatar.com youkaichao Avatar for zhuohan123 from gravatar.com zhuohan123

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: vLLM Team
  • Requires: Python >=3.8
  • Provides-Extra: tensorizer
Classifiers

Release history Release notifications | RSS feed

0.6.4.post1

0.6.4

0.6.3.post1

0.6.3

0.6.2

0.6.1.post2

0.6.1.post1

0.6.1

0.6.0

0.5.5

0.5.4

0.5.3.post1

0.5.3

This version

0.5.2

0.5.1

0.5.0.post1

0.5.0

0.4.3

0.4.2

0.4.1

0.4.0.post1

0.4.0

0.3.3

0.3.2

0.3.1

0.3.0

0.2.7

0.2.6

0.2.5

0.2.4

0.2.3

0.2.2

0.2.1.post1

0.2.1 yanked

Reason this release was yanked:

A bug in tensor parallelism support.

0.2.0

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vllm-0.5.2.tar.gz (824.0 kB view details)

Uploaded Source

Built Distribution

vllm-0.5.2-cp38-abi3-manylinux1_x86_64.whl (147.0 MB view details)

Uploaded CPython 3.8+

File details

Details for the file vllm-0.5.2.tar.gz.

File metadata

  • Download URL: vllm-0.5.2.tar.gz
  • Upload date:
  • Size: 824.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for vllm-0.5.2.tar.gz
Algorithm Hash digest
SHA256 ac00908667fa1ea9639747a986699f31f28a99afa149fc729589a7c609b5e6d7
MD5 ff1eb59aab7bd380a3e7f70306f7a443
BLAKE2b-256 d480fc0e7dc9814f0fd5824afdba4c2d8fceba5b08410b8cef5d4ee22f3b6887

See more details on using hashes here.

File details

Details for the file vllm-0.5.2-cp38-abi3-manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for vllm-0.5.2-cp38-abi3-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 ac9e366ffad44a8928889871e12b3718476df063e28a1da15a30ba70c1f29df9
MD5 d2346a52d4cde7dd53016fb4933fd003
BLAKE2b-256 6784f28a30e6e89405cd6ced3b7fd0fd636e6ecfec0c23af0ab218fea3293767

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page