A high-throughput and memory-efficient inference and serving engine for LLMs

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for simon-mo from gravatar.com simon-mo Avatar for wskwon from gravatar.com wskwon Avatar for youkaichao from gravatar.com youkaichao Avatar for zhuohan123 from gravatar.com zhuohan123

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: vLLM Team
  • Requires: Python >=3.8
  • Provides-Extra: audio, tensorizer, video
Classifiers

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for simon-mo from gravatar.com simon-mo Avatar for wskwon from gravatar.com wskwon Avatar for youkaichao from gravatar.com youkaichao Avatar for zhuohan123 from gravatar.com zhuohan123

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: vLLM Team
  • Requires: Python >=3.8
  • Provides-Extra: audio, tensorizer, video
Classifiers

Release history Release notifications | RSS feed

0.6.4.post1

0.6.4

0.6.3.post1

0.6.3

0.6.2

This version

0.6.1.post2

0.6.1.post1

0.6.1

0.6.0

0.5.5

0.5.4

0.5.3.post1

0.5.3

0.5.2

0.5.1

0.5.0.post1

0.5.0

0.4.3

0.4.2

0.4.1

0.4.0.post1

0.4.0

0.3.3

0.3.2

0.3.1

0.3.0

0.2.7

0.2.6

0.2.5

0.2.4

0.2.3

0.2.2

0.2.1.post1

0.2.1 yanked

Reason this release was yanked:

A bug in tensor parallelism support.

0.2.0

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vllm-0.6.1.post2.tar.gz (1.3 MB view details)

Uploaded Source

Built Distribution

vllm-0.6.1.post2-cp38-abi3-manylinux1_x86_64.whl (170.7 MB view details)

Uploaded CPython 3.8+

File details

Details for the file vllm-0.6.1.post2.tar.gz.

File metadata

  • Download URL: vllm-0.6.1.post2.tar.gz
  • Upload date:
  • Size: 1.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.0

File hashes

Hashes for vllm-0.6.1.post2.tar.gz
Algorithm Hash digest
SHA256 1766f99c6a46849124685abd47e4450d6bfd119ca477fa83f16553e213cb8b6a
MD5 0218e9cd48bba6770ef460d9247fdab9
BLAKE2b-256 73e5789b8254dc317ee66504d8a831c833b719ce1218640955ffec904ad1734a

See more details on using hashes here.

File details

Details for the file vllm-0.6.1.post2-cp38-abi3-manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for vllm-0.6.1.post2-cp38-abi3-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 d99c8102c719f54171ca014d40232dea7d62756e07e4b0993a8ea99bae3b2866
MD5 40e99641b327735ccbfc517eb77de73b
BLAKE2b-256 0ffce218785bf6b93a21843b97dc5a674da58cc8f5364867bd47a26d78f73dba

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page