TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers
Report project as malware

Project description

TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers

Release history Release notifications | RSS feed

1.3.0rc12 pre-release

1.3.0rc11 pre-release

1.3.0rc10 pre-release

1.3.0rc9 pre-release

1.3.0rc8 pre-release

1.3.0rc7 pre-release

1.3.0rc6 pre-release

1.3.0rc5.post1 pre-release

1.3.0rc5 pre-release

1.3.0rc4 pre-release

1.3.0rc3 pre-release

1.3.0rc2 pre-release

1.3.0rc1 pre-release

1.3.0rc0 pre-release

1.2.0

1.2.0rc8 pre-release

1.2.0rc7 pre-release

1.2.0rc6.post3 pre-release

1.2.0rc6.post2 pre-release

1.2.0rc6.post1 pre-release

1.2.0rc6 pre-release

1.2.0rc5 pre-release

1.2.0rc4 pre-release

1.2.0rc3 pre-release

1.2.0rc2.post2 pre-release

1.2.0rc2 pre-release

1.2.0rc1 pre-release

1.2.0rc0 pre-release

1.1.0

1.1.0rc5 pre-release

1.1.0rc4 pre-release

1.1.0rc3 pre-release

1.1.0rc2 pre-release

1.1.0rc1 pre-release

1.1.0rc0 pre-release

1.0.0

1.0.0rc6 pre-release

1.0.0rc5 pre-release

1.0.0rc4 pre-release

1.0.0rc3 pre-release

1.0.0rc2 pre-release

1.0.0rc1 pre-release

1.0.0rc0 pre-release

0.21.0

0.21.0rc2 pre-release

0.21.0rc1 pre-release

0.21.0rc0 pre-release

0.20.0

0.20.0rc3 pre-release

0.20.0rc2 pre-release

0.20.0rc1 pre-release

0.20.0rc0 pre-release

0.19.0

0.19.0rc0 pre-release

0.19.0.dev2025040800 pre-release

0.19.0.dev2025040100 pre-release

0.19.0.dev2025032500 pre-release

0.19.0.dev2025031800 pre-release

0.18.2

0.18.1

0.18.0

0.18.0.dev2025031100 pre-release

0.18.0.dev2025030400 pre-release

0.18.0.dev2025022500 pre-release

0.18.0.dev2025021800 pre-release

0.18.0.dev2025021101 pre-release

0.18.0.dev2025021100 pre-release

0.18.0.dev2025020400 pre-release

0.17.0.post1

0.17.0 yanked

0.17.0.dev2024121700 pre-release

0.16.0

0.16.0.dev2024121000 pre-release

0.16.0.dev2024120300 pre-release

0.16.0.dev2024112600 pre-release

0.16.0.dev2024111900 pre-release

0.15.0

0.15.0.dev2024111200 pre-release

0.15.0.dev2024110500 pre-release

0.15.0.dev2024102900 pre-release

0.15.0.dev2024102200 pre-release

0.15.0.dev2024101500 pre-release

0.14.0

0.14.0.dev2024100800 pre-release

This version

0.14.0.dev2024100100 pre-release

0.14.0.dev2024092401 pre-release

0.14.0.dev2024092400 pre-release

0.14.0.dev2024091700 pre-release

0.14.0.dev2024091000 pre-release

0.13.0

0.13.0.dev2024090300 pre-release

0.13.0.dev2024082700 pre-release

0.13.0.dev2024082000 pre-release

0.13.0.dev2024081300 pre-release

0.12.0

0.12.0.dev2024080600 pre-release

0.12.0.dev2024073000 pre-release

0.12.0.dev2024072302 pre-release

0.12.0.dev2024072301 pre-release

0.12.0.dev2024072300 pre-release

0.12.0.dev2024071600 pre-release

0.12.0.dev2024070900 pre-release

0.12.0.dev2024070200 pre-release

0.11.0

0.11.0.dev2024062500 pre-release

0.11.0.dev2024061800 pre-release

0.11.0.dev2024061100 pre-release

0.11.0.dev2024060400 pre-release

0.11.0.dev2024052800 pre-release

0.11.0.dev2024052100 pre-release

0.11.0.dev2024051400 pre-release

0.10.0

0.10.0.dev2024050700 pre-release

0.10.0.dev2024043000 pre-release

0.10.0.dev2024042300 pre-release

0.10.0.dev2024041600 pre-release

0.9.0

0.9.0.dev2024040900 pre-release

0.9.0.dev2024040200 pre-release

0.9.0.dev2024032600 pre-release

0.9.0.dev2024031900 pre-release

0.9.0.dev2024031200 pre-release

0.9.0.dev2024030500 pre-release

0.9.0.dev2024022700 pre-release

0.9.0.dev2024022000 pre-release

0.9.0.dev2024020600 pre-release

0.8.0

0.8.0.dev2024013000 pre-release

0.8.0.dev2024012302 pre-release

0.8.0.dev2024012301 pre-release

0.8.0.dev2024011601 pre-release

0.8.0.dev20240123 pre-release

0.8.0.dev20240116 pre-release

0.7.1

0.7.0

0.6.1

0.5.0.post1

0.5.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tensorrt_llm-0.14.0.dev2024100100.tar.gz (1.2 kB view details)

Uploaded Source

File details

Details for the file tensorrt_llm-0.14.0.dev2024100100.tar.gz.

File metadata

File hashes

Hashes for tensorrt_llm-0.14.0.dev2024100100.tar.gz
Algorithm Hash digest
SHA256 52af5427c80d4e3b05ed683b1af9d799189a3ad9f1d08663c73551f71f5f8d23
MD5 9ae3ea2f9d61d188279c8aa830bf479c
BLAKE2b-256 464804952ba94b7b645a9cf437f24d83564f3ccf6d5644e646185114ec2997d7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page