TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers
Report project as malware

Project description

TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers

Release history Release notifications | RSS feed

1.3.0rc14 pre-release

1.3.0rc13 pre-release

1.3.0rc12 pre-release

1.3.0rc11 pre-release

1.3.0rc10 pre-release

1.3.0rc9 pre-release

1.3.0rc8 pre-release

1.3.0rc7 pre-release

1.3.0rc6 pre-release

1.3.0rc5.post2 pre-release

1.3.0rc5.post1 pre-release

1.3.0rc5 pre-release

1.3.0rc4 pre-release

1.3.0rc3 pre-release

1.3.0rc2 pre-release

1.3.0rc1 pre-release

1.3.0rc0 pre-release

1.2.1

1.2.0

1.2.0rc8 pre-release

1.2.0rc7 pre-release

1.2.0rc6.post3 pre-release

1.2.0rc6.post2 pre-release

1.2.0rc6.post1 pre-release

1.2.0rc6 pre-release

1.2.0rc5 pre-release

1.2.0rc4 pre-release

1.2.0rc3 pre-release

1.2.0rc2.post2 pre-release

1.2.0rc2 pre-release

1.2.0rc1 pre-release

1.2.0rc0 pre-release

1.1.0

1.1.0rc5 pre-release

1.1.0rc4 pre-release

1.1.0rc3 pre-release

1.1.0rc2 pre-release

1.1.0rc1 pre-release

1.1.0rc0 pre-release

1.0.0

1.0.0rc6 pre-release

1.0.0rc5 pre-release

1.0.0rc4 pre-release

1.0.0rc3 pre-release

1.0.0rc2 pre-release

1.0.0rc1 pre-release

1.0.0rc0 pre-release

0.21.0

0.21.0rc2 pre-release

0.21.0rc1 pre-release

0.21.0rc0 pre-release

0.20.0

0.20.0rc3 pre-release

0.20.0rc2 pre-release

0.20.0rc1 pre-release

0.20.0rc0 pre-release

0.19.0

0.19.0rc0 pre-release

0.19.0.dev2025040800 pre-release

0.19.0.dev2025040100 pre-release

0.19.0.dev2025032500 pre-release

0.19.0.dev2025031800 pre-release

0.18.2

0.18.1

0.18.0

0.18.0.dev2025031100 pre-release

0.18.0.dev2025030400 pre-release

0.18.0.dev2025022500 pre-release

0.18.0.dev2025021800 pre-release

0.18.0.dev2025021101 pre-release

0.18.0.dev2025021100 pre-release

0.18.0.dev2025020400 pre-release

0.17.0.post1

0.17.0 yanked

0.17.0.dev2024121700 pre-release

0.16.0

0.16.0.dev2024121000 pre-release

This version

0.16.0.dev2024120300 pre-release

0.16.0.dev2024112600 pre-release

0.16.0.dev2024111900 pre-release

0.15.0

0.15.0.dev2024111200 pre-release

0.15.0.dev2024110500 pre-release

0.15.0.dev2024102900 pre-release

0.15.0.dev2024102200 pre-release

0.15.0.dev2024101500 pre-release

0.14.0

0.14.0.dev2024100800 pre-release

0.14.0.dev2024100100 pre-release

0.14.0.dev2024092401 pre-release

0.14.0.dev2024092400 pre-release

0.14.0.dev2024091700 pre-release

0.14.0.dev2024091000 pre-release

0.13.0

0.13.0.dev2024090300 pre-release

0.13.0.dev2024082700 pre-release

0.13.0.dev2024082000 pre-release

0.13.0.dev2024081300 pre-release

0.12.0

0.12.0.dev2024080600 pre-release

0.12.0.dev2024073000 pre-release

0.12.0.dev2024072302 pre-release

0.12.0.dev2024072301 pre-release

0.12.0.dev2024072300 pre-release

0.12.0.dev2024071600 pre-release

0.12.0.dev2024070900 pre-release

0.12.0.dev2024070200 pre-release

0.11.0

0.11.0.dev2024062500 pre-release

0.11.0.dev2024061800 pre-release

0.11.0.dev2024061100 pre-release

0.11.0.dev2024060400 pre-release

0.11.0.dev2024052800 pre-release

0.11.0.dev2024052100 pre-release

0.11.0.dev2024051400 pre-release

0.10.0

0.10.0.dev2024050700 pre-release

0.10.0.dev2024043000 pre-release

0.10.0.dev2024042300 pre-release

0.10.0.dev2024041600 pre-release

0.9.0

0.9.0.dev2024040900 pre-release

0.9.0.dev2024040200 pre-release

0.9.0.dev2024032600 pre-release

0.9.0.dev2024031900 pre-release

0.9.0.dev2024031200 pre-release

0.9.0.dev2024030500 pre-release

0.9.0.dev2024022700 pre-release

0.9.0.dev2024022000 pre-release

0.9.0.dev2024020600 pre-release

0.8.0

0.8.0.dev2024013000 pre-release

0.8.0.dev2024012302 pre-release

0.8.0.dev2024012301 pre-release

0.8.0.dev2024011601 pre-release

0.8.0.dev20240123 pre-release

0.8.0.dev20240116 pre-release

0.7.1

0.7.0

0.6.1

0.5.0.post1

0.5.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tensorrt_llm-0.16.0.dev2024120300.tar.gz (1.4 kB view details)

Uploaded Source

File details

Details for the file tensorrt_llm-0.16.0.dev2024120300.tar.gz.

File metadata

File hashes

Hashes for tensorrt_llm-0.16.0.dev2024120300.tar.gz
Algorithm Hash digest
SHA256 82a771180a970f2425179a7b43a7cca8e9abe9a72b2291adb4e51b3c22d8ec6c
MD5 1f09415c931a64fd6484f3c9b1735f2a
BLAKE2b-256 86f97c12de842de6c4ee2e0556a442e6a4e12f23a9b36b37d579f9f745939bcd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page