TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers
Report project as malware

Project description

TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache License 2.0
  • Author: NVIDIA Corporation
  • Tags nvidia , tensorrt , deeplearning , inference
  • Requires: Python <4, >=3.7
Classifiers

Release history Release notifications | RSS feed

1.3.0rc14 pre-release

1.3.0rc13 pre-release

1.3.0rc12 pre-release

1.3.0rc11 pre-release

1.3.0rc10 pre-release

1.3.0rc9 pre-release

1.3.0rc8 pre-release

1.3.0rc7 pre-release

1.3.0rc6 pre-release

1.3.0rc5.post2 pre-release

1.3.0rc5.post1 pre-release

1.3.0rc5 pre-release

1.3.0rc4 pre-release

1.3.0rc3 pre-release

1.3.0rc2 pre-release

1.3.0rc1 pre-release

1.3.0rc0 pre-release

1.2.1

1.2.0

1.2.0rc8 pre-release

1.2.0rc7 pre-release

1.2.0rc6.post3 pre-release

1.2.0rc6.post2 pre-release

1.2.0rc6.post1 pre-release

1.2.0rc6 pre-release

1.2.0rc5 pre-release

1.2.0rc4 pre-release

1.2.0rc3 pre-release

1.2.0rc2.post2 pre-release

1.2.0rc2 pre-release

1.2.0rc1 pre-release

1.2.0rc0 pre-release

1.1.0

1.1.0rc5 pre-release

1.1.0rc4 pre-release

1.1.0rc3 pre-release

1.1.0rc2 pre-release

1.1.0rc1 pre-release

1.1.0rc0 pre-release

1.0.0

1.0.0rc6 pre-release

1.0.0rc5 pre-release

1.0.0rc4 pre-release

1.0.0rc3 pre-release

1.0.0rc2 pre-release

1.0.0rc1 pre-release

1.0.0rc0 pre-release

0.21.0

0.21.0rc2 pre-release

0.21.0rc1 pre-release

0.21.0rc0 pre-release

0.20.0

0.20.0rc3 pre-release

0.20.0rc2 pre-release

0.20.0rc1 pre-release

0.20.0rc0 pre-release

0.19.0

0.19.0rc0 pre-release

0.19.0.dev2025040800 pre-release

0.19.0.dev2025040100 pre-release

0.19.0.dev2025032500 pre-release

0.19.0.dev2025031800 pre-release

0.18.2

0.18.1

0.18.0

0.18.0.dev2025031100 pre-release

0.18.0.dev2025030400 pre-release

0.18.0.dev2025022500 pre-release

0.18.0.dev2025021800 pre-release

0.18.0.dev2025021101 pre-release

0.18.0.dev2025021100 pre-release

0.18.0.dev2025020400 pre-release

0.17.0.post1

0.17.0 yanked

0.17.0.dev2024121700 pre-release

0.16.0

This version

0.16.0.dev2024121000 pre-release

0.16.0.dev2024120300 pre-release

0.16.0.dev2024112600 pre-release

0.16.0.dev2024111900 pre-release

0.15.0

0.15.0.dev2024111200 pre-release

0.15.0.dev2024110500 pre-release

0.15.0.dev2024102900 pre-release

0.15.0.dev2024102200 pre-release

0.15.0.dev2024101500 pre-release

0.14.0

0.14.0.dev2024100800 pre-release

0.14.0.dev2024100100 pre-release

0.14.0.dev2024092401 pre-release

0.14.0.dev2024092400 pre-release

0.14.0.dev2024091700 pre-release

0.14.0.dev2024091000 pre-release

0.13.0

0.13.0.dev2024090300 pre-release

0.13.0.dev2024082700 pre-release

0.13.0.dev2024082000 pre-release

0.13.0.dev2024081300 pre-release

0.12.0

0.12.0.dev2024080600 pre-release

0.12.0.dev2024073000 pre-release

0.12.0.dev2024072302 pre-release

0.12.0.dev2024072301 pre-release

0.12.0.dev2024072300 pre-release

0.12.0.dev2024071600 pre-release

0.12.0.dev2024070900 pre-release

0.12.0.dev2024070200 pre-release

0.11.0

0.11.0.dev2024062500 pre-release

0.11.0.dev2024061800 pre-release

0.11.0.dev2024061100 pre-release

0.11.0.dev2024060400 pre-release

0.11.0.dev2024052800 pre-release

0.11.0.dev2024052100 pre-release

0.11.0.dev2024051400 pre-release

0.10.0

0.10.0.dev2024050700 pre-release

0.10.0.dev2024043000 pre-release

0.10.0.dev2024042300 pre-release

0.10.0.dev2024041600 pre-release

0.9.0

0.9.0.dev2024040900 pre-release

0.9.0.dev2024040200 pre-release

0.9.0.dev2024032600 pre-release

0.9.0.dev2024031900 pre-release

0.9.0.dev2024031200 pre-release

0.9.0.dev2024030500 pre-release

0.9.0.dev2024022700 pre-release

0.9.0.dev2024022000 pre-release

0.9.0.dev2024020600 pre-release

0.8.0

0.8.0.dev2024013000 pre-release

0.8.0.dev2024012302 pre-release

0.8.0.dev2024012301 pre-release

0.8.0.dev2024011601 pre-release

0.8.0.dev20240123 pre-release

0.8.0.dev20240116 pre-release

0.7.1

0.7.0

0.6.1

0.5.0.post1

0.5.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tensorrt_llm-0.16.0.dev2024121000.tar.gz (1.4 kB view details)

Uploaded Source

File details

Details for the file tensorrt_llm-0.16.0.dev2024121000.tar.gz.

File metadata

File hashes

Hashes for tensorrt_llm-0.16.0.dev2024121000.tar.gz
Algorithm Hash digest
SHA256 789e7e8322e55ce6bd776d9a7fc7861489a9da67105f8906204f9683d6c0cb0a
MD5 cf346ea5fc351c62642cdd64ccdcba3d
BLAKE2b-256 aa6dc01677bfad06ffc94373e25b101c534db01be16f44545bfb3f425d777538

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page