Triton Inference Server Model

Simple package to run inference with Triton Inference Server easily.

pip install trism
# Or
pip install https://github.com/hieupth/trism

How to use

# Create triton model.
model = TritonModel(
  model="my_model",     # Model name.
  version=0,            # Model version.
  url="localhost:8001", # Triton Server URL.
  grpc=True             # Use gRPC or Http.
)
# View metadata.
for inp in model.inputs:
  print(f"name: {inp.name}, shape: {inp.shape}, datatype: {inp.dtype}\n")
for out in model.outputs:
  print(f"name: {out.name}, shape: {out.shape}, datatype: {out.dtype}\n")
# Inference.
outputs = model.run(data = [np.array(...)])

License

GNU AGPL v3.0.
Copyright © 2024 Hieu Pham. All rights reserved.

Metadata

Release files for trism 0.0.1.post1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for trism 0.0.1.post1
File	Size	Uploaded	Provenance
trism-0.0.1.post1.tar.gz	16.0 kB	Sep 15, 2024	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for trism 0.0.1.post1
File	Interpreter	ABI	Platform	Reset
trism-0.0.1.post1-py3-none-any.whl 16.4 kB Sep 15, 2024 Without provenance	Python 3	none	any	Details

Total release size: 32.5 kB

Release files / trism-0.0.1.post1.tar.gz

Download URL	trism-0.0.1.post1.tar.gz
Size	16.0 kB
Tags	Source
SHA-256 checksum How to use checksums	`dd158b2e9ce7f88d3ea2e7255bcfdba1f5e28eda6c2fcb1b9c2474f6278489ca`
BLAKE2b-256 checksum How to use checksums	`0980670405e89e3030280e4006a9c4e13733dc778ffd96059e6af11297b72a93`
Upload date	Sep 15, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.4`

Release files / trism-0.0.1.post1-py3-none-any.whl

Download URL	trism-0.0.1.post1-py3-none-any.whl
Size	16.4 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`1d41753f238ea75e268f63d0570af8d4084fd00ffccf02b13f06b48a7456b185`
BLAKE2b-256 checksum How to use checksums	`b99bf31f5c5b3eec051bf0bd5d85c8c72aa1aee489cde33d62138866dc3fdee0`
Upload date	Sep 15, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.4`

Security for trism 0.0.1.post1

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.