A high level package for Nvidia Triton requests
Project description
Python package to interact with Nvidia Triton Server
from triton_requests import TritonEndPoint
tep = TritonEndPoint(model_name="emotion-english-distilroberta-base_onnx_inference", url="localhost:9000")
tep.encode("Harry is really happy after his present")
Will result a numpy array
array([[-1.1953125 , -2.4921875 , -2.8964844 , 4.9921875 , 0.35498047, 0.70458984, 1.9570312 ]], dtype=float32)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
triton_requests-0.0.3.tar.gz
(2.3 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file triton_requests-0.0.3.tar.gz.
File metadata
- Download URL: triton_requests-0.0.3.tar.gz
- Upload date:
- Size: 2.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
68b29d7e100a3df99ed5bae641cac16397864c652b79a8b4ea4c07a2d1437bd6
|
|
| MD5 |
c820d42622992e33f8cfec47f2975c8b
|
|
| BLAKE2b-256 |
cada2626a469f49da225f18f822c1174491ad73c6221cd9432abf53d3a99d84d
|
File details
Details for the file triton_requests-0.0.3-py3-none-any.whl.
File metadata
- Download URL: triton_requests-0.0.3-py3-none-any.whl
- Upload date:
- Size: 3.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
137b1d6eb9b8d39761833ad48fec94681eaa13ba5fd6c6a32c2a1ce75a3179c1
|
|
| MD5 |
2af2d917e9dad7bb01c25a307a69da53
|
|
| BLAKE2b-256 |
03a471b7011411ed9e74ed50cbd27ab1df322f98782f64deece77f801b469d05
|
