A high level package for Nvidia Triton requests
Project description
Python package to interact with Nvidia Triton Server
from triton_requests import TritonEndPoint
tep = TritonEndPoint(model_name="emotion-english-distilroberta-base_onnx_inference", url="localhost:9000")
tep.encode("Harry is really happy after his present")
Will result a numpy array
array([[-1.1953125 , -2.4921875 , -2.8964844 , 4.9921875 , 0.35498047, 0.70458984, 1.9570312 ]], dtype=float32)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
triton_requests-0.0.3.tar.gz
(2.3 kB
view hashes)
Built Distribution
Close
Hashes for triton_requests-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 137b1d6eb9b8d39761833ad48fec94681eaa13ba5fd6c6a32c2a1ce75a3179c1 |
|
MD5 | 2af2d917e9dad7bb01c25a307a69da53 |
|
BLAKE2b-256 | 03a471b7011411ed9e74ed50cbd27ab1df322f98782f64deece77f801b469d05 |