A high level package for Nvidia Triton requests
Project description
Python package to interact with Nvidia Triton Server
from triton_requests import TritonEndPoint
tep = TritonEndPoint(model_name="emotion-english-distilroberta-base_onnx_inference", url="localhost:9000")
tep.encode("Harry is really happy after his present")
Will result a numpy array
array([[-1.1953125 , -2.4921875 , -2.8964844 , 4.9921875 , 0.35498047, 0.70458984, 1.9570312 ]], dtype=float32)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
triton_requests-0.0.2.tar.gz
(2.2 kB
view hashes)
Built Distribution
Close
Hashes for triton_requests-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 694f01c734040e197c77c988fa2e4dc4a612b5be7f0e3fe3554832a7129ac2c3 |
|
MD5 | 6d6544f7d26539fcd55aa2504cfed9ab |
|
BLAKE2b-256 | 61adccb4039fb902006f685d2ba13b29c7f49719e27662b22376cc15ffbd0f34 |