carefree-client is a client framework based on FastAPI. It also supports interacting with Triton Inference Server.
pip
Install
pip install -e .
Run
uvicorn apis.interface:app --host 0.0.0.0 --port 8123
Docker
Build
docker build -t cfclient .
If your internet environment lands in China, it might be faster to build with Dockerfile.cn:
docker build -t cfclient -f Dockerfile.cn .
Run
docker run --rm -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
or
docker run --rm --link image_name_of_your_triton_server -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
In this case, you need to modify the apis/interface.py file as well: you need to modify the constants variable (defined at L27) and set the value of triton_host (defined at L28) from None to image_name_of_your_triton_server.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file carefree-client-0.1.10.tar.gz.
File metadata
- Download URL: carefree-client-0.1.10.tar.gz
- Upload date:
- Size: 9.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/4.0.1 CPython/3.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ee95c07277e2cd5e49fa4e85de2757f0e4b7749966327254b0db7a5bdf2366f3
|
|
| MD5 |
8e1816bf22b46a9a868ac207a03681bf
|
|
| BLAKE2b-256 |
e55fa891c6b22bde36db9f22953944d1d13ba7fa9960d117980e848dd58c3975
|
