Client framework based on FastAPI
Project description
carefree-client
is a client framework based on FastAPI
. It also supports interacting with Triton Inference Server.
pip
Install
pip install -e .
Run
uvicorn apis.interface:app --host 0.0.0.0 --port 8123
Docker
Build
docker build -t cfclient .
If your internet environment lands in China, it might be faster to build with Dockerfile.cn
:
docker build -t cfclient -f Dockerfile.cn .
Run
docker run --rm -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
or
docker run --rm --link image_name_of_your_triton_server -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
In this case, you need to modify the apis/interface.py
file as well: you need to modify the constants
variable (defined at L27) and set the value of triton_host
(defined at L28) from None
to image_name_of_your_triton_server
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
carefree-client-0.1.10.tar.gz
(9.8 kB
view hashes)