carefree-client is a client framework based on FastAPI. It also supports interacting with Triton Inference Server.
pip
Install
pip install -e .
Run
uvicorn apis.interface:app --host 0.0.0.0 --port 8123
Docker
Build
docker build -t cfclient .
If your internet environment lands in China, it might be faster to build with Dockerfile.cn:
docker build -t cfclient -f Dockerfile.cn .
Run
docker run --rm -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
or
docker run --rm --link image_name_of_your_triton_server -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest
In this case, you need to modify the apis/interface.py file as well: you need to modify the constants variable (defined at L27) and set the value of triton_host (defined at L28) from None to image_name_of_your_triton_server.
1 maintainer
Metadata
1 maintainer
Release files for carefree-client 0.1.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| carefree-client-0.1.10.tar.gz | 9.8 kB | Details |
Release files / carefree-client-0.1.10.tar.gz
| Download URL | carefree-client-0.1.10.tar.gz |
|---|---|
| Size | 9.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ee95c07277e2cd5e49fa4e85de2757f0e4b7749966327254b0db7a5bdf2366f3
|
|
BLAKE2b-256 checksum How to use checksums |
e55fa891c6b22bde36db9f22953944d1d13ba7fa9960d117980e848dd58c3975
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.8.13
|
