Skip to main content

carefree-client is a client framework based on FastAPI. It also supports interacting with Triton Inference Server.

pip

Install

pip install -e .

Run

uvicorn apis.interface:app --host 0.0.0.0 --port 8123

Docker

Build

docker build -t cfclient .

If your internet environment lands in China, it might be faster to build with Dockerfile.cn:

docker build -t cfclient -f Dockerfile.cn .

Run

docker run --rm -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest

or

docker run --rm --link image_name_of_your_triton_server -p 8123:8123 -v /full/path/to/your/client/logs:/carefree-client/apis/logs cfclient:latest

In this case, you need to modify the apis/interface.py file as well: you need to modify the constants variable (defined at L27) and set the value of triton_host (defined at L28) from None to image_name_of_your_triton_server.

Metadata

Release files for carefree-client 0.1.10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for carefree-client 0.1.10
File Size Uploaded Provenance
carefree-client-0.1.10.tar.gz 9.8 kB Without provenance Details

Release files / carefree-client-0.1.10.tar.gz

Download URL carefree-client-0.1.10.tar.gz
Size 9.8 kB
Tags Source
SHA-256 checksum
How to use checksums
ee95c07277e2cd5e49fa4e85de2757f0e4b7749966327254b0db7a5bdf2366f3
BLAKE2b-256 checksum
How to use checksums
e55fa891c6b22bde36db9f22953944d1d13ba7fa9960d117980e848dd58c3975
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.8.13

Security for carefree-client 0.1.10

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page