Skip to main content

hugpy-worker

pip install hugpy-worker   # pulls hugpy-wrapper (the front door)

Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health); every inference is forwarded to fitevict's /v1/chat/completions, which owns evict-to-fit, load, serve and call_log. The contract is lifted from hugpy_fleet.worker.agent; nothing below it is.

hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
    --advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080

Without --central it serves locally and never registers.

Metadata

Release files for hugpy-worker 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-worker 0.1.1
File Size Uploaded
hugpy_worker-0.1.1.tar.gz 12.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-worker 0.1.1
File Interpreter ABI Platform
hugpy_worker-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 26.3 kB

Release files / hugpy_worker-0.1.1.tar.gz

Download URL hugpy_worker-0.1.1.tar.gz
Size 12.8 kB
Tags Source
SHA-256 checksum
How to use checksums
79f1e900d5eb615efbb914d5df36f389812a959a88d67b2397f721e4548c2b9d
BLAKE2b-256 checksum
How to use checksums
889e204b8403f1ac1dc39be6f1c34bb4196d9f48d5e424618b0041966fd00e04
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release files / hugpy_worker-0.1.1-py3-none-any.whl

Download URL hugpy_worker-0.1.1-py3-none-any.whl
Size 13.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1a9043d93ca23c7c8dc3afe5659f8151f3b9a22fd84c8b4bb377be5d64f88d4e
BLAKE2b-256 checksum
How to use checksums
3c03120d1e0192176a7b843c4b9b25d3a808ae0410df146d46fafccd805e5f69
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

This release

0.1.1 This release

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page