hugpy-worker
pip install hugpy-worker # pulls hugpy-wrapper (the front door)
Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy
worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health);
every inference is forwarded to fitevict's /v1/chat/completions, which owns
evict-to-fit, load, serve and call_log. The contract is lifted from
hugpy_fleet.worker.agent; nothing below it is.
hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
--advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080
Without --central it serves locally and never registers.
1 maintainer
Metadata
1 maintainer
Release files for hugpy-worker 0.1.15
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hugpy_worker-0.1.15.tar.gz | 28.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hugpy_worker-0.1.15-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 56.5 kB
Release files / hugpy_worker-0.1.15.tar.gz
| Download URL | hugpy_worker-0.1.15.tar.gz |
|---|---|
| Size | 28.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
12895bdc887b28d89da5dd6981f04adbd5da6f8bf49bab0b000d6a2a9e288621
|
|
BLAKE2b-256 checksum How to use checksums |
5332054cd6cfc3951fd7c534374dac12567402dcd64546f8f48503aa45a39010
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / hugpy_worker-0.1.15-py3-none-any.whl
| Download URL | hugpy_worker-0.1.15-py3-none-any.whl |
|---|---|
| Size | 27.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3622cff79715778d0eb429b0f597a855cc01c94fc914f0ca9fdd5f29c87b9933
|
|
BLAKE2b-256 checksum How to use checksums |
310a1b2cb61f0b116711f455a166d697850505f726acefd1d89ea9e7358d700c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
