hugpy-worker
pip install hugpy-worker # pulls hugpy-wrapper (the front door)
Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy
worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health);
every inference is forwarded to fitevict's /v1/chat/completions, which owns
evict-to-fit, load, serve and call_log. The contract is lifted from
hugpy_fleet.worker.agent; nothing below it is.
hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
--advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080
Without --central it serves locally and never registers.
1 maintainer
Metadata
1 maintainer
Release files for hugpy-worker 0.1.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hugpy_worker-0.1.3.tar.gz | 20.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hugpy_worker-0.1.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 39.0 kB
Release files / hugpy_worker-0.1.3.tar.gz
| Download URL | hugpy_worker-0.1.3.tar.gz |
|---|---|
| Size | 20.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
dfb86994626eb611a71aa4f5f7a73963ef5860e4fe8f62f0ba26a590f01863f2
|
|
BLAKE2b-256 checksum How to use checksums |
c1bcaf5e23d2d1c7561645b579537e66d0689a3b9e118158bee4b8072d613e71
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
Release files / hugpy_worker-0.1.3-py3-none-any.whl
| Download URL | hugpy_worker-0.1.3-py3-none-any.whl |
|---|---|
| Size | 18.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e7bb9c1749e4b98826888d28487a00736d4b60ba24e76115493f75cc251d7513
|
|
BLAKE2b-256 checksum How to use checksums |
df96ea29a7b1b44cc2d5669554d9d0051557a98362cb7242282d98d0243940c0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
