hugpy-worker
pip install hugpy-worker # pulls hugpy-wrapper (the front door)
Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy
worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health);
every inference is forwarded to fitevict's /v1/chat/completions, which owns
evict-to-fit, load, serve and call_log. The contract is lifted from
hugpy_fleet.worker.agent; nothing below it is.
hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
--advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080
Without --central it serves locally and never registers.
1 maintainer
Metadata
1 maintainer
Release files for hugpy-worker 0.1.16
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hugpy_worker-0.1.16.tar.gz | 30.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hugpy_worker-0.1.16-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 59.1 kB
Release files / hugpy_worker-0.1.16.tar.gz
| Download URL | hugpy_worker-0.1.16.tar.gz |
|---|---|
| Size | 30.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
06381f5fcff251c4c655a66c0b3ce71e705159c6e61d70b9a135a130e55757fd
|
|
BLAKE2b-256 checksum How to use checksums |
80c76081559efec4ee2c6b5fa36fb449fb376b75921b8c114e9edc344ebaa22c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / hugpy_worker-0.1.16-py3-none-any.whl
| Download URL | hugpy_worker-0.1.16-py3-none-any.whl |
|---|---|
| Size | 29.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
4b42c97376abc7651c80b2c0c3d7723d97916254e0b378840d97d7c05c46a76c
|
|
BLAKE2b-256 checksum How to use checksums |
58699a16d131713e8640195d6fa83162fb5f72cc7a03ee833d09d61e5d62eac7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
