hugpy-worker
pip install hugpy-worker # pulls hugpy-wrapper (the front door)
Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy
worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health);
every inference is forwarded to fitevict's /v1/chat/completions, which owns
evict-to-fit, load, serve and call_log. The contract is lifted from
hugpy_fleet.worker.agent; nothing below it is.
hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
--advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080
Without --central it serves locally and never registers.
1 maintainer
Metadata
1 maintainer
Release files for hugpy-worker 0.1.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hugpy_worker-0.1.6.tar.gz | 23.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hugpy_worker-0.1.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 45.5 kB
Release files / hugpy_worker-0.1.6.tar.gz
| Download URL | hugpy_worker-0.1.6.tar.gz |
|---|---|
| Size | 23.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0124379ea13381d6a879993f4684a2db67db177126b6e2ebe789f6ab2aa27b4d
|
|
BLAKE2b-256 checksum How to use checksums |
21d1aee42194dd1fa38ce6e6386b701a99325e7e33df32a2f20cab27e108dbc6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / hugpy_worker-0.1.6-py3-none-any.whl
| Download URL | hugpy_worker-0.1.6-py3-none-any.whl |
|---|---|
| Size | 22.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
61fd61a4ef09a667823fcf7d55fc535f360b19096dd37eaca460313502ee8073
|
|
BLAKE2b-256 checksum How to use checksums |
16bb9c34706b3eee463c09545c4b445f3d79979456babc636011a5510df6149c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
