Skip to main content

hugpy-worker

pip install hugpy-worker   # pulls hugpy-wrapper (the front door)

Per-box hugpy worker over the fitevict front door. Central sees an ordinary hugpy worker (register, heartbeat, /infer, /infer/stream, /infer/cancel, /health); every inference is forwarded to fitevict's /v1/chat/completions, which owns evict-to-fit, load, serve and call_log. The contract is lifted from hugpy_fleet.worker.agent; nothing below it is.

hugpy-worker --central http://127.0.0.1:7020 --name ae-worker --port 9200 \
    --advertise http://192.168.1.100:9200 --front-door http://127.0.0.1:8080

Without --central it serves locally and never registers.

Metadata

Release files for hugpy-worker 0.1.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-worker 0.1.9
File Size Uploaded
hugpy_worker-0.1.9.tar.gz 25.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-worker 0.1.9
File Interpreter ABI Platform
hugpy_worker-0.1.9-py3-none-any.whl Python 3 none any Details

Total release size: 49.3 kB

Release files / hugpy_worker-0.1.9.tar.gz

Download URL hugpy_worker-0.1.9.tar.gz
Size 25.2 kB
Tags Source
SHA-256 checksum
How to use checksums
543e8cb0c7adf5b9e81d5ae4473cd7b3819957251a172f4f9de535e886d42d78
BLAKE2b-256 checksum
How to use checksums
4ba357c833d01f83f2f6b115b5e64abd0ea48f9a96fe85fc7bae98803d3ab3fb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_worker-0.1.9-py3-none-any.whl

Download URL hugpy_worker-0.1.9-py3-none-any.whl
Size 24.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1b6c3b6915acd5adb975b6e9b87568367f8689efffe601fe119fd17fb3e5736c
BLAKE2b-256 checksum
How to use checksums
5ebc3184cd6a3c2810c4e628c6e6e5deb92b4ef203b956d2e77d63550f6a9381
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

This release

0.1.9 This release

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page