Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.41

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.41
File Size Uploaded
hugpy_core-0.1.41.tar.gz 108.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.41
File Interpreter ABI Platform
hugpy_core-0.1.41-py3-none-any.whl Python 3 none any Details

Total release size: 224.3 kB

Release files / hugpy_core-0.1.41.tar.gz

Download URL hugpy_core-0.1.41.tar.gz
Size 108.0 kB
Tags Source
SHA-256 checksum
How to use checksums
5ca053001f9d28713494254f41fbe0a653dd8e5c78d286371e83c42f89391944
BLAKE2b-256 checksum
How to use checksums
8cb70cd3935b500940720142f47ca1134bb6675e71a9dfad285b8e1616b5d8a0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.41-py3-none-any.whl

Download URL hugpy_core-0.1.41-py3-none-any.whl
Size 116.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
413f7856ea1744cc304252053acedf72f507ee94efbb56dd285ffef0878f725c
BLAKE2b-256 checksum
How to use checksums
73549ea772c7280ccd1e2ba3faf53da42b5a26fbd0d60871d486339e4558d5a0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.41 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page