Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.27

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.27
File Size Uploaded
hugpy_core-0.1.27.tar.gz 86.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.27
File Interpreter ABI Platform
hugpy_core-0.1.27-py3-none-any.whl Python 3 none any Details

Total release size: 180.3 kB

Release files / hugpy_core-0.1.27.tar.gz

Download URL hugpy_core-0.1.27.tar.gz
Size 86.9 kB
Tags Source
SHA-256 checksum
How to use checksums
b367005d1b82dcf5e2aa6fd39eedbda924705a86cab022efd61d2e3b5ad2e75a
BLAKE2b-256 checksum
How to use checksums
c5b17039db565ca7cac5470934b6f18595deadcd5dafd03615a38aeefa35d23a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.27-py3-none-any.whl

Download URL hugpy_core-0.1.27-py3-none-any.whl
Size 93.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d6336236522773cb502388608f2eebcb6c0a7561f58d90de72acb95b77c24b8f
BLAKE2b-256 checksum
How to use checksums
3ec353128a80172cffa008c51b6fe9683692127cfadb5ad033a2c70207a43d10
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.27 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page