Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.29

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.29
File Size Uploaded
hugpy_core-0.1.29.tar.gz 90.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.29
File Interpreter ABI Platform
hugpy_core-0.1.29-py3-none-any.whl Python 3 none any Details

Total release size: 186.6 kB

Release files / hugpy_core-0.1.29.tar.gz

Download URL hugpy_core-0.1.29.tar.gz
Size 90.2 kB
Tags Source
SHA-256 checksum
How to use checksums
86332c524c7db440e5ff125c25a71c7592d255dd34c93619263760618be4686d
BLAKE2b-256 checksum
How to use checksums
381a13fca700802f460d43573dca0b0aee98caa58281865680d0b4b1f80566a6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.29-py3-none-any.whl

Download URL hugpy_core-0.1.29-py3-none-any.whl
Size 96.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
233f403026646357c6f007a5f8e0ac2a264a23215393e61331f6c050fb883dd9
BLAKE2b-256 checksum
How to use checksums
8e35a5d6fd68ab3a0b1eec0b65273b88076c35f574d15cbfd30e4cdc0dfeaeaf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.29 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page