Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.18

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.18
File Size Uploaded
hugpy_core-0.1.18.tar.gz 80.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.18
File Interpreter ABI Platform
hugpy_core-0.1.18-py3-none-any.whl Python 3 none any Details

Total release size: 166.3 kB

Release files / hugpy_core-0.1.18.tar.gz

Download URL hugpy_core-0.1.18.tar.gz
Size 80.9 kB
Tags Source
SHA-256 checksum
How to use checksums
5a885babcb2bd6edefed0db8d835044c01cb29aac6c4fee7a2c89a94853cd307
BLAKE2b-256 checksum
How to use checksums
d550bfd4822d32d7fb6976da7a9acefe1019ea8ab30ea715522b30f0e1360677
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.18-py3-none-any.whl

Download URL hugpy_core-0.1.18-py3-none-any.whl
Size 85.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d8b490c1182fdb015f8170c64ee787c83ecc1af6df038feb624217c07d457aa7
BLAKE2b-256 checksum
How to use checksums
723948c634e5a2b1c1f0bc4a41f1d198d0a0eae1f84cba4566a7f72683b66cd5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.18 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page