Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.16

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.16
File Size Uploaded
hugpy_core-0.1.16.tar.gz 78.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.16
File Interpreter ABI Platform
hugpy_core-0.1.16-py3-none-any.whl Python 3 none any Details

Total release size: 159.4 kB

Release files / hugpy_core-0.1.16.tar.gz

Download URL hugpy_core-0.1.16.tar.gz
Size 78.2 kB
Tags Source
SHA-256 checksum
How to use checksums
9fe1d2468b566d1b44ef84d2fe5e29c6f7d42bfb72ecae6132bfa48f5150b143
BLAKE2b-256 checksum
How to use checksums
857d41c2d4724cf44a478ed2ae3c2dced3b16d8810be4afaf14bf4fbd48497e7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.16-py3-none-any.whl

Download URL hugpy_core-0.1.16-py3-none-any.whl
Size 81.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e7eadabd67cf7c6a40c4a575cb732b872b61595ce324ad873eac891a09d6b20c
BLAKE2b-256 checksum
How to use checksums
473a7f434a63410b4740b8ac3d092454f93f184ff90c5bf939f521ace52cb29d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.16 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page