Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.24

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.24
File Size Uploaded
hugpy_core-0.1.24.tar.gz 83.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.24
File Interpreter ABI Platform
hugpy_core-0.1.24-py3-none-any.whl Python 3 none any Details

Total release size: 172.8 kB

Release files / hugpy_core-0.1.24.tar.gz

Download URL hugpy_core-0.1.24.tar.gz
Size 83.7 kB
Tags Source
SHA-256 checksum
How to use checksums
59525b08b10fb32ccef9b503dc7c321899f4f43cfedc8366d9f77d169ae8f895
BLAKE2b-256 checksum
How to use checksums
7a774953be7cdcb6f90ac09f5346ea53f9da95d9af2942b2be3150580220bc2b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.24-py3-none-any.whl

Download URL hugpy_core-0.1.24-py3-none-any.whl
Size 89.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c3c9780cdf6cbf55c787a76d9065b8e03eb92d4f27c2e115c792483a00e6de3f
BLAKE2b-256 checksum
How to use checksums
3048eb5be6ad663cd348a0635c8f60131728c4e00ff134880ea1b3046d7a10a1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.24 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page