Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.21

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.21
File Size Uploaded
hugpy_core-0.1.21.tar.gz 81.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.21
File Interpreter ABI Platform
hugpy_core-0.1.21-py3-none-any.whl Python 3 none any Details

Total release size: 167.7 kB

Release files / hugpy_core-0.1.21.tar.gz

Download URL hugpy_core-0.1.21.tar.gz
Size 81.6 kB
Tags Source
SHA-256 checksum
How to use checksums
2bf2e311f1fdbb16ceeda28c4993d0cbe9b1206d995a1b439d6271fc2c8e6446
BLAKE2b-256 checksum
How to use checksums
09f68ca4e14a59439e8ede779c1f75dc6231ba198946511a76f13dc04c152125
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.21-py3-none-any.whl

Download URL hugpy_core-0.1.21-py3-none-any.whl
Size 86.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d52c2d31fc246f5fb52a5199e1939efd581744ac4b2e42906c376d779ed4cc38
BLAKE2b-256 checksum
How to use checksums
132d5df81f83e5f16c8b701a9c5a1bfe0592b5351e1695529aa6b49b39d46dd2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.21 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page