Skip to main content

hugpy_core

hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict) register and heartbeat here; the registry is live in memory. /v1/chat/completions picks an online worker that has the model (resident first; alloc.worker pins one) and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB state — each box's fitevict owns placement and the call log.

hugpy-core --host 127.0.0.1 --port 7020

Metadata

Release files for hugpy-core 0.1.17

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hugpy-core 0.1.17
File Size Uploaded
hugpy_core-0.1.17.tar.gz 79.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hugpy-core 0.1.17
File Interpreter ABI Platform
hugpy_core-0.1.17-py3-none-any.whl Python 3 none any Details

Total release size: 162.8 kB

Release files / hugpy_core-0.1.17.tar.gz

Download URL hugpy_core-0.1.17.tar.gz
Size 79.6 kB
Tags Source
SHA-256 checksum
How to use checksums
82223a499c9ed1ea7a6292475548ffcc29b6079ddbcce41159d2722ad1ae6646
BLAKE2b-256 checksum
How to use checksums
0ec5b07de2644bdd5728a1675b5a93293db279c627f6f1e84bd01a7e2c35d203
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / hugpy_core-0.1.17-py3-none-any.whl

Download URL hugpy_core-0.1.17-py3-none-any.whl
Size 83.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
6ccaae82f80c8eb95bab0b8e221f5e9670c48e828e560c040558ee8db3969865
BLAKE2b-256 checksum
How to use checksums
e15bf95272109993bba7a4011453c88b6e6265900a4922536df7b3fcb3924c4a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.46

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.26

2 release files

This release

0.1.17 This release

2 release files

0.1.9

1 release file

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page