hugpy_core
hugpy central, minimal. Workers (hugpy_worker, one per box, over fitevict)
register and heartbeat here; the registry is live in memory. /v1/chat/completions
picks an online worker that has the model (resident first; alloc.worker pins one)
and relays to its /infer/stream. No evict-to-fit, discovery, admission or DB
state — each box's fitevict owns placement and the call log.
hugpy-core --host 127.0.0.1 --port 7020
Benchmark call-log history
POST /llm/benchmark/run opens a core call-log row before validation or planning.
Accepted runs keep that row pending until their asynchronous outcome is known.
Rejected plans retain their constraint reasons in the core response and error.
The response and X-Hugpy-Request-Id expose its request ID.
Benchmark history/status read call_log; the JSON state and run archives are no
longer read or written. Existing files are left intact as legacy evidence and
are not converted into invented historical call records. Grading entries store
call pointers and verdicts. History resolves answers and measurements from the
referenced execution records. Each benchmark inference core row points back to
the orchestration row, and its execution pointer identifies the wrapper row.
Pending benchmark rows from a previous core process are marked interrupted.
1 maintainer
Metadata
1 maintainer
Release files for hugpy-core 0.1.43
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hugpy_core-0.1.43.tar.gz | 116.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hugpy_core-0.1.43-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 240.1 kB
Release files / hugpy_core-0.1.43.tar.gz
| Download URL | hugpy_core-0.1.43.tar.gz |
|---|---|
| Size | 116.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8e6346f9463a65b3a14b63a7fcf00bb21865c89d8e857c0732e369aedadd5dc1
|
|
BLAKE2b-256 checksum How to use checksums |
b4bb00db6e6823af44766f48fe65d24edf20ef1b2d4ce585103075f418b85995
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / hugpy_core-0.1.43-py3-none-any.whl
| Download URL | hugpy_core-0.1.43-py3-none-any.whl |
|---|---|
| Size | 123.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ecd248a78421ae4964822d1f4306bd6323e1f726afb0d413fce55ce92135c7e9
|
|
BLAKE2b-256 checksum How to use checksums |
779144e820050ef2eb494ccb8a1c11bbba962dc8e694475279c17203f4700841
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
