Skip to main content

szl-serve

One OpenAI-shaped chat call. One pinned weight. One receipt.

KERNEL-owned canonical governed-inference recipe + validator + energy receipt for SZL Holdings.

SZL Holdings — Orbit v2

Control before action. Evidence after.

Product · Proof · GitHub organization

This is not a vendor engine. It is the silhouette of 2026 serving (vLLM / SGLang / TGI / TensorRT-LLM / llama.cpp / Dynamo) — without copying those engines, and without fabricating tokens/s or joules.

Homepage: a-11-oy.com · Owner: Stephen P. Lutar Jr. / SZL Holdings · Doctrine v11 LOCKED 749/14/163 · Λ = Conjecture 1 (advisory, never a theorem) · Apache-2.0


What this is NOT

  • Not vLLM. Not TGI. Not TensorRT-LLM. Not SGLang. Not Dynamo. Those names are the 2026 silhouette. This repo does not vendor-copy them. GPU path is ROADMAP until MEASURED on named hardware.
  • Not a tokens/s leaderboard. A MEASURED sample is raw completion tokens + elapsed_ms. No derived tok/s rating.
  • Not proven trust. A hash-chained receipt proves integrity of that record. It does not prove the model, the lab, or Λ.
  • Not a takeover of the Hugging Face Space. FORGE owns szl-holdings/szl-forge / SZLHOLDINGS/szl-model-inference-lab. This KERNEL repo pins that MEASURED lab as the live CPU path. It does not invent a second runtime.
  • Not szl-forge-lab. That Space is SNAPSHOT / READ-ONLY, not a trainer, not a serve runtime. Do not point szl-serve at forge-lab.
  • Not Ask & Act as a live control plane. The a11oy operator tab does not gate, launch, or control this recipe.
  • Not energy-attested-runs as MEASURED serve energy. That corpus is 8/8 SIMULATED, not an NVML joule delta and not a live serve path.

Honesty plate: CARD.md.


ATELIER lock

Serve studio = SZLHOLDINGS/szl-model-inference-lab only. GPU remains ROADMAP.

Surface Class
SZLHOLDINGS/szl-model-inference-lab LIVE / MEASURED serve studio (this pin)
SZLHOLDINGS/szl-forge-lab SNAPSHOT, not a trainer, not a serve target
GPU / vLLM / TGI / TensorRT-LLM / SGLang / Dynamo ROADMAP
SZLHOLDINGS/energy-attested-runs 8/8 SIMULATED — not this recipe's CPU energy evidence
Ask & Act not a live control plane

LIVE CPU (MEASURED) — pin this lab, do not invent a second runtime

ATELIER serve studio. Not szl-forge-lab.

Surface https://szlholdings-szl-model-inference-lab.hf.space
Space https://huggingface.co/spaces/SZLHOLDINGS/szl-model-inference-lab
FORGE source e28abe9d4be3ce5efbb09ea2a3a248494c654636
API OpenAI subset POST /v1/chat/completions
Model SZLHOLDINGS/SZL-Khipu-1.5B-GGUF@67d60ec577730747055491640cfb91fc4a4b5d25
GGUF SZL-Khipu-1.5B-Q4_K_M.gguf · SHA-256 13c1a1993063e1dff92f7413ccf48eaca6d48efc8801ae9af35961ae3396623a · 986047904 bytes
Sample 2026-11-04 24 completion tokens · elapsed_ms 8237 · execution_record UNSIGNED · evidence measured-cpu-serve-20261104.json
Energy joules=null · label UNAVAILABLE (CPU lab; MEASURED only from a real NVML delta)
GPU ROADMAP until MEASURED on named hardware
SLA Best-effort public demo. No provider SLA. Dummy bearer not-a-secret only — never a real token.
curl https://szlholdings-szl-model-inference-lab.hf.space/v1/chat/completions \
  -H "content-type: application/json" \
  -H "authorization: Bearer not-a-secret" \
  -d '{"model":"SZLHOLDINGS/SZL-Khipu-1.5B-GGUF@67d60ec577730747055491640cfb91fc4a4b5d25","messages":[{"role":"user","content":"Explain one limit of cryptographic receipts."}],"max_tokens":24,"stream":false}'

Contract: /.well-known/szl-inference-contract.json. Identity: /api/v1/identity.


Read-only runtime qualification

The pinned recipe can drift from the public Space. qualify reads four bounded JSON surfaces and emits one receipt with per-field OBSERVED, DIVERGENT, or UNKNOWN states:

szl-serve qualify --output qualification.json

The command checks /api/build-info, /api/v1/identity, /.well-known/szl-inference-contract.json, and /v1/models. It requires the exact Forge source repository and revision, model revision, GGUF file, byte count, SHA-256, contract schema, and model-list identity. A timeout, partial JSON, HTML response, oversized response, cross-origin redirect, missing field, or stale value never becomes success. The current public contract may report UNKNOWN for source repository until /api/build-info exposes that field; the qualifier does not infer it from a URL or Space name.

Qualification is read-only. It sends no prompt, mints no signed release receipt, changes no provider state, and says nothing about response quality, safety, SLA, or production readiness.


Airgap twin — same pin, local llama.cpp / Ollama

Local llama.cpp and Ollama run the same Q4_K_M bytes. They are the airgap twin of the Space, not a clone of vLLM.

llama-cli    -hf SZLHOLDINGS/SZL-Khipu-1.5B-GGUF:Q4_K_M
llama-server -hf SZLHOLDINGS/SZL-Khipu-1.5B-GGUF:Q4_K_M
ollama run hf.co/SZLHOLDINGS/SZL-Khipu-1.5B-GGUF:Q4_K_M

Print the recipe (no GGUF download):

python -m szl_serve recipe

Generated command strings target POSIX shells (sh/Bash). Prompts, the JSON request body, and server host/port values are quoted as literal arguments; shell substitutions inside them are not executed. PowerShell and cmd.exe use different quoting rules and are not supported by these command generators. The generators print recipes only; the selected engine validates host/port values.


Controller — schema outside the weights

Model output is proposal-only. Copy of khipu.schema.json is pinned from the GGUF repo (SHA-256 b95f9927366dae7c5d36cfb7de6e229eb605524318ab642a6aa2292a212170d0).

Built wheels include this exact 6,262-byte schema and its PIN.json under szl_serve/schemas/. The validator prefers these package resources; source checkouts use the canonical root schemas/ copy. Git preserves LF bytes for both JSON files on Windows as well as Linux. Schema bytes and the SHA-256 pin remain strict: a drifted packaged schema is rejected, rather than normalized or replaced with a fallback copy.

  • Hallucinated citedNodeIds → REJECT. Never silently repaired into a green plan.
  • brainBinding.status stays NOT_RESOLVED.
  • Real model output provenance is MODEL_PROPOSED, not SYNTHETIC.
  • Calls using source="MODEL" require controller-provided offered_ids; the model's own candidate list cannot establish grounding. An empty list explicitly means no handles were offered and still enforces rejection.
  • Invalid JSON / cross-field contract failure → fail closed (REJECT).

The CLI examples below check schema and internal consistency (source="UNKNOWN"). They do not establish that handles were independently offered to a real model.

python -m szl_serve validate tests/fixtures/plan_model_proposed.json
python -m szl_serve validate tests/fixtures/plan_hallucinated_cited.json   # exits 1

Energy + receipt

Each wrap uses szl-energy-attest semantics (import if available, else a tiny honest local meter):

Energy When
MEASURED Real NVML energy-counter delta. joules is that number.
UNAVAILABLE No GPU / no fresh NVML delta (the CPU lab and this CI). joules=null.

Never invent a joule. Hash-chain a serve receipt: request hash, output hash, model pin, energy label. Receipt is UNSIGNED unless a key is actually present. Do not fake DSSE.


MEASURED vs ROADMAP vs UNAVAILABLE

Surface Label
FORGE Space CPU OpenAI subset + GGUF pin + 2026-11-04 sample MEASURED
llama.cpp / Ollama commands for the same pin LIVE recipe (airgap twin)
Energy on CPU UNAVAILABLE
GPU / vLLM / TGI / TensorRT-LLM / SGLang / Dynamo ROADMAP
GPU attention ROADMAP — no fused/paged-attention LIVE claim; no tokens/s invented
Speculative decode (szl-specdecode) SPECDECODE=UNAVAILABLE until soft-import LIVE — see below
SZLHOLDINGS/szl-forge-lab SNAPSHOT — not a trainer; do not point this recipe at it
SZLHOLDINGS/energy-attested-runs 8/8 SIMULATED — not MEASURED NVML; not a live serve path
Ask & Act not a live control plane
Chaski, ReceiptAgent weights ROADMAP stubs on this config surface — not fake LIVE

Λ is Conjecture 1. It does not become a theorem because a chat call returned 21 tokens.


Speculative decode silhouette (optional)

Pointer to szl-holdings/szl-specdecode (HF twin SZLHOLDINGS/szl-specdecode). Soft-imports szl_specdecode.verify_draft when that package is installed; otherwise labels SPECDECODE=UNAVAILABLE. GPU draft kernels stay UNAVAILABLE. Speedup claim stays null until a MEASURED draft/target pair receipt exists. Not a rehost of Medusa, EAGLE, TensorRT-LLM speculative decoding, or vLLM. Credit Stephen Lutar. MEASURED-or-null.

from szl_serve.specdecode import probe_specdecode, get_verify_draft

probe_specdecode()           # {"label": "SPECDECODE=UNAVAILABLE", ...} or import-LIVE
get_verify_draft()           # callable or None — never fabricates tokens/s

Tests

Unit tests use fixture plan JSON. No network. Do not download the ~1 GB GGUF in CI. The packaging regression builds a wheel and an sdist-to-wheel round trip with installed build tools and no package index, then installs the wheel into a temporary target. An isolated Python subprocess outside the checkout checks the exact schema and pin, validates a benign synthetic ABSTAIN proposal, and confirms that tampered package data fails closed. Build tooling is a test extra.

python -m pip install --require-hashes -r requirements/test.lock
python -m pip install --no-deps -e .
pytest -q

requirements/test.lock is a universal hash-locked closure generated from the published package metadata at the declared Python 3.10 floor, with an exclude-newer cutoff of 2026-11-02 UTC. Library compatibility ranges remain in pyproject.toml; the lock controls CI and review reproduction without narrowing downstream consumers.


Layout

LICENSE                 Apache-2.0, Copyright 2026 SZL Holdings
README.md               this Series A face
CARD.md                 honesty plate
schemas/khipu.schema.json
szl_serve/{__init__,schema,energy,recipe,cli}.py
tests/fixtures/*.json

Governed AI you can pin — not a leaderboard you can fake.

a-11-oy.com · Khipu GGUF · MEASURED lab (FORGE)

SLSA: L1 honest · L2 attested · L3 roadmap. Λ = Conjecture 1. Trust ceiling 0.97 — never 100%.

Metadata

Release files for szl-serve 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for szl-serve 0.1.0
File Size Uploaded Provenance Actions
szl_serve-0.1.0.tar.gz 54.3 kB With provenance Details for szl_serve-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for szl-serve 0.1.0
File Interpreter ABI Platform Actions
szl_serve-0.1.0-py3-none-any.whl Python 3 none any Details for szl_serve-0.1.0-py3-none-any.whl

Total release size: 93.8 kB

Release files / szl_serve-0.1.0.tar.gz

Download URL szl_serve-0.1.0.tar.gz
Size 54.3 kB
Tags Source
SHA-256 checksum
How to use checksums
1c900b11f32c4534c1ff59007bbe9ee96d999fce2e2d039a4bf422ceb468db56
BLAKE2b-256 checksum
How to use checksums
fb0e916341076c6d0e6e36e2b483f44314b689e6d21b05309a78b5aae5ae4ff4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 15, 2026.

Transparency log

Release files / szl_serve-0.1.0-py3-none-any.whl

Download URL szl_serve-0.1.0-py3-none-any.whl
Size 39.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8a8fafd3f29aad0899bfcfe4320c09617f55b5f96dff135f940c920682c7dc1b
BLAKE2b-256 checksum
How to use checksums
734ac8da21673d69d0e118629c93ad670de07ec312951e246169496e452c04c1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 15, 2026.

Transparency log

Security for szl-serve 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for szl_serve-0.1.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 15, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page