Analytical preflight for omegaprompt calibration: deterministic classifier over seven calibration trap patterns (self-agreement bias, small-sample KC-4 power, variant homogeneity, rubric concentration, judge budget, empty reference, missing held-out slice). Emits AnalyticalFinding records the omegaprompt pipeline consumes via derive_adaptation_plan.
Project description
mini-antemortem-cli
New to this? Start here: EASY_README.md (English) · EASY_README_KR.md (한국어). Compressed plain-language introductions for readers who find the full doc below intimidating.
Analytical preflight for omegaprompt calibration. Reads the run configuration and classifies seven calibration-specific trap patterns against deterministic rules. No API calls, no network; reasoning is deterministic given the inputs. Emits
AnalyticalFindingrecords that feedomegaprompt'sderive_adaptation_plan.
pip install mini-antemortem-cli
Why this is separate from omegaprompt
omegaprompt ships a plugin interface (omegaprompt.preflight.contracts + omegaprompt.preflight.adaptation) but no classifier code. Standalone users do not need analytical preflight — the main pipeline runs with declared defaults. Users who want analytical risk assessment over their configuration install this package alongside:
pip install omegaprompt mini-antemortem-cli
Trap patterns
Seven deterministic classifications run against the run config:
| Trap id | Hypothesis |
|---|---|
self_agreement_bias |
Target and judge share a vendor; judge's biases overlap with target. |
small_sample_kc4_power |
Dataset too small for Pearson correlation to carry statistical power. |
variants_homogeneous |
System-prompt variants are too similar for sensitivity to have signal. |
rubric_weight_concentration |
A single rubric dimension carries most of the weight. |
judge_budget_too_small |
Judge output budget is SMALL but rubric has many dimensions + gates. |
empty_reference_with_strict_rubric |
No dataset item has a reference; rubric implies ground-truth comparison. |
no_held_out_slice |
No --test slice; walk-forward cannot run. |
Each pattern returns one of REAL / GHOST / NEW / UNRESOLVED with a severity (blocker / high / medium / low) and a remediation hint.
Usage
from omegaprompt.domain.dataset import Dataset, DatasetItem
from omegaprompt.domain.judge import Dimension, HardGate, JudgeRubric
from omegaprompt.domain.params import PromptVariants
from omegaprompt.preflight import PreflightReport, derive_adaptation_plan
from mini_antemortem_cli import analytical_preflight
rubric = JudgeRubric(
dimensions=[
Dimension(name="accuracy", description="correct", weight=0.85),
Dimension(name="clarity", description="readable", weight=0.15),
],
hard_gates=[HardGate(name="no_refusal", description="x", evaluator="judge")],
)
variants = PromptVariants(system_prompts=["You are an assistant."], few_shot_examples=[])
train = Dataset(items=[DatasetItem(id=f"t{i}", input=f"task {i}") for i in range(5)])
test = Dataset(items=[DatasetItem(id=f"v{i}", input=f"val {i}") for i in range(3)])
findings = analytical_preflight(
target_provider="openai",
target_model="gpt-4o-mini",
judge_provider="openai",
judge_model="gpt-4o-mini",
train_dataset=train,
test_dataset=test,
rubric=rubric,
variants=variants,
judge_output_budget="small",
)
report = PreflightReport(analytical_findings=findings)
plan = derive_adaptation_plan(report=report)
# plan.skip_axes, plan.max_gap_override, etc.
Design principles
- Deterministic. Same config in, same findings out. No LLM calls; no sampling noise.
- Source-level citations. Each finding carries a
notedescribing the rule that fired and aremediationhint. No hand-wave. - Severity discipline.
highseverity findings driveAdaptationPlanoverrides that only strengthen the discipline (perapply_adaptation_planinvariants). - Extensible. Add your own
TrapPatternand classifier function; compose with the built-in seven.
Validation
Every trap pattern has positive + negative test cases. No API calls, fully offline. Run with pytest -q.
Relation to the family
- Antemortem / antemortem-cli — pre-implementation reconnaissance discipline for code changes. The naming "mini-antemortem-cli" echoes this family; the enumerate-then-classify pattern comes from there.
- omegaprompt — prompt calibration engine. This package feeds its preflight plugin interface.
- mini-omega-lock — empirical sibling. Runs live probes to measure judge consistency and endpoint reliability.
License
Apache 2.0. See LICENSE.
License history. PyPI distributions of version 0.1.0 were shipped with an MIT LICENSE file. The repository was relicensed to Apache 2.0 on 2026-04-22 (commit d2d7eb7); 0.2.0 (2026-04-28) and all later versions ship under Apache 2.0. Anyone who installed 0.1.0 holds an MIT license to that copy — license changes do not apply retroactively.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mini_antemortem_cli-0.3.0.tar.gz.
File metadata
- Download URL: mini_antemortem_cli-0.3.0.tar.gz
- Upload date:
- Size: 16.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
25f7aeab86c0c6b1bb22fa0ef10a79824a91aa5af13facd880cff2e4a56097ae
|
|
| MD5 |
c31f714a5b992b0dff2dca60b4e83b51
|
|
| BLAKE2b-256 |
9c0e568e056d7d6384e94bb2e5b73a0ce9b2a42f81e6dc2932cc82ce0daf95ab
|
File details
Details for the file mini_antemortem_cli-0.3.0-py3-none-any.whl.
File metadata
- Download URL: mini_antemortem_cli-0.3.0-py3-none-any.whl
- Upload date:
- Size: 21.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2a0a76ec94d7859f00822255c5596a1f244d437c9733f6691e5a92ebc1879c46
|
|
| MD5 |
9a6ffd5c31c84e2c9bcd9028db42e008
|
|
| BLAKE2b-256 |
401362f09ae636f6dd298bfa862a53477d9feafb69225f9e5e5ac487fe74a141
|