Skip to main content

Analytical preflight for omegaprompt calibration: deterministic classifier over seven calibration trap patterns (self-agreement bias, small-sample KC-4 power, variant homogeneity, rubric concentration, judge budget, empty reference, missing held-out slice). Emits AnalyticalFinding records the omegaprompt pipeline consumes via derive_adaptation_plan.

Project description

mini-antemortem-cli

New to this? Start here: EASY_README.md (English) · EASY_README_KR.md (한국어). Compressed plain-language introductions for readers who find the full doc below intimidating.

License: Apache 2.0 Python Parent

Analytical preflight for omegaprompt calibration. Reads the run configuration and classifies seven calibration-specific trap patterns against deterministic rules. No API calls, no network; reasoning is deterministic given the inputs. Emits AnalyticalFinding records that feed omegaprompt's derive_adaptation_plan.

pip install mini-antemortem-cli

Why this is separate from omegaprompt

omegaprompt ships a plugin interface (omegaprompt.preflight.contracts + omegaprompt.preflight.adaptation) but no classifier code. Standalone users do not need analytical preflight — the main pipeline runs with declared defaults. Users who want analytical risk assessment over their configuration install this package alongside:

pip install omegaprompt mini-antemortem-cli

Trap patterns

Seven deterministic classifications run against the run config:

Trap id Hypothesis
self_agreement_bias Target and judge share a vendor; judge's biases overlap with target.
small_sample_kc4_power Dataset too small for Pearson correlation to carry statistical power.
variants_homogeneous System-prompt variants are too similar for sensitivity to have signal.
rubric_weight_concentration A single rubric dimension carries most of the weight.
judge_budget_too_small Judge output budget is SMALL but rubric has many dimensions + gates.
empty_reference_with_strict_rubric No dataset item has a reference; rubric implies ground-truth comparison.
no_held_out_slice No --test slice; walk-forward cannot run.

Each pattern returns one of REAL / GHOST / NEW / UNRESOLVED with a severity (blocker / high / medium / low) and a remediation hint.

Usage

from omegaprompt.domain.dataset import Dataset, DatasetItem
from omegaprompt.domain.judge import Dimension, HardGate, JudgeRubric
from omegaprompt.domain.params import PromptVariants
from omegaprompt.preflight import PreflightReport, derive_adaptation_plan
from mini_antemortem_cli import analytical_preflight

rubric = JudgeRubric(
    dimensions=[
        Dimension(name="accuracy", description="correct", weight=0.85),
        Dimension(name="clarity",  description="readable", weight=0.15),
    ],
    hard_gates=[HardGate(name="no_refusal", description="x", evaluator="judge")],
)
variants = PromptVariants(system_prompts=["You are an assistant."], few_shot_examples=[])
train = Dataset(items=[DatasetItem(id=f"t{i}", input=f"task {i}") for i in range(5)])
test = Dataset(items=[DatasetItem(id=f"v{i}", input=f"val {i}") for i in range(3)])

findings = analytical_preflight(
    target_provider="openai",
    target_model="gpt-4o-mini",
    judge_provider="openai",
    judge_model="gpt-4o-mini",
    train_dataset=train,
    test_dataset=test,
    rubric=rubric,
    variants=variants,
    judge_output_budget="small",
)

report = PreflightReport(analytical_findings=findings)
plan = derive_adaptation_plan(report=report)
# plan.skip_axes, plan.max_gap_override, etc.

Design principles

  • Deterministic. Same config in, same findings out. No LLM calls; no sampling noise.
  • Source-level citations. Each finding carries a note describing the rule that fired and a remediation hint. No hand-wave.
  • Severity discipline. high severity findings drive AdaptationPlan overrides that only strengthen the discipline (per apply_adaptation_plan invariants).
  • Extensible. Add your own TrapPattern and classifier function; compose with the built-in seven.

Validation

Every trap pattern has positive + negative test cases. No API calls, fully offline. Run with pytest -q.

Relation to the family

  • Antemortem / antemortem-cli — pre-implementation reconnaissance discipline for code changes. The naming "mini-antemortem-cli" echoes this family; the enumerate-then-classify pattern comes from there.
  • omegaprompt — prompt calibration engine. This package feeds its preflight plugin interface.
  • mini-omega-lock — empirical sibling. Runs live probes to measure judge consistency and endpoint reliability.

License

Apache 2.0. See LICENSE.

License history. PyPI distributions of version 0.1.0 were shipped with an MIT LICENSE file. The repository was relicensed to Apache 2.0 on 2026-04-22 (commit d2d7eb7); 0.2.0 (2026-04-28) and all later versions ship under Apache 2.0. Anyone who installed 0.1.0 holds an MIT license to that copy — license changes do not apply retroactively.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mini_antemortem_cli-0.3.0.tar.gz (16.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mini_antemortem_cli-0.3.0-py3-none-any.whl (21.8 kB view details)

Uploaded Python 3

File details

Details for the file mini_antemortem_cli-0.3.0.tar.gz.

File metadata

  • Download URL: mini_antemortem_cli-0.3.0.tar.gz
  • Upload date:
  • Size: 16.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for mini_antemortem_cli-0.3.0.tar.gz
Algorithm Hash digest
SHA256 25f7aeab86c0c6b1bb22fa0ef10a79824a91aa5af13facd880cff2e4a56097ae
MD5 c31f714a5b992b0dff2dca60b4e83b51
BLAKE2b-256 9c0e568e056d7d6384e94bb2e5b73a0ce9b2a42f81e6dc2932cc82ce0daf95ab

See more details on using hashes here.

File details

Details for the file mini_antemortem_cli-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mini_antemortem_cli-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2a0a76ec94d7859f00822255c5596a1f244d437c9733f6691e5a92ebc1879c46
MD5 9a6ffd5c31c84e2c9bcd9028db42e008
BLAKE2b-256 401362f09ae636f6dd298bfa862a53477d9feafb69225f9e5e5ac487fe74a141

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page