Skip to main content

Analytical preflight for omegaprompt calibration: deterministic classifier over seven calibration trap patterns (self-agreement bias, small-sample KC-4 power, variant homogeneity, rubric concentration, judge budget, empty reference, missing held-out slice). Emits AnalyticalFinding records the omegaprompt pipeline consumes via derive_adaptation_plan.

Project description

mini-antemortem-cli

New to this? Start here: EASY_README.md (English) · EASY_README_KR.md (한국어). Compressed plain-language introductions for readers who find the full doc below intimidating.

License: Apache 2.0 Python Parent

Analytical preflight for omegaprompt calibration. Reads the run configuration and classifies seven calibration-specific trap patterns against deterministic rules. No API calls, no network; reasoning is deterministic given the inputs. Emits AnalyticalFinding records that feed omegaprompt's derive_adaptation_plan.

pip install mini-antemortem-cli

Why this is separate from omegaprompt

omegaprompt ships a plugin interface (omegaprompt.preflight.contracts + omegaprompt.preflight.adaptation) but no classifier code. Standalone users do not need analytical preflight — the main pipeline runs with declared defaults. Users who want analytical risk assessment over their configuration install this package alongside:

pip install omegaprompt mini-antemortem-cli

Trap patterns

Seven deterministic classifications run against the run config:

Trap id Hypothesis
self_agreement_bias Target and judge share a vendor; judge's biases overlap with target.
small_sample_kc4_power Dataset too small for Pearson correlation to carry statistical power.
variants_homogeneous System-prompt variants are too similar for sensitivity to have signal.
rubric_weight_concentration A single rubric dimension carries most of the weight.
judge_budget_too_small Judge output budget is SMALL but rubric has many dimensions + gates.
empty_reference_with_strict_rubric No dataset item has a reference; rubric implies ground-truth comparison.
no_held_out_slice No --test slice; walk-forward cannot run.

Each pattern returns one of REAL / GHOST / NEW / UNRESOLVED with a severity (blocker / high / medium / low) and a remediation hint.

Usage

from omegaprompt.domain.dataset import Dataset, DatasetItem
from omegaprompt.domain.judge import Dimension, HardGate, JudgeRubric
from omegaprompt.domain.params import PromptVariants
from omegaprompt.preflight import PreflightReport, derive_adaptation_plan
from mini_antemortem_cli import analytical_preflight

rubric = JudgeRubric(
    dimensions=[
        Dimension(name="accuracy", description="correct", weight=0.85),
        Dimension(name="clarity",  description="readable", weight=0.15),
    ],
    hard_gates=[HardGate(name="no_refusal", description="x", evaluator="judge")],
)
variants = PromptVariants(system_prompts=["You are an assistant."], few_shot_examples=[])
train = Dataset(items=[DatasetItem(id=f"t{i}", input=f"task {i}") for i in range(5)])
test = Dataset(items=[DatasetItem(id=f"v{i}", input=f"val {i}") for i in range(3)])

findings = analytical_preflight(
    target_provider="openai",
    target_model="gpt-4o-mini",
    judge_provider="openai",
    judge_model="gpt-4o-mini",
    train_dataset=train,
    test_dataset=test,
    rubric=rubric,
    variants=variants,
    judge_output_budget="small",
)

report = PreflightReport(analytical_findings=findings)
plan = derive_adaptation_plan(report=report)
# plan.skip_axes, plan.max_gap_override, etc.

Design principles

  • Deterministic. Same config in, same findings out. No LLM calls; no sampling noise.
  • Source-level citations. Each finding carries a note describing the rule that fired and a remediation hint. No hand-wave.
  • Severity discipline. high severity findings drive AdaptationPlan overrides that only strengthen the discipline (per apply_adaptation_plan invariants).
  • Extensible. Add your own TrapPattern and classifier function; compose with the built-in seven.

Validation

Every trap pattern has positive + negative test cases. No API calls, fully offline. Run with pytest -q.

Relation to the family

  • Antemortem / antemortem-cli — pre-implementation reconnaissance discipline for code changes. The naming "mini-antemortem-cli" echoes this family; the enumerate-then-classify pattern comes from there.
  • omegaprompt — prompt calibration engine. This package feeds its preflight plugin interface.
  • mini-omega-lock — empirical sibling. Runs live probes to measure judge consistency and endpoint reliability.

License

Apache 2.0. See LICENSE.

License history. PyPI distributions of version 0.1.0 were shipped with an MIT LICENSE file. The repository was relicensed to Apache 2.0 on 2026-04-22 (commit d2d7eb7); 0.2.0 (2026-04-28) and all later versions ship under Apache 2.0. Anyone who installed 0.1.0 holds an MIT license to that copy — license changes do not apply retroactively.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mini_antemortem_cli-0.2.0.tar.gz (11.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mini_antemortem_cli-0.2.0-py3-none-any.whl (16.6 kB view details)

Uploaded Python 3

File details

Details for the file mini_antemortem_cli-0.2.0.tar.gz.

File metadata

  • Download URL: mini_antemortem_cli-0.2.0.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for mini_antemortem_cli-0.2.0.tar.gz
Algorithm Hash digest
SHA256 d04d1600372268af8129968f7f4c1e673220d29df0e346ed51f71a567d5a0e3e
MD5 41c849f136f55aa7eea964c2e78ceb2c
BLAKE2b-256 81a21ae5b456bd3e93ad1cd1132eba4294dc41b06294e2a380079077af361941

See more details on using hashes here.

File details

Details for the file mini_antemortem_cli-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mini_antemortem_cli-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 170d69cb2e2d55669c051b9bc451d65e48da69c5a3debf103c8bfe597e529d02
MD5 8d6c70cc5e7d2383ca5e7ba3434a5d08
BLAKE2b-256 adcd3b903ca7592fd1b011f1a22f08f31a54b1a705acbe83618004c9fee95f86

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page