Ockev
Ship the Result, Not the Conversation.
Ending the "Tomato-Egg Problem" in AI Agent Deliverables with a 35ms Discriminative Decision Engine.
"I asked an AI agent to write a recipe for tomato scrambled eggs. It proudly delivered: 'Here is your tomato scrambled eggs (note: this dish contains no pork, no beef, no chicken, and no fish).' Why are AI agents so obsessed with telling us what they didn't do? Ship the result, not the conversation."
— Shangyin Tan, UC Berkeley
The "Tomato-Egg Problem" in AI Agents
When coding and workflow agents generate deliverables (PR descriptions, documentation, code comments, executive slides, or RPA forms), they frequently exhibit Apophasis (the rhetorical habit of describing an entity by detailing what it is not):
- "Implemented JWT auth (note: we did not use session cookies or basic auth after exploring three other architectures)."
- "Updated customer export. We attempted 4 regex approaches that failed before settling on this one."
- "Tomato Scrambled Eggs (100% pork-free, beef-free, chicken-free, fish-free)."
This conversational residue clutters deliverables, expands context windows, distracts human reviewers, and leaks private development scaffolding.
Ockev solves this at the gate. Named after Occam's Razor (Entia non sunt multiplicanda praeter necessitatem) and the Jev discriminative architecture, Ockev provides an ultra-fast, zero-generation System 1 gatekeeper that intercepts conversational clutter before it reaches readers or production.
Performance & Pareto Frontier
Ockev was benchmarked on TomatoEggBench-120, a standardized 120-case real-world benchmark spanning 5 production domains (Code Repositories, Excel/CSV, PDF Documents, Form RPA, and Executive Slide Decks).
TomatoEggBench-120 Benchmark Results
| Model / System | Architecture | Benchmark Accuracy | Violation Recall | Inference Latency | Deployment Mode |
|---|---|---|---|---|---|
| Ockev-3B (Ours) | Qwen2.5-3B + Pointer Head | 95.8% (115/120) | 98.5% | 105.0 ms | Local / Private GPU |
| TypeSafe Jev 1.13.0 | Causal MoE + RLCD | 93.3% (112/120) | 96.9% | 250.0 ms | Cloud API ($42/1B tok) |
| Ockev-1.5B (Ours) | Qwen2.5-1.5B + Pointer Head | 92.5% (111/120) | 95.4% | 50.8 ms | Local / Apple Silicon |
| SemIf Qwen3.5-4B | Qwen3.5-4B (Logits) | 74.7% (89/120) | 68.0% | 850.0 ms | Local Logits Readout |
| ModernBERT-151M | ModernBERT (Fixed Head) | 25.0% (30/120) | 35.0% | 24.0 ms | Local Embeddings |
Core Architecture
Unlike standard generative LLMs that waste tokens generating verbose explanations, Ockev uses a Block-Causal Mask with a Pointer Readout Head:
State (Deliverable + Context) ──┐
├─► [Causal LM Backbone] ──► [Hidden States]
Questions (Criteria + Options) ──┘ │
▼
[Decide Token Q] ───────────────► q = W_q · h_decide ──────┐
├─► Scaled Dot Product ──► Softmax ──► Verdict
[Option Tokens K_1 ... K_N] ────► k_i = W_k · h_opt_i ─────┘
- Zero Generated Tokens: Decisions are computed in a single forward pass via metric dot-product between the decision query vector and option key vectors.
- Order Invariant: Pointer heads project options into metric space independently, eliminating choice position bias.
- Decoupled Uncertainty: Rather than treating
uncertainas an attractor token, Ockev computes decision margins directly: $$\text{Margin} = |P(\text{pass}) - P(\text{revise})| < \tau \implies \text{uncertain}$$
Quickstart
Installation
pip install ockev
# For Apple Silicon (Metal acceleration via MLX)
pip install "ockev[mlx]"
CLI Usage
Verify any markdown file, commit message, or PR text before publishing:
# Check a deliverable file
ockev check path/to/PULL_REQUEST.md
# Check raw text directly
ockev check --text "Tomato scrambled eggs (does not contain pork or beef)."
Output:
=== Ockev Deliverable Gate Review ===
Verdict: REVISE
Confidence: 0.96
Latency: 34.2 ms
Probabilities: {'pass': 0.021, 'revise': 0.979}
[FAIL] Deliverable contains conversational clutter, negative echoes, or discarded options.
Python API
from ockev import OckevGate
gate = OckevGate()
result = gate.review_deliverable(
candidate_text="Added support for PostgreSQL 16. Verified migration scripts against test db.",
task_context="Database upgrade PR"
)
print(result)
# {'verdict': 'pass', 'confidence': 0.94, 'probabilities': {'pass': 0.97, 'revise': 0.03}, 'latency_ms': 32.1}
Apple Silicon MLX Native Engine
Run directly on Apple Silicon M-series chips with zero CUDA or PyTorch overhead:
from ockev.mlx_engine import MLXOckevEngine
engine = MLXOckevEngine("Qwen/Qwen2.5-1.5B")
res = engine.evaluate(state="...", question_spec={...})
print(f"MLX Latency: {res['latency_ms']} ms")
Agent Integration
Ockev includes an out-of-the-box Agent Skill for Pi and Codex agents:
# ~/.codex/skills/final-state-review/SKILL.md
Produce content that stands on its own for the next reader or agent.
Ship the result, not the conversation.
When activated, the agent automatically runs ockev check before finalizing code, documentation, or PR handoffs.
License
Distributed under the Apache 2.0 License.
Metadata
Release files for ockev 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ockev-0.1.0.tar.gz | 14.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ockev-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 28.0 kB
Release files / ockev-0.1.0.tar.gz
| Download URL | ockev-0.1.0.tar.gz |
|---|---|
| Size | 14.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d080c02d745daf22610043f76a086c8c24a5560184ff6429868adace05c177e3
|
|
BLAKE2b-256 checksum How to use checksums |
214128f7184d72508bcfe7f525821dc05c32d7be28516c1c334e124f29f6cef7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.13
|
Release files / ockev-0.1.0-py3-none-any.whl
| Download URL | ockev-0.1.0-py3-none-any.whl |
|---|---|
| Size | 13.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ff7e506dd54a223f78271381d5ec13a9217f1168290d9ad47bd723725bbc7b7b
|
|
BLAKE2b-256 checksum How to use checksums |
9331ad34c1493259a87c7878d7fe351a7289c532114b31a0a83eb753067e7197
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.13
|