Deterministic Python research engine for prediction-market evidence-backed backtests
Project description
batter
Built for Pancake — receipts at https://usepancake.com/r/<receipt-id> use this engine to verify strategy math.
batter is a deterministic Python research engine for prediction-market evidence-backed backtests. Given a backtest spec and an EvidenceDataset, it produces a canonical result_hash — identical bytes across ubuntu / macos / windows on Python 3.12+ — enabling reproducible research and auditability of strategy claims. Engine 0.4 adds Monte Carlo bootstrap confidence intervals and a sign-permutation Sharpe test so credibility signals travel with every result.
The PyPI package is batter; the Python module is pancake_engine (sklearn-style rename: pip install batter then import pancake_engine).
What is this for?
Pancake is a prediction-market research platform. batter is the math layer, extracted as a standalone package so the formulas can be verified independently of the platform.
When a strategy backtest runs on Pancake, it runs through batter. The platform stores the result_hash; anyone can reproduce that hash locally by running the same spec and dataset through pip install batter. This is the platform connection: batter has origin in Pancake but is genuinely independently usable by anyone doing prediction-market research.
Install
pip install batter
Quickstart
import json
from pancake_engine import run_backtest, BacktestSpec, EvidenceDataset, BacktestConfig
spec = BacktestSpec(**json.load(open("spec.json")))
dataset = EvidenceDataset(**json.load(open("dataset.json")))
config = BacktestConfig()
result = run_backtest(spec, dataset, config)
print(result.result_hash) # deterministic SHA-256 over canonical JSON
print(result.metrics.sharpe)
print(result.bootstrap_ci) # 95% CI on cagr / sharpe / sortino (0.4+)
Determinism
The same (spec, dataset, config) produces the same result_hash across ubuntu / macos / windows on Python 3.12+. Verification method, fixture set, and numeric bounds are documented in docs/math-audit-0.4.md §"Verification verdict".
Supported Python versions: 3.12 and 3.13. Python 3.11 is permanently out of scope — sum() semantics changed in 3.12 (compensated float accumulation), causing the bootstrap CI values to differ by 1 ULP and producing a different result_hash. No code change can reconcile this without reverse-engineering 3.12's exact internal accumulation path. See docs/py311-investigation-2026-05-27.md for the full root-cause analysis and docs/math-audit-0.4.md §"Known scope qualifier — Python 3.11" for the audit entry.
Cross-platform
CI enforces a 6-cell matrix (ubuntu-latest + macos-latest + windows-latest) × (Python 3.12 + 3.13). See the badge above.
Cite batter
If you use batter in academic or independent research, please cite:
@software{mustopo2026batter,
author = {Mustopo, Michael},
title = {batter: Deterministic Python research engine for
prediction-market evidence-backed backtests},
year = {2026},
version = {0.6.0},
url = {https://usepancake.com/engine},
repository = {https://github.com/usepancake/batter},
license = {Apache-2.0},
note = {The math layer of usepancake.com. Produces canonical
SHA-256 result hashes reproducible across Ubuntu,
macOS, and Windows on Python 3.12+.}
}
Verify any receipt
No trusted party required. Given a self-contained bundle (spec + inline dataset + expected hash), batter verify re-runs the engine locally and checks that the computed result_hash matches the declared one. Anyone can audit a Pancake receipt independently.
pip install batter
# local bundle file
batter verify --bundle receipt-bundle.json
# or fetch from a URL directly
batter verify --url https://usepancake.com/r/<receipt-id>/bundle.json
Exit codes: 0 verified · 1 hash or dataset integrity mismatch · 2 input/validation error · 3 unverifiable (pointer dataset — rows not inline, license-gated)
JSON output (stdout):
{
"verified": true,
"expected": "<sha256>",
"computed": "<sha256>",
"engine_version": "0.8.1",
"num_trades": 42
}
Bundle shapes accepted:
- regen-style (what
examples/*/regen.pyproduces):{spec, dataset, config?, expected_result_hash: "<sha256>"} - fixture-style:
{spec, dataset, config?, expected: {result_hash: "<sha256>", ...}}
The dataset must carry storage_mode: "inline" with rows present. Pointer datasets (rows held under license) print a clear message and exit 3.
batter verify also checks dataset integrity first: it recomputes rows_sha256 and schema_sha256 over the bundle's actual bytes and compares them to the declared values. A tampered bundle is caught before the engine even runs.
If the bundle declares an engine_version that differs from the installed version, a warning is printed — result_hash values are only comparable under the same ENGINE_VERSION.
License
Apache-2.0 — Copyright 2026 Michael Mustopo
See also
- usepancake.com — the prediction-market research platform
- usepancake.com/engine — batter's platform page (methodology, JSON-LD, citation)
- usepancake.com/methodology — platform methodology
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file batter-0.9.0.tar.gz.
File metadata
- Download URL: batter-0.9.0.tar.gz
- Upload date:
- Size: 319.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a6c1a07345936754cefcab20f3f47987ebd4a5e1cf414cd5dc43209c04ee9e86
|
|
| MD5 |
7596da6710ef6691839d5d07132a5568
|
|
| BLAKE2b-256 |
ac4a13bc490b6771fb0fb370dea0bd49d35ac1df8447e55f8ce7a26bc0066735
|
Provenance
The following attestation bundles were made for batter-0.9.0.tar.gz:
Publisher:
publish.yml on usepancake/batter
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
batter-0.9.0.tar.gz -
Subject digest:
a6c1a07345936754cefcab20f3f47987ebd4a5e1cf414cd5dc43209c04ee9e86 - Sigstore transparency entry: 1778420826
- Sigstore integration time:
-
Permalink:
usepancake/batter@665d03945e9ace1e63fef1cfc65ce824a6ef7ec3 -
Branch / Tag:
refs/tags/0.9.0 - Owner: https://github.com/usepancake
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@665d03945e9ace1e63fef1cfc65ce824a6ef7ec3 -
Trigger Event:
release
-
Statement type:
File details
Details for the file batter-0.9.0-py3-none-any.whl.
File metadata
- Download URL: batter-0.9.0-py3-none-any.whl
- Upload date:
- Size: 139.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
29899f9f7bf6db2ac568d66cc147cda78436a05c2935b1823c9644352dbefbc3
|
|
| MD5 |
0b9acec8bbe5db58652ab0a970c8f7a2
|
|
| BLAKE2b-256 |
dbb436fdc7b20ef1873e23ae92cee443dfd8039de2b03803a2d3e07043fe0363
|
Provenance
The following attestation bundles were made for batter-0.9.0-py3-none-any.whl:
Publisher:
publish.yml on usepancake/batter
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
batter-0.9.0-py3-none-any.whl -
Subject digest:
29899f9f7bf6db2ac568d66cc147cda78436a05c2935b1823c9644352dbefbc3 - Sigstore transparency entry: 1778421195
- Sigstore integration time:
-
Permalink:
usepancake/batter@665d03945e9ace1e63fef1cfc65ce824a6ef7ec3 -
Branch / Tag:
refs/tags/0.9.0 - Owner: https://github.com/usepancake
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@665d03945e9ace1e63fef1cfc65ce824a6ef7ec3 -
Trigger Event:
release
-
Statement type: