Skip to main content

miras

میراث — inheritance, heritage. The same word in Persian, Turkish and Azerbaijani (miras). Cultural inheritance is what this package models.

Know whether your study can recover conformity and migration, before you collect data.

miras simulates cultural evolution with agent-based models, and then asks the question that decides whether a study is worth running: given this design, can the parameters of the process actually be recovered from the data? It simulates the study many times from known parameters, infers them back, and reports what the design cannot distinguish.

pip install miras

Python 3.10+. Apache 2.0. One required dependency: numpy.


Built on the Cultural Evolution Workflow

miras exists because of

Deffner, D., Fedorova, N., Andrews, J. & McElreath, R. (2024). Bridging theory and data: A computational workflow for cultural evolution. Proceedings of the National Academy of Sciences 121(48), e2322887121. https://doi.org/10.1073/pnas.2322887121 · code

The paper argues for a workflow: build a generative model of the process, simulate data from it, and check that your analysis recovers what you put in before collecting real data. Its agent-based model, its three worked examples, its Stan model and its migration data are all part of miras (miras paper ...). What miras adds is the step the paper does by hand, once per design, turned into a tool you can run on any design.

If you use miras, please cite the paper. The original code is CC0; see NOTICE for the full attribution.


The failure that matters

The paper contains its own motivating example. In its ABC analysis, cultural F_ST is the only summary statistic. For a population simulated with unbiased copying (θ = 1) and migration m = 0.3, the published run put 66% of the posterior mass on θ = 0.5, m = 0.2. Weaker conformity plus less migration produces the same between-group diversity as the truth.

That is equifinality: different processes, indistinguishable data. It is the problem cultural evolution keeps rediscovering (neutral drift or weak conformity from frequency data; conformity or migration from F_ST), and it is invisible from inside a single analysis. The posterior looks like a posterior. Nothing in the output says the design could never have told the two apart.


The thirty-second version

import miras
from miras import Model, Islands, WrightFisher, Conformity, CrossSectional, ModelSimulator, Uniform

model = Model(structure=Islands(n_groups=20, group_size=50), demography=WrightFisher(),
              learning=Conformity(), innovation=0.05, n_models=20)

study = ModelSimulator(model, summaries=["fst"], n_steps=150,
                       design=CrossSectional(n_per_group=30))      # 30 respondents per village

report = miras.identify(study, {"learning.theta": Uniform(0.5, 3.0),
                                "migration":      Uniform(0.0, 0.4)})
print(report.summary())

Run as-is (several minutes: 2,000 simulated studies on one core), this prints

parameter                contraction  90% coverage  bias (sd)
learning.theta                  0.82          0.86      +0.04
migration                       0.39          0.86      +0.01

[warning] NOT_IDENTIFIED migration (where 1.46 < learning.theta < 2.2)

Exact numbers vary slightly between machines; the finding does not.

On a 20-village population with a uniform prior on the conformity exponent θ ∈ [0.5, 3] and the migration rate m ∈ [0, 0.4] (examples/equifinality.py, 2,000 simulated studies, 150 test datasets):

=== F_ST only (as in the paper) ===
parameter                contraction  90% coverage  bias (sd)
learning.theta                  0.80          0.89      +0.06
migration                       0.36          0.91      +0.09

[warning] NOT_IDENTIFIED migration (where 1.34 < learning.theta < 2.19)
    The posterior for migration is close to its prior (contraction 0.18 in this
    region): these summaries carry little information about it ...

=== F_ST + within-group diversity ===
learning.theta                  0.83          0.91      +0.03
migration                       0.60          0.91      +0.04

No findings.

=== F_ST + majority share + variants per group ===
learning.theta                  0.83          0.89      +0.03
migration                       0.41          0.90      +0.06

No findings.
Only partly constrained (contraction < 0.5): migration.

Three things this says that no single analysis would:

  1. F_ST recovers conformity well but migration badly, and only in part of parameter space. Under moderate conformity, between-group differences are maintained by conformity whatever the migration rate, so F_ST says almost nothing about migration there. Averaged over the whole prior the problem is diluted (contraction 0.36); the regional check finds where it lives.
  2. The fix is a specific measurement, not "more data". Adding within-group diversity, which a survey collects at no extra cost, removes the finding and raises migration's contraction from 0.36 to 0.60.
  3. Not every extra summary helps. Majority share and the number of variants per group leave migration only partly constrained (0.41).

Where the paper's trade-off appears. I built this example expecting F_ST alone to produce an EQUIFINALITY finding between θ and m, as in the paper's motivating case. With 20 villages of 50 it does not: the posterior for a conformist truth runs diagonally (more conformity plus more migration looks alike), but too diffusely to count as a ridge. With smaller villages it does. miras demo (10 villages of 40, 25 respondents each, 600 simulated studies):

=== F_ST only ===
learning.theta                  0.68          0.88      +0.06
migration                       0.48          0.85      +0.17
[warning] EQUIFINALITY learning.theta, migration (where learning.theta > 1.32)
    ... raising learning.theta can be offset by raising migration ...

=== F_ST + within-group diversity ===
learning.theta                  0.76          0.78      +0.11
migration                       0.65          0.75      +0.19
[warning] EQUIFINALITY learning.theta, migration (where learning.theta > 2.03)

Within-group diversity shrinks the equifinal region to strong conformity but does not remove it. The demo is deliberately small, and its 90% intervals cover the truth only 75–88% of the time; treat its numbers as indicative and rerun with a larger --n-reference before relying on them.

The same question gave a different kind of answer for two population sizes. That is the point of running the check rather than reasoning about it: which failure a design has depends on the model, the prior and the design together. The paper's own case used yet another model (age-structured, with a discrete four-point prior on θ).


Findings

Finding Question it answers
EQUIFINALITY Do two parameters trade off against each other, so the data pin down a combination but not each one? Which direction is the trade-off?
NOT_IDENTIFIED Is the posterior for this parameter just the prior coming back, with no information even jointly with others?

Each finding is checked across the whole prior and within regions (thirds of each parameter's range). A finding confined to a region carries a where, e.g. where 1.34 < learning.theta < 2.19: problems that exist only in part of parameter space are otherwise averaged away.

Alongside the findings, every report gives each parameter's contraction (1 − posterior variance / prior variance: 0 means the data taught nothing, 1 means the parameter is pinned down), the coverage of 90% intervals (should be near 0.90; far below means the inference itself is miscalibrated), and the bias.

How it decides

For each pseudo-observed dataset the posterior is examined on each prior's working scale, standardised by the prior SD. A pair of parameters is equifinal in that dataset when their joint posterior is a ridge: much narrower in one direction than the other, well constrained across the ridge, with the ridge running diagonally (it mixes both parameters), and with the pair jointly learned clearly better than either parameter alone. The finding is raised when that holds in at least 30% of test datasets.

Why not just flag a strong posterior correlation? Because two parameters can be correlated and both well identified; flagging that would make the tool fire on good designs. The test suite pins this case (correlated identified must stay quiet).

Why the naive version doesn't work

  1. Marginal posteriors hide equifinality. Under a product confound each parameter's marginal posterior is only moderately narrow, which reads as "somewhat identified". The information is in the joint.
  2. Equifinality is not the same as no information. A parameter in an equifinal pair can have low marginal contraction; reporting it as NOT_IDENTIFIED would send you looking for a missing summary rather than a missing contrast. miras reports one or the other, never both.
  3. A single test dataset is an anecdote. Ridges bend: whether θ and m trade off can depend on where in parameter space the truth lies. miras evaluates many truths, reports how often the ridge appears, and where in parameter space.

Comparing designs costs no extra simulations

Build one reference table with every summary you might measure, then evaluate designs by selecting columns:

table = miras.ReferenceTable.build(study_with_all_summaries, priors, 2000, cores=8)

for summaries in (["fst"], ["fst", "within_diversity"], ["fst", "majority_share", "n_variants"]):
    print(miras.identify(study, priors, table=table.select(summaries)).summary())

examples/equifinality.py does exactly this; miras demo is a smaller, faster version (a few minutes on one core).


The engine

Component Options
structure Islands(n_groups, group_size, size_grid, r_dist): villages on a grid; migrants choose destinations by distance; group sizes conserved
demography AgeStructured(r_mort, max_age, r_learn, ...) as in the paper; WrightFisher() for non-overlapping generations
learning Neutral(), Conformity(theta), PayoffBias(payoffs, strength) for frequency-dependent games, Mixture(rules, weights)
migration scalar, or age-specific (e.g. the Dutch rates in miras.paper._data)
variants infinite alleles (every innovation is new) or a finite set
res = model.set({"learning.theta": 2.0, "migration": 0.1}).simulate(300, seed=1,
                                                                    record=["fst", "n_variants"])
res.series["fst"]

Checked against things that do not depend on it

Prediction (miras.theory) Agreement
F_ST of the neutral island model, from an identity-by-state recursion within 1% in three regimes (tested to 6%)
Homozygosity of a neutral Wright-Fisher population within 1% (tested to 5%)
Number of variants, Ewens sampling formula within 6% (diffusion approximation; tested to 10%)
Payoff-biased imitation vs. the replicator equation (Hawk-Dove) max deviation 0.004 over 60 steps
Hawk-Dove mixed equilibrium p* = V/C within 0.02
Coordination game fixates on the side of its unstable point yes, both sides
Conformity exponent orders within-group diversity θ = 0.8 > 1 > 2

PayoffBias is the bridge to evolutionary game theory: in a large population proportional imitation follows the replicator dynamics exactly in expectation, which is what the test checks.


Inference backends

Backend Use
ReferenceTable Rejection ABC with local-linear regression adjustment (Beaumont et al. 2002). Amortised: one set of simulations serves every query. Default for identify.
ABCSMC Sequential Monte Carlo ABC with adaptive tolerances (Beaumont et al. 2009). Sharper posteriors for a single dataset. identify(..., method="smc").
Stan Via CmdStanPy, for likelihood-based models such as the paper's longitudinal model. analyze() accepts posteriors from any backend.

For a model outside miras, wrap any function: miras.FunctionSimulator(fn) with fn(params: dict, rng) -> summaries.


The paper's three workflows

miras paper dags             # synthetic data from a DAG, power analysis, causal effect
miras paper abm              # migration x conformity sweep, Fig. 3
miras paper longitudinal     # longitudinal Stan model and causal effects, Fig. 4
miras paper longitudinal --identify 9   # new: can the longitudinal design recover mu and theta?
miras paper abc              # the paper's ABC analysis, Fig. 5

--identify uses Stan as the inference backend: it simulates longitudinal datasets at known (μ, θ), fits the paper's model to each and hands the posteriors to miras.analyze. With --quick the posteriors look sharp (contraction 0.98–0.99 in the test suite's two datasets), but those tiny fits do not pass the convergence check (R-hat about 1.45), so they show that the pipeline runs, not that the design works. The full-size run is the real test.

Every workflow has --quick for a smoke test, --cores, --seed, --outdir and --track. The Stan-based ones (dags, longitudinal) need CmdStan; see Installing CmdStan.

The full analyses are as heavy as the originals. Measured on an 8-core Apple Silicon Mac (miras 0.1.0, Python 3.11, CmdStan 2.40):

Command Time Output
miras paper dags under a minute (plus ~5 s to compile the Stan model once) DAGstoData_Plots/
miras paper abm 7.4 h (46,200 simulations) output/Abstract_ABM.pdf, output/abm_results.npz
miras paper longitudinal about 1 h 45 min, almost all of it the Stan fit output/TimeSeries.pdf
miras paper longitudinal --identify 9 roughly 2 h per dataset, so most of a day output/longitudinal_identifiability.md
miras paper abc 17.6 h (2 × 100,000 simulations) output/abc_result.png

Intermediate results are cached, so figures can be redrawn without rerunning: miras paper abm --plot-only, miras paper longitudinal --reuse, miras paper abc --reuse.

The two longest runs survive interruption. miras paper abm and miras paper abc save a checkpoint every two minutes and on Ctrl-C; running the same command again resumes where it stopped (--fresh starts over). A resumed run gives exactly the same numbers as an uninterrupted one, because every simulation's seed is fixed by its position in the job list; this is tested. A checkpoint is only resumed with identical settings and the same miras version. Progress lines show an estimate of the time left.

What the full-scale runs show

These are from the end-to-end check of 0.1.0 (the simulations are unchanged in 0.1.1).

  • DAGs: the estimated causal effect of M on D is 1.87 (90% interval about −0.6 to 4.3; true value 2). The same seed gives the same estimate on macOS and Linux.
  • ABM (Fig. 3): the qualitative result of the paper. Conformity maintains between-group differences, migration erodes them, and the causal effect of raising migration from 0.1 to 0.2 is largest under weak conformity (θ = 1.4).
  • ABC (Fig. 5): for the unbiased population (truth θ = 1, m = 0.3), 94% of the accepted simulations sit on the true cell; the paper's published run put 66% on a wrong one. For the conformist population (truth θ = 2, m = 0.1) all 1,000 accepted simulations sit on θ = 3, m = 0.2: more conformity plus more migration reproduces the observed F_ST. That is the trade-off miras demo flags as EQUIFINALITY for strong conformity. Two cautions: this is one reference dataset, and "100%" is an artefact of rejection on a discrete grid, not certainty (re-simulating from that cell gives F_ST centred at 0.587, below the reference 0.605).
  • Longitudinal (Fig. 4): the fit did not converge; see below.

ABC contrasts (panels c and f). The original code computes the effect of ±10 points of migration around fixed cells (m = 0.2 for the unbiased case, m = 0.1 for the conformist case), which are where the paper's own posterior landed. When a posterior lands elsewhere, as the conformist one did above, those contrasts are taken around the wrong place. From 0.1.1 the contrasts are centred on the posterior's most common migration value, and each panel says which (around m = ...); a direction that would leave the prior range is omitted. --paper-contrasts restores the original scheme.

Convergence of the longitudinal fit

In the 0.1.0 end-to-end check the Stan fit reported max R-hat = 1.619, divergent transitions = 1500. 1,500 is exactly the number of post-warm-up draws in one chain: one of the four chains got stuck in a region with θ ≈ 0.3 and diverged on every iteration, while the other three recovered the truth (μ ≈ 0.10, θ ≈ 3). The pooled posterior mean (θ = 2.39) and panels b–d of TimeSeries.pdf mixed in the stuck chain: a second mode in μ, a spike near θ = 0.3 and a jagged age-migration band. miras 0.1.0 printed the numbers but did not warn.

From 0.1.1 every Stan fit (in dags and longitudinal) is checked. A fit counts as converged only with every R-hat ≤ 1.01 and no divergent transitions. Otherwise miras prints a per-chain table that names the suspect chains, for example

WARNING: the Stan fit did NOT converge; do not use its posterior as is.
  max R-hat = 1.620, divergent transitions = 1500  (need R-hat <= 1.01 and 0 divergences)
  chain  divergences     log_theta      logit_mu
      1            0         1.100        -2.200
      2            0         1.098        -2.198
      3         1500        -1.200        -2.410   <- suspect
      4            0         1.100        -2.201
  - chain 3 diverged on 1500 of 1500 iterations (it is stuck, not sampling)

The figure is still drawn, with "Stan fit did NOT converge" across the top, and the diagnostics are saved to output/convergence-seed-<seed>.json. A cached fit loaded with --reuse is checked too. With --identify, fits that do not converge are left out of the report and listed in its notes (--keep-unconverged keeps them).

What to do about a stuck chain:

miras paper longitudinal --refit --seed 2                    # same data, new chain seeds
miras paper longitudinal --refit --seed 2 --init-radius 0.5  # also start chains closer together

--refit keeps the cached simulated data and redoes the Stan fit and the posterior simulations. --init-radius R starts the chains uniformly in (−R, R) on Stan's unconstrained scale instead of Stan's default (−2, 2). Whether it prevents this particular failure has not been shown yet, so it is an option rather than the default. Each fit now writes its CSV files to its own folder, output/stan_output/seed-<seed>/, so refits never mix with earlier ones.

Whether the original R/rstan fit is equally prone to this has not been checked.

These are ports of the original R code, and in porting it a few bugs were fixed rather than reproduced. Each is marked with a NOTE comment:

  1. Power analysis: the R loop fitted data[[i]] (the sweep index) instead of data[[j]] (the replicate), so all 200 replicates were one dataset.
  2. Longitudinal data: the first recorded year's group was never filled in, so every participant's first analysed year was coded as a migration, inflating the estimated migration rates.
  3. Ageing: in R, Age[idx[-babies]] selects nobody when a group has no deaths, so nobody in that group ages that year. AgeStructured(legacy_aging=True) (or --legacy-aging) reproduces the original.
  4. Smaller: swapped axis labels on the power heat map, a one-year shift of the reference curve in Fig. 4c, undefined object names in the ABC plotting code, hard-coded plot annotations from one particular run.

The Stan model's array syntax was updated for Stan ≥ 2.33 (the original no longer compiles); the model is unchanged.


Provenance

An identifiability report is an experiment: it depends on seeds, priors, summaries and library versions. With daftar installed:

report = miras.identify(study, priors, track=True, label="fst-only-design")

records the priors, summaries, miras version and environment, and the contraction of every parameter, so two reports can be compared with daftar diff rather than eyeballed. The paper workflows take --track. Without daftar this is a no-op with a warning, never an error.


Optional extras

pip install "miras[plot]"         # matplotlib: report.plot(), figures
pip install "miras[stan]"         # cmdstanpy; then install CmdStan itself (below)
pip install "miras[provenance]"   # daftar
pip install "miras[paper]"        # everything the paper workflows need
pip install "miras[all]"

miras doctor shows which of these work in the current environment.

Installing CmdStan

miras[stan] installs cmdstanpy, the Python interface. The Stan compiler itself (CmdStan) is a separate one-time install that downloads and builds it (a few minutes):

install_cmdstan
miras doctor          # CmdStan should now show "ok"

On macOS you need Apple's command-line tools first (xcode-select --install).

If the download fails with SSL: CERTIFICATE_VERIFY_FAILED, your Python does not use the system's certificates (common with the python.org installer on macOS). Either run the certificate installer that came with Python, once:

open "/Applications/Python 3.11/Install Certificates.command"

or point Python at certifi's bundle for the current terminal session:

export SSL_CERT_FILE="$(python -m certifi)"
install_cmdstan

python -m cmdstanpy.install_cmdstan also works but prints a harmless RuntimeWarning; the install_cmdstan command does the same without it. Compiled models are cached in ~/.cache/miras (override with MIRAS_CACHE), so the first run of each Stan workflow spends a few extra seconds compiling.


Tests

pip install -e ".[dev]"        # or: pip install "miras[all]" pytest
pytest -q                      # engine vs. theory, detectors vs. ground truth
pytest -q --run-slow           # also fits Stan models (needs CmdStan)

Expected: 91 passed, 1 skipped (the skip is the slow Stan test). The core install (numpy only) also works: tests that need matplotlib, pandas or daftar skip themselves.

The detector tests are the ones that matter. Toy simulators with known identifiability (a product, sum or ratio of two parameters; an irrelevant parameter; identified, weakly identified and strongly correlated cases) score each detector in both directions: it must fire where the confound exists and stay quiet where it does not. See TESTING.md.


Status

Research prototype, honestly labelled.

  • The thresholds that turn posterior geometry into findings are calibrated on toy problems with known answers, not yet on a broad set of real designs.
  • Rejection ABC widens posteriors; a parameter can look less identified than it is when the reference table is small. Coverage is reported so you can see when that happens; more simulations or method="smc" sharpen it.
  • Equifinality is detected between pairs of parameters; three-way trade-offs are on the roadmap.
  • Stan fits are checked for convergence and failures are reported loudly (since 0.1.1), but not fixed: the paper's longitudinal model can get a chain stuck, and it is not yet known what prevents that reliably (see "Convergence of the longitudinal fit").
  • Not yet done, and what would decide whether this is useful: applying it to published cultural-evolution study designs and checking its verdicts against what those studies could and could not conclude.

See ROADMAP.md.

Licence

Apache 2.0. Portions derived from the CC0-licensed Cultural Evolution Workflow (Deffner et al. 2024); see NOTICE.

Metadata

Release files for miras 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for miras 0.1.1
File Size Uploaded Provenance Actions
miras-0.1.1.tar.gz 99.7 kB Without provenance Details for miras-0.1.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for miras 0.1.1
File Interpreter ABI Platform Actions
miras-0.1.1-py3-none-any.whl Python 3 none any Details for miras-0.1.1-py3-none-any.whl

Total release size: 184.5 kB

Release files / miras-0.1.1.tar.gz

Download URL miras-0.1.1.tar.gz
Size 99.7 kB
Tags Source
SHA-256 checksum
How to use checksums
d943c311dfa7b19122fd14c276bdd9d09c8c11ca607f7831565291dbb1dc20c5
BLAKE2b-256 checksum
How to use checksums
69a90395fddc975d7032e594f3f2b00adb517753b7a5043879f7c490a2840ef6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.5

Release files / miras-0.1.1-py3-none-any.whl

Download URL miras-0.1.1-py3-none-any.whl
Size 84.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c39e62ac8066358214100690f0ba664f85010f874fc479404135f5371b66c8e2
BLAKE2b-256 checksum
How to use checksums
677c8185dd1b8b2fc92d189a314ccd85966ac280c91d046c952875c7dfac55e8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.5

Security for miras 0.1.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page