emic 0.2.0

Epsilon Machine Inference & Characterization - A framework for computational mechanics

emic

Epsilon Machine Inference & Characterization

A Python framework for constructing and analyzing epsilon-machines based on computational mechanics.

📚 Documentation | 🚀 Getting Started

What is an Epsilon-Machine?

An epsilon-machine (ε-machine) is the minimal, optimal predictor of a stochastic process. Introduced by James Crutchfield and collaborators, ε-machines capture the intrinsic computational structure hidden in sequential data.

Key concepts:

• Causal states: Equivalence classes of histories that yield identical predictions
• Statistical complexity (Cμ): The entropy of the causal state distribution — a measure of structural complexity
• Entropy rate (hμ): The irreducible randomness in the process

ε-machines reveal the emic structure of a process — the computational organization that exists within the system itself, not imposed from outside.

Features

• 🔮 Inference: Reconstruct ε-machines from observed sequences using the CSSR algorithm
• 📊 Analysis: Compute complexity measures (Cμ, hμ, excess entropy)
• 🎲 Sources: Built-in stochastic process generators (Golden Mean, Even Process, Biased Coin, Periodic)
• 🔗 Pipeline: Composable >> operator for source → inference → analysis workflows
• 📈 Visualization: State diagram rendering with Graphviz
• 📝 LaTeX Export: Publication-ready tables and machine descriptions
• 🧩 Extensible: Protocol-based architecture for custom algorithms and sources

Installation

pip install emic

Or install from source with uv:

git clone https://github.com/johnazariah/emic.git
cd emic
uv sync --dev

Quick Start

from emic.sources import GoldenMeanSource
from emic.inference import CSSR, CSSRConfig
from emic.analysis import analyze

# Generate data from the Golden Mean process (no consecutive 1s)
source = GoldenMeanSource(p=0.5, seed=42)

# Infer the epsilon-machine using CSSR
config = CSSRConfig(max_history=5, significance=0.001)
result = CSSR(config).infer(source.take(10_000))

# Analyze the inferred machine
summary = analyze(result.machine)
print(f"States: {len(result.machine.states)}")
print(f"Statistical Complexity: Cμ = {summary.statistical_complexity:.4f}")
print(f"Entropy Rate: hμ = {summary.entropy_rate:.4f}")

Pipeline Composition

Chain operations using the >> operator:

from emic.sources import GoldenMeanSource
from emic.inference import CSSR, CSSRConfig
from emic.analysis import Analyzer

# Compose a full pipeline
result = (
    GoldenMeanSource(p=0.5, seed=42)
    >> CSSR(CSSRConfig(max_history=5, significance=0.001))
    >> Analyzer()
)

print(result.summary)

Supported Processes

Process	Description	True States
Golden Mean	No consecutive 1s allowed	2
Even Process	Even number of 1s between 0s	2
Biased Coin	i.i.d. Bernoulli process	1
Periodic	Deterministic repeating pattern	n (period length)

Project Status

✅ Core implementation complete — The framework is functional with:

• CSSR inference algorithm with post-merge state optimization
• Full analysis suite (Cμ, hμ, excess entropy)
• Synthetic and empirical data sources
• Pipeline composition
• 194 tests with 90% coverage

📚 Full documentation available

Etymology

The name emic works on multiple levels:

1. Acronym: Epsilon Machine Inference & Characterization
2. Linguistic: In linguistics/anthropology, emic refers to analysis from within the system — understanding structure on its own terms. This resonates with computational mechanics: ε-machines reveal the intrinsic structure of a process.
3. Phonetic: Pronounced "EE-mik" or "EH-mic" — a nod to "ε-machine"

References

• Crutchfield, J.P. (1994). "The Calculus of Emergence: Computation, Dynamics, and Induction". Physica D.
• Shalizi, C.R. & Crutchfield, J.P. (2001). "Computational Mechanics: Pattern and Prediction, Structure and Simplicity". Journal of Statistical Physics.
• Crutchfield, J.P. & Young, K. (1989). "Inferring Statistical Complexity". Physical Review Letters.

Contributing

Contributions are welcome! See the Contributing Guide for details.

License

MIT License — see LICENSE for details.

Author

John Azariah (@johnazariah)