Skip to main content

Epi — Epistemic Programming Interface

A type discipline for AI-augmented full-stack applications

License PyPI Python DOI Accepted at SBLP 2026


Research status: v0.3 — active development, structural validation phase.

Authors: Randerson Rebouças (PhD candidate, UFRGS), Dante Barone, and Eliseo Reátegui, PPGIE/UFRGS. The short paper "Epi: An Epistemic Type System for Containing LLM Hallucination in Generated Code" was accepted at SBLP 2026, the 30th Brazilian Symposium on Programming Languages, part of CBSoft 2026.

Accepted paper: paper/Epi-SBLP2026-camera-ready.pdf (camera-ready). This repository is the artifact for that paper; the archived snapshot is at doi.org/10.5281/zenodo.21433256.

What Epi is

Epi is a domain-specific language whose type system makes the epistemic boundary between deterministic computation and AI inference explicit. From a single .epi source, the transpiler generates a complete Next.js project — database schema, API routes, auth middleware, runtime validators, LLM inference calls, and UI components — such that AI-inferred values cannot bypass validation.

The thesis is narrow and honest: LLM hallucination cannot be prevented, but it can be contained at a type-system boundary, by construction, in the generated code.

What problem this solves

In a typical AI-augmented app, validation of LLM outputs, confidence thresholding, fallback handling, and audit trails are all optional — features the developer must remember to add. They get omitted in practice.

Epi makes them structural consequences of the type. A declaration like

risco: AI.Enum(Alto, Medio, Baixo, strict: true, confidence_threshold: 0.85)

necessarily produces:

  1. A database column (deterministic, Prisma).
  2. A Zod schema constraining the LLM output at runtime.
  3. An LLM inference call with confidence reporting.
  4. A checkpoint route that pauses for human review when confidence is below threshold.

You cannot compile an Epi program with an AI field and forget to validate the output. The transpiler emits the contract.

Example

@Language: Epi v0.3
@Goal: "Contract Analysis with Human-in-the-loop"

Entity Contrato {
    id: UUID(auto),
    titulo: Text,
    documento: Text,
    valor: Decimal,
    criado_em: DateTime(auto),
    risco: AI.Enum(Alto, Medio, Baixo, strict: true)
}
//       ▲ Rigid: deterministic    ▲ Epistemic: AI-inferred, validated at the boundary

Guard SomenteAdvogados {
    Condition: Auth.Role == "Lawyer"
}

Pulse ExtrairRisco {
    Input: Contrato
    Protect: Guard.SomenteAdvogados
    Process:
        Execute: AI.scan(
            source: Input.documento,
            prompt: file("@prompts/legal_scan.md"),
            temperature: 0.1,
            on_fail: Fallback.ManualReview(Queue: "Advogados")
        )
    Output: Contrato.risco
}

Pipeline AnalisarContrato {
    Flow: ExtrairRisco -> GerarResumo -> Notificar
    On_Error: Retry(max: 3, backoff: exponential)
}

Lens Dashboard {
    Mood: "Clean, Legal-Tech"            // [experimental]
    Display:
        Table(Contrato, columns: [titulo, valor, risco]),
        Form(Contrato) -> Button("Analisar").trigger(ExtrairRisco)
}

Fewer than 80 lines. The transpiler generates the entire Next.js project — schema, middleware, routes, validators, LLM calls, UI — with the epistemic contract enforced.

When to use Epi

  • Domains where audit-by-construction is required: legal, healthcare, education, government.
  • Apps where AI-inferred values must be persisted and traceable, not just shown.
  • Focused LLM-augmented products, not general-purpose AI platforms.
  • Settings where human-in-the-loop is structural (Trace + Checkpoint maps naturally).
  • Domains with a meaningful prior distribution (Bayesian update genuinely helps).

When NOT to use Epi

  • Conversational chatbots or customer-support assistants.
  • Apps centered on complex RAG, multi-tool agents, or fine-tuning workflows.
  • Teams with a mature in-house AI platform (LangGraph custom, internal orchestration).
  • Pure creative generation (confidence and checkpoint don't apply).
  • Latency-critical paths under 100 ms; Epi is for decision-grade flows.

See docs/LIMITATIONS.md for the full honest list of gaps in v0.3.

Architecture

A three-layer transpiler. The LLM is formally excluded from Layers 1 and 2.

.epi source
   ▼
[Layer 1: Parser]            Lark + EBNF              100% deterministic
   ▼
[Layer 2: Rigid Generator]   Prisma, middleware,      100% deterministic
                             routes, Zod validators
   ▼
[Layer 3: Epistemic Gen.]    LLM calls, Trace,        validated by Layer 2
                             Checkpoint, Lens

See docs/ARCHITECTURE.md for the full breakdown.

Requirements

To run the transpiler:

Version Notes
Python >= 3.11 the Epi CLI and transpiler
pip any recent pip install epi-lang

To build and run a project the transpiler generates:

Version Notes
Node.js + npm >= 20 the emitted project is Next.js
PostgreSQL >= 14 or any DATABASE_URL Prisma accepts
An LLM provider either an Anthropic API key, or Ollama running locally. Neither is needed to validate or transpile, only to execute the generated AI calls.

To reproduce the containment evaluation of the paper (eval/):

Notes
Ollama serving qwen2.5:3b-instruct and llama3.2:1b, about 3.5 GB on disk together
RAM 16 GB is what the reported numbers were measured on

Developed and measured on macOS 15 (Apple Silicon, 16 GB RAM). Nothing in the toolchain is platform-specific, but no other platform has been exercised.

Installation

pip install epi-lang

Or from source, which is also what you need for the example programs and the evaluation harness:

git clone https://github.com/RandMelville/epi-lang.git
cd epi-lang
pip install -e ".[dev]"

Check that it works

The fastest end-to-end check needs no database, no API key and no Node:

epi validate examples/avaliacao-simples.epi
epi transpile examples/avaliacao-simples.epi --outdir ./generated
ls generated

That parses the program of Section 5 of the paper and writes the generated project (13 files, 477 lines) to ./generated. The full test suite:

pytest

Run a generated project

cd generated
npm install
cp .env.example .env
# Set DATABASE_URL, then pick a provider:
#   EPI_AI_PROVIDER=anthropic + ANTHROPIC_API_KEY=sk-ant-...
#   EPI_AI_PROVIDER=ollama    (requires `ollama serve`)
npx prisma migrate dev --name init
npm run dev

Reproduce the paper's evaluation

cd eval
./setup.sh

See eval/README.md for the harness, the 40-item dataset with gold labels, and the raw per-call results behind Table 2.

The five primitives

Primitive What it does Status
Entity Data schema with typed fields, rigid + epistemic stable
Guard Auth & authorization, transpiles to middleware stable
Pulse AI execution unit with temperature, prompt, on_fail stable
Pipeline Composes Pulses with retry/backoff strategy stable
Lens Semantic UI declaration Display / Inject stable; Mood experimental

The epistemic type system

Two domains.

Rigid types — deterministic, no AI involvement:

UUID(auto)   Text   Int   Float   Decimal   Bool   DateTime(auto)   JSON

Epistemic types — AI-inferred, runtime-validated:

AI.Enum(values..., strict, prior, confidence_threshold)
AI.Text(max_tokens)
AI.Classification(labels)
AI.Score(min, max)
AI.Embedding(dimensions)

A single epistemic declaration generates a database column, a Zod validator, an LLM inference call, and optionally a checkpoint route. If it compiles, the runtime contract is enforced.

Trace + Checkpoint (v0.3 highlight)

A Pulse can be decomposed into Trace steps. Each step can Expose: intermediate reasoning fields and pause at a Checkpoint: for human review before the final output is committed.

Pulse AvaliarRespostaAluno {
    Trace CompreenderEnunciado {
        Execute: AI.reason(source: Input.enunciado, prompt: file("@prompts/..."))
        Expose: interpretacao, conceitos_chave, criterios_avaliacao
        Checkpoint: ReviewRequired(role: "Professor")
    }

    Trace AvaliarResposta {
        Execute: AI.classify(
            source: Input.resposta_aluno,
            confidence_threshold: 0.85,
            on_low_confidence: Checkpoint.ReviewRequired(role: "Professor")
        )
    }
}

This generates an in-memory TraceState store, inspect / resume HTTP routes, and an audit trail of every human approval or correction. Designed for high-stakes evaluation flows (pedagogical assessment, legal review, clinical triage).

Documentation

Document Purpose
docs/SPEC.md Formal language specification (English, canonical)
docs/ARCHITECTURE.md Transpiler architecture and design decisions
docs/MANIFESTO.md Why epistemic types matter
docs/LIMITATIONS.md What Epi does NOT do (honest list of gaps)
docs/CONTRIBUTING.md How to contribute
paper/Epi-SBLP2026-camera-ready.pdf The accepted SBLP 2026 paper (camera-ready)
paper/main.tex LaTeX source of the accepted paper
docs/PAPER.md Early internal draft, unpublished and superseded by the paper above, not kept in sync
docs/translations/SPEC-PT.md Portuguese translation (may lag)

Status

Stable in v0.3:

  • EBNF grammar (Lark)
  • AST with epistemic type system (Pydantic)
  • Parser + Lark transformer
  • Deterministic generators: Prisma schema, middleware, routes, Zod validators
  • Epistemic generators: LLM calls, Trace + Checkpoint, Bayesian prior
  • Provider-agnostic LLM client in the generated project: Anthropic, or any OpenAI-compatible endpoint, with Ollama used for local open-weight models. Selected by EPI_AI_PROVIDER at deployment, with no change to the .epi source.
  • CLI: validate, parse, transpile
  • 127 tests passing (pytest)
  • PyPI package (pip install epi-lang)

Experimental — known to be incomplete:

  • Lens.Mood — deterministic keyword-to-Tailwind lookup of 6 hardcoded moods. Not LLM-generated UI; do not rely on it.
  • --target fastapi — blocked in the CLI; current output is inconsistent.

Planned for v0.4:

  • Gemini and a broader provider matrix on top of the existing adapter.
  • epi init for project bootstrap without cloning the repo.
  • FastAPI target completion (or formal removal).
  • Empirical evaluation study (Epi-generated vs hand-written equivalents).
  • SQLite option for quickstart without local Postgres.
System Relationship to Epi
ProbZelus (PLDI 2020) Separates deterministic and probabilistic reactive streams. Epi lifts the separation to application-level types.
SlicStan (POPL 2019) Information-flow types for probabilistic programs. Epi adapts the discipline to AI-augmented full-stack apps.
Russo & Sabelfeld, Dynamic vs. Static Flow-Sensitive Security Analysis (CSF 2010) Information-flow control as type-level separation of security levels — structural analog to Epi's rigid/epistemic separation.
BAML Typed LLM function signatures. Epi extends the idea to whole-application generation.
Wasp Full-stack DSL (React + Node). Epi adds epistemic types and AI-aware code generation.
DSPy (Stanford) Declarative LLM programming via signatures. Orthogonal to Epi — DSPy optimizes prompts, Epi separates type domains.

Citation

@software{reboucas2026epi,
  author  = {Rebouças, Randerson Oliveira Melville and Barone, Dante Augusto Couto and Reátegui, Eliseo},
  title   = {Epi: An Epistemic Type System for Containing LLM Hallucination in Generated Code},
  year    = {2026},
  url     = {https://github.com/RandMelville/epi-lang},
  version = {0.3.2},
  doi     = {10.5281/zenodo.21433256}
}

The paper was accepted at SBLP 2026 (30th Brazilian Symposium on Programming Languages, CBSoft 2026).

Contributing

See docs/CONTRIBUTING.md. Honest critique preferred over wishful documentation.

License

Apache License 2.0 — Copyright (c) 2026 Randerson Rebouças.

Metadata

Release files for epi-lang 0.3.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for epi-lang 0.3.3
File Size Uploaded Provenance Actions
epi_lang-0.3.3.tar.gz 303.0 kB With provenance Details for epi_lang-0.3.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for epi-lang 0.3.3
File Interpreter ABI Platform Actions
epi_lang-0.3.3-py3-none-any.whl Python 3 none any Details for epi_lang-0.3.3-py3-none-any.whl

Total release size: 356.4 kB

Release files / epi_lang-0.3.3.tar.gz

Download URL epi_lang-0.3.3.tar.gz
Size 303.0 kB
Tags Source
SHA-256 checksum
How to use checksums
e032add2eeb6274d6fda471c3bd787d6c44e1463623079734f8a78c90d91a226
BLAKE2b-256 checksum
How to use checksums
9aebb88c2d883dbcac3aee45c455c50773d943fa3efd667e2b3c1733279d9c6e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jul 31, 2026.

Transparency log

Release files / epi_lang-0.3.3-py3-none-any.whl

Download URL epi_lang-0.3.3-py3-none-any.whl
Size 53.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e734962cbf7f67674b2bba871736f98b70727cc1ff76ebd206b412f7f5db15f0
BLAKE2b-256 checksum
How to use checksums
eeb40391f4a4d2fee2d03ac80d84171aa7d19478543a3fb411a27e17b100b794
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jul 31, 2026.

Transparency log

Security for epi-lang 0.3.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for epi_lang-0.3.3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jul 31, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page