Eigrel

A programming language for Data, Machine Learning and AI.

Write what you want. Let the compiler decide how to run it.

🇧🇷 Leia em português

Eigrel is a declarative language for data engineering, machine learning and GenAI. You describe datasets, transformations, features and models in one language; the compiler decides whether each step becomes Python, SQL, Spark or something else.

dataset customers from csv("data/customers.csv")

transform customers {
    filter age >= 18
    select age, income, purchases, churned
}

features customers {
    age
    income
    purchases
}

model churn = random_forest {
    trees = 100
}

train churn {
    target = churned
}

evaluate churn {
    metrics = [accuracy, precision, recall, f1]
}

Status

Eigrel is at v0.1 — Language: the lexer, parser and syntax tree are done, and the CLI can check files and print their tokens or AST. Nothing executes yet; the compiler, IR and Python backend come in v0.2. See the roadmap.

Getting started

Install from PyPI (Python 3.13+):

pip install eigrel
eigrel init churn
eigrel check churn/main.eig

From source

Requires uv.

make install                     # creates .venv and installs eigrel in editable mode
.venv/bin/eigrel init churn      # creates churn/main.eig
.venv/bin/eigrel check churn/main.eig

CLI

Errors point at the exact spot:

error: comparisons cannot be chained; combine them with 'and'
 --> pipeline.eig:4:21
  |
4 |     filter age > 18 < 30
  |                     ^

Docker

make docker-build
make docker-run      # runs `eigrel check` on examples/ml.eig inside the container

Language

The full syntax is in docs/LANGUAGE.md. Examples live in examples/.

Project layout

src/eigrel/
├── compiler/
│   ├── tokens.py    token kinds, keywords, source locations
│   ├── lexer.py     source text → tokens
│   ├── ast.py       syntax tree nodes and JSON export
│   ├── parser.py    tokens → syntax tree (recursive descent)
│   └── errors.py    diagnostics with source excerpts
└── cli.py           the `eigrel` command

Development

make test            # pytest
make coverage        # pytest with the 90% coverage gate
make lint            # ruff check + format check
make typecheck       # mypy
make check-examples  # eigrel check examples/*.eig

Commits follow Conventional Commits; releases and the changelog are generated by semantic-release.

License

Licensed under the Apache License 2.0.