Skip to main content

Configuration-driven PostgreSQL dimension tables, migrations, and APIs.

Project description

pgcraft

Documentation

Configuration-driven PostgreSQL dimension tables, migrations, and APIs.

pgcraft generates SQLAlchemy models, Alembic migrations, and PostgREST API views from declarative dimension configurations. Define your schema once; pgcraft handles the rest.


Features

  • Dimension types — Simple, Append-Only (SCD Type 2), and Entity-Attribute-Value, each with generated backing tables, views, and triggers.
  • Plugin architecture — Composable plugins with @requires / @produces decorators, executed in topological order.
  • Automatic migrations — Alembic integration with SQL-formatted migration scripts via sqlglot.
  • PostgREST API layer — API views, roles, and grants declared alongside your models.
  • Postgres is king — Logic lives in the database (views, triggers, check constraints). Python orchestrates; Postgres enforces.

Quick start

Install

pip install pgcraft            # or: uv add pgcraft

Define a dimension

from sqlalchemy import Column, MetaData, String
from pgcraft.factory.dimension import SimpleDimensionResourceFactory

metadata = MetaData()

SimpleDimensionResourceFactory(
    tablename="users",
    schemaname="public",
    metadata=metadata,
    schema_items=[
        Column("name", String, nullable=False),
        Column("email", String),
    ],
)

This creates:

  • A public.users table with id, name, and email columns.
  • An api.users view exposing the same columns for PostgREST.
  • Alembic migration support out of the box.

Generate migrations

pgcraft migrate revision --autogenerate -m "add users"
pgcraft migrate upgrade head

Dimension types

pgcraft ships with three built-in dimension types:

Type Use case History?
Simple Static reference data No
Append-Only (SCD Type 2) Track changes over time Yes
EAV Flexible / sparse attributes with full audit trail Yes

See the dimensions documentation for ERD diagrams, schema details, and worked examples.

Documentation

Full documentation is available at roddarjohn.github.io/pgcraft.

Development

# Clone and install
git clone https://github.com/<username>/pgcraft.git
cd pgcraft
uv sync --all-groups

# Run checks
just lint          # ruff check + format
just type-check    # ty check src/
just dev-test      # pytest (fast, needs DATABASE_URL)
just test          # tox (full isolation)
just docs          # build Sphinx HTML docs

Tests require a running PostgreSQL instance:

DATABASE_URL=postgresql+psycopg:///pgcraft just dev-test

Design philosophy

See PLAN.md for the full design philosophy. The short version:

  • Postgres is king. Push logic into the database when it is obviously correct and declarative.
  • Explicit over implicit. No magic — if behavior is not obvious from reading the code, it needs a docstring explaining why.
  • Simple over clever. Three similar lines are better than a premature abstraction.

License

See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgcraft-0.1.2.tar.gz (34.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgcraft-0.1.2-py3-none-any.whl (53.1 kB view details)

Uploaded Python 3

File details

Details for the file pgcraft-0.1.2.tar.gz.

File metadata

  • Download URL: pgcraft-0.1.2.tar.gz
  • Upload date:
  • Size: 34.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgcraft-0.1.2.tar.gz
Algorithm Hash digest
SHA256 9146049d17788353fe7c719bad65a18216b39a84de110c316d29aecb25fc9560
MD5 bc295e48981d79c6baa12872c658d441
BLAKE2b-256 be2fe5d1392b44bbf3f839cb4bf79ee668fb37d8e3c3df067069f362b3d11f9c

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgcraft-0.1.2.tar.gz:

Publisher: publish.yml on roddarjohn/pgcraft

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pgcraft-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: pgcraft-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 53.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgcraft-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 dd51e698ddaa6cd62bbbd69ac9ece0f4e60241396b57e0cf7a3ecc6113f7e020
MD5 70f4e65f560e698d97e9e73dc6687b6d
BLAKE2b-256 9adc834aa11a7047759e16d574afc6d85b870761baafb614c23c11ece7031cd8

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgcraft-0.1.2-py3-none-any.whl:

Publisher: publish.yml on roddarjohn/pgcraft

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page