Skip to main content

Configuration-driven PostgreSQL framework

Project description

pgcraft

PyPI Documentation

Pre-alpha — pgcraft is under active development. APIs may change between releases. Feedback and contributions are welcome.

Configuration-driven PostgreSQL data schemas, migrations, and APIs.

pgcraft generates SQLAlchemy models, Alembic migrations, and PostgREST API views from declarative dimension configurations. Define your schema once; pgcraft handles the rest.


Features

  • Dimension types — Simple, Append-Only (SCD Type 2), and Entity-Attribute-Value, each with generated backing tables, views, and triggers.
  • Plugin architecture — Composable plugins with @requires / @produces decorators, executed in topological order.
  • Automatic migrations — Alembic integration with SQL-formatted migration scripts via sqlglot.
  • PostgREST API layer — API views, roles, and grants declared alongside your models.
  • Postgres is king — Logic lives in the database (views, triggers, check constraints). Python orchestrates; Postgres enforces.

Quick start

Install

pip install pgcraft            # or: uv add pgcraft

Define a dimension

from sqlalchemy import Column, MetaData, String
from pgcraft.factory.dimension import SimpleDimensionResourceFactory

metadata = MetaData()

SimpleDimensionResourceFactory(
    tablename="users",
    schemaname="public",
    metadata=metadata,
    schema_items=[
        Column("name", String, nullable=False),
        Column("email", String),
    ],
)

This creates:

  • A public.users table with id, name, and email columns.
  • An api.users view exposing the same columns for PostgREST.
  • Alembic migration support out of the box.

Generate migrations

pgcraft migrate revision --autogenerate -m "add users"
pgcraft migrate upgrade head

Dimension types

pgcraft ships with three built-in dimension types:

Type Use case History?
Simple Static reference data No
Append-Only (SCD Type 2) Track changes over time Yes
EAV Flexible / sparse attributes with full audit trail Yes

See the dimensions documentation for ERD diagrams, schema details, and worked examples.

Documentation

Full documentation is available at roddarjohn.github.io/pgcraft.

Development

# Clone and install
git clone https://github.com/<username>/pgcraft.git
cd pgcraft
uv sync --all-groups

# Run checks
just lint          # ruff check + format
just type-check    # ty check src/
just dev-test      # pytest (fast, needs DATABASE_URL)
just test          # tox (full isolation)
just docs          # build Sphinx HTML docs

Tests require a running PostgreSQL instance:

DATABASE_URL=postgresql+psycopg:///pgcraft just dev-test

Design philosophy

See PLAN.md for the full design philosophy. The short version:

  • Postgres is king. Push logic into the database when it is obviously correct and declarative.
  • Explicit over implicit. No magic — if behavior is not obvious from reading the code, it needs a docstring explaining why.
  • Simple over clever. Three similar lines are better than a premature abstraction.

License

See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgcraft-0.3.0.tar.gz (34.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgcraft-0.3.0-py3-none-any.whl (53.2 kB view details)

Uploaded Python 3

File details

Details for the file pgcraft-0.3.0.tar.gz.

File metadata

  • Download URL: pgcraft-0.3.0.tar.gz
  • Upload date:
  • Size: 34.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgcraft-0.3.0.tar.gz
Algorithm Hash digest
SHA256 bf6c38219375a0a30cbc246644a4c2bbf2bb797c16224d0195bdd4b66f7dd095
MD5 9a0e4e2ce01b3e9fecf270c882a8ff00
BLAKE2b-256 62e6d800b93c68b4a748b78d0206bf84d99813f74146854e123718557ce7d6ef

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgcraft-0.3.0.tar.gz:

Publisher: publish.yml on roddarjohn/pgcraft

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pgcraft-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: pgcraft-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 53.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgcraft-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 377c665508c62aa0bb671b4bc127b9b8bd7a226747ee4e9c478a8e4d0874eace
MD5 ce30a14a40f3f22d43066298dff35bba
BLAKE2b-256 4558a9ee91ffcf30089cce05f45ee4550379a32b3b277b8629aceb58bf826e5b

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgcraft-0.3.0-py3-none-any.whl:

Publisher: publish.yml on roddarjohn/pgcraft

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page