Skip to main content

PostgreSQL migration toolkit: stage versions, generate incrementals via results, apply with libpq.

Project description

pgpkg

A small, focused PostgreSQL migration toolkit.

You write SQL describing the exact desired state of your database in an ordered sql/ directory. pgpkg does everything else:

  1. stageversion — concatenates sql/ into a versioned base file <prefix>--<version>.sql.
  2. makemigration — diffs two staged versions with results to generate an incremental migration <prefix>--A--B.sql, including body-only function/procedure changes that require CREATE OR REPLACE.
  3. graph — shows the version graph and shortest paths between versions.
  4. migrate — connects to a live database (libpq env vars or psql-style flags), reads the currently installed version, and applies the shortest sequence of incrementals (or bootstraps from a base file) to reach the target version.
  5. wheel — scaffolds a self-contained wrapper Python project that bakes your migrations into a wheel and exposes a <project>-migrator console script.
  6. verify — round-trips every edge (a -> b) through two throwaway databases to prove the incremental produces the same schema as loading <prefix>--b.sql.
  7. bundle — writes a compressed tar.zst artifact containing migrations/ plus sql/pre/ and sql/post/ for automation or custom packaging flows.

Prerequisites

  • Python ≥ 3.11 and uv
  • pgpkg[diff] — the makemigration command requires the optional results dependency: uv tool install --with 'pgpkg[diff]' pgpkg
  • Dockermakemigration and verify spin up throwaway PostgreSQL containers via testcontainers; Docker must be running
  • libpqmigrate connects to a live database using standard libpq environment variables (PGHOST, PGPORT, PGDATABASE, PGUSER, PGPASSWORD) or explicit -h/-p/-d/-U/--dsn flags

Quickstart

uv tool install --with 'pgpkg[diff]' pgpkg

mkdir -p sql/pre sql/post
echo "CREATE TABLE foo (id int PRIMARY KEY);" > sql/010_schema.sql

# declare your project once
cat >> pyproject.toml <<'TOML'
[tool.pgpkg]
project_name = "myext"
TOML

# stage a version
pgpkg stageversion 0.1.0

# iterate sql/ and generate an incremental
pgpkg stageversion 0.2.0
pgpkg makemigration --from 0.1.0 --to 0.2.0

# apply to a live database (libpq env vars honored)
pgpkg migrate -d mydb -h localhost --to 0.2.0

Tracking and packaging

By default, pgpkg records applied versions in pgpkg.migrations. You can relocate that table with:

[tool.pgpkg]
project_name = "myext"

[tool.pgpkg.tracking]
schema = "ops"
table = "schema_versions"

If your application already owns the authoritative version table, set [tool.pgpkg].version_source = "module:attribute" and provide an object with read_live_version(...) and record_applied(...) methods. The generic pgpkg wheel scaffold is intentionally limited to the default tracking path; custom version sources should use a project-specific wrapper that calls pgpkg.api.migrate_from_artifact(..., version_source=...).

See the full manual at https://bitner.github.io/pgpkg/ and the source docs in docs/.

Development

uv sync --extra dev --extra diff
uv run pre-commit install
uv run pre-commit run --all-files
uv run ty check src tests
uv run pytest -q
uv build --out-dir dist
uv run mkdocs build --strict

See CONTRIBUTING.md for the release workflow and trusted-publishing setup. For initial repository and publishing bootstrap, use your local project bootstrap checklist.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgpkg-0.1.1.tar.gz (45.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgpkg-0.1.1-py3-none-any.whl (31.9 kB view details)

Uploaded Python 3

File details

Details for the file pgpkg-0.1.1.tar.gz.

File metadata

  • Download URL: pgpkg-0.1.1.tar.gz
  • Upload date:
  • Size: 45.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for pgpkg-0.1.1.tar.gz
Algorithm Hash digest
SHA256 a3abf53a6b7e8c88774e0280a199bf752a4f0d17cb848c6d1119984c871b7ff9
MD5 e46ba11a80ce24e1c3077dc4e6b7b474
BLAKE2b-256 824cc2557e77821fb7c53b327975d544ee7873042caaad8cf6a6f0416fdbd4cc

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgpkg-0.1.1.tar.gz:

Publisher: publish-pypi.yml on bitner/pgpkg

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pgpkg-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: pgpkg-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 31.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for pgpkg-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b8d2e6fc7a5118abc9529b37dba63ae4adc83e120650063e8563ef89f7c4e011
MD5 c64d0f428628ce3c55046bc96f85099e
BLAKE2b-256 40ce2046b80e9a6e80088479f594b28c861d6ee68a515c109ff99343f4ec6d92

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgpkg-0.1.1-py3-none-any.whl:

Publisher: publish-pypi.yml on bitner/pgpkg

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page