Declarative, automatic db migrations using SQL & git as the source of truth
Project description
automigrate
Automigrate is a command-line tool for SQL migrations. Unlike other migration tools, it uses git history to do diffs on create table
statements instead of forcing you to write up/down diffs for every change.
How is this different
This tool doesn't make you write & manage a giant folder of up/down migrations. It uses git history to infer them instead, and to version production databases.
Other schema migration tools work in one of two ways:
- Check in 'up' and 'down' migrations, which then get applied to your DB (alembic et al). These are most often manual.
- Compare a live DB to a source of truth and apply the changes (sqldiff.exe, migra, pgquarrel)
This tool only requires you to create and edit the desired state of your database, i.e. a file or folder full of create table
and create index
statements. This tool looks at the git history of that file and automatically infers the DDL statements to get from and old point in history to the new one.
Seriously, all you have to do is maintain a file like this:
-- schema.sql
create table whatever (
userid uuid primary key,
age_at_birth int default 0
);
And when you add a field to the create table statement, automig figures out the 'alter table'. No writing or checking in migrations.
Usage
If you're using postgres:
pip install automig[postgres]
# set an environment var with postgres connection details
export AUTOMIG_CON=postgresql://postgres:$PGPASSWORD@host
# initialize the postgres DB to schema/*.sql -- do this once to create a DB
automig_pg --glob 'schema/*.sql' init
# update your DB to whatever sha is at git HEAD -- do this whenever your schema changes
automig_pg --glob 'schema/*.sql' update
# do a dry-run, show the output without applying it
automig_pg --preview --glob 'schema/*.sql' update
If you're using another database, you can get the raw SQL for these actions by using the automig
tool instead of automig_pg
. (docs coming soon).
Postgres is the primary database I test on, with sqlite support secondary.
Advanced features
- Instructions for doing kube-native migrations are in the
kube
folder. - You can skip over bad diffs using
--opaque
mode, docs coming soon - You can specify manual overrides for erroring diffs by using .manualmig.yml file, docs coming soon.
- Convert an existing DB to use automig -- please post a github issue if you have this issue and I'll add instructions
Generate ORM definitions from SQL
Experimental sqlalchemy generator in sa_harness.py. Try it out with:
python -m automig.lib.sa_harness 'test/schema/*.sql'
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.