pytest-alembic

CircleCI

Introduction

A pytest plugin to test alembic migrations (with default tests) and which enables you to write tests specific to your migrations.

$ pip install pytest-alembic
$ pytest --test-alembic

...
::pytest_alembic/tests/model_definitions_match_ddl <- . PASSED           [ 25%]
::pytest_alembic/tests/single_head_revision <- . PASSED                  [ 50%]
::pytest_alembic/tests/up_down_consistency <- . PASSED                   [ 75%]
::pytest_alembic/tests/upgrade <- . PASSED                               [100%]

============================== 4 passed in 2.32s ===============================

The pitch

Have you ever merged a change to your models and you forgot to generate a migration?

Have you ever written a migration only to realize that it fails when there’s data in the table?

Have you ever written a perfect migration only to merge it and later find out that someone else merged also merged a migration and your CD is now broken!?

pytest-alembic is meant to (with a little help) solve all these problems and more. Note, due to a few different factors, there may be some minimal required setup; however most of it is boilerplate akin to the setup required for alembic itself.

Built-in Tests

test_single_head_revision

Assert that there only exists one head revision.

We’re not sure what realistic scenario involves a diverging history to be desirable. We have only seen it be the result of uncaught merge conflicts resulting in a diverged history, which lazily breaks during deployment.
test_upgrade

Assert that the revision history can be run through from base to head.
test_model_definitions_match_ddl

Assert that the state of the migrations matches the state of the models describing the DDL.

In general, the set of migrations in the history should coalesce into DDL which is described by the current set of models. Therefore, a call to revision --autogenerate should always generate an empty migration (e.g. find no difference between your database (i.e. migrations history) and your models).
test_up_down_consistency

Assert that all downgrades succeed.

While downgrading may not be lossless operation data-wise, there’s a theory of database migrations that says that the revisions in existence for a database should be able to go from an entirely blank schema to the finished product, and back again.

Let us know if you have any ideas for more built-in tests which would be generally useful for most alembic histories!

Custom Tests

For more information, see the docs for custom tests (example below) or custom static data (to be inserted automatically before a given revision).

Sometimes when writing a particularly knarly data migration, it helps to be able to practice a little timely TDD, since there’s always the potential you’ll trash your actual production data.

With pytest-alembic, you can write tests directly, in the same way that you would normally, through the use of the alembic_runner fixture.

def test_knarly_migration_xyz123(alembic_engine, alembic_runner):
    # Migrate up to, but not including this new migration
    alembic_runner.migrate_up_before('xyz123')

    # Perform some very specific data setup, because this migration is sooooo complex.
    # ...
    alembic_engine.execute(table.insert(id=1, name='foo'))

    alembic_runner.migrate_up_one()

alembic_runner has a number of methods designed to make it convenient to change the state of your database up, down, and all around.

Installing

pip install "pytest-alembic"

Release files for pytest-alembic 0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pytest-alembic 0.3.1
File	Size	Uploaded
pytest-alembic-0.3.1.tar.gz	14.6 kB	May 10, 2021	Details

Built distribution (wheel)

Table of built distributions (wheels) for pytest-alembic 0.3.1
File	Interpreter	ABI	Platform	Reset
pytest_alembic-0.3.1-py3-none-any.whl 17.7 kB May 10, 2021	Python 3	none	any	Details

Total release size: 32.3 kB

Release files / pytest-alembic-0.3.1.tar.gz

Download URL	pytest-alembic-0.3.1.tar.gz
Size	14.6 kB
Tags	Source
SHA-256 checksum How to use checksums	`0670a71d5a8feb675d004ce9d4e23b583fe66a2cbdf84b88b936712d24fb43f4`
BLAKE2b-256 checksum How to use checksums	`f396989a75e25b33f436bcad69fe9f9e3f6985954c9d2089f1b6ac733e581689`
Upload date	May 10, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.1.5 CPython/3.8.8 Darwin/20.3.0`

Release files / pytest_alembic-0.3.1-py3-none-any.whl

Download URL	pytest_alembic-0.3.1-py3-none-any.whl
Size	17.7 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`60bb2b8bf447af388ddd20dbe2380b44f2c21dfeaa124f4480d52c173de051c9`
BLAKE2b-256 checksum How to use checksums	`bcac88c27652f2776553318e51e4dd2640d7c722eb78ad0a9b387c8a7a06bb54`
Upload date	May 10, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.1.5 CPython/3.8.8 Darwin/20.3.0`