Skip to main content

The SQL-first database toolkit for SQLAlchemy.

Project description

DBWarden

DBWarden

Your SQLAlchemy models are your migrations.

Python PyPI License DeepWiki

Full documentation  |  Source Code


DBWarden is a database migration and schema management tool for SQLAlchemy. You define your schema in Python (in your SQLAlchemy models) and DBWarden derives everything else: migration SQL, rollbacks, snapshots, safety checks, and seed lifecycle.

There are no migration scripts to write or maintain. There is no migration runtime. Your models are the contract. The database is kept in sync with them.

At a glance

  • Migrations generated from your models, not written by hand
  • Plain SQL output: reviewable, committable, executable anywhere
  • Built-in rollback in every migration file
  • Pre-deploy impact analysis: know what breaks before it ships
  • Offline migration generation for CI pipelines without a live database
  • Schema snapshots for deterministic diffs and rename detection
  • Typed class Meta system with import-time validation
  • Multi-database support: PostgreSQL, MySQL, ClickHouse, MariaDB, SQLite
  • Versioned seed lifecycle with checksum drift detection
  • Reverse-engineer live databases into models with generate-models (supports --base for custom imports)

Why DBWarden

Most migration tools ask you to maintain two representations of your schema: your ORM models and your migration files. When they drift, you find out at deploy time.

DBWarden eliminates the second representation. Your SQLAlchemy models are the schema definition. DBWarden reads them, diffs them against the current database state, and generates the SQL to close the gap (including rollback) without you writing a line of migration code.

This also means:

  • No migration runtime to install or version
  • No generated Python scripts that quietly do the wrong thing
  • No schema drift discovered in production: drift is caught at make-migrations time
  • Migrations that can be generated in CI without a database connection

DBWarden is not a wrapper around Alembic. It is a different approach to the same problem: Alembic asks you to describe how to change the database; DBWarden asks you to describe what the schema should be.

From zero to production

Typical adoption path in an existing project:

  1. Point DBWarden at your existing SQLAlchemy models
  2. Run initial make-migrations to generate a baseline schema
  3. Commit generated migrations as your source of truth
  4. Replace your current migration workflow with the DBWarden CLI
  5. Optionally enable:
    • Migration impact analysis for safer deploys
    • Offline mode for CI pipelines without a database service
    • FastAPI integration for startup validation and health checks

Installation

uv add dbwarden
uv add "dbwarden[fastapi]"   # FastAPI integration
uv add "dbwarden[metrics]"   # Prometheus metrics
uv add "dbwarden[sandbox]"   # Docker-backed test databases

Requirements: Python 3.12+, SQLAlchemy 2.0+.

Optional dependency groups:

Group Default Provides
[postgres] Yes psycopg2-binary
[mysql] pymysql
[clickhouse] clickhouse-connect, aiohttp
[fastapi] fastapi, pydantic, asyncpg, aiosqlite
[sandbox] testcontainers
[metrics] prometheus-client
[dev] pytest, zensical, seoslug, httpx2

Quickstart

1. Configure

Create a file named dbwarden.py in your project root:

from dbwarden import database_config

primary = database_config(
    database_name="primary",
    default=True,
    database_type="postgresql",
    database_url_sync="postgresql://user:pass@localhost:5432/myapp",
    database_url_async="postgresql+asyncpg://user:pass@localhost:5432/myapp",
)

2. Define your models

from sqlalchemy import Column, Integer, String, Text, ForeignKey, DateTime
from sqlalchemy.orm import declarative_base
from dbwarden.databases import TableMeta, IndexSpec

Base = declarative_base()

class User(Base):
    __tablename__ = "users"

    id = Column(Integer, primary_key=True)
    email = Column(String(255), unique=True, nullable=False)
    bio = Column(Text, nullable=True)

    class Meta(TableMeta):
        comment = "Core user accounts"


class Post(Base):
    __tablename__ = "posts"

    id = Column(Integer, primary_key=True)
    title = Column(String(255), nullable=False)
    body = Column(Text, nullable=False)
    user_id = Column(Integer, ForeignKey("users.id"), nullable=False)
    created_at = Column(DateTime, nullable=False)

    class Meta(TableMeta):
        indexes = [
            IndexSpec(name="ix_posts_created_at", columns=["created_at"]),
        ]

3. Generate a migration

dbwarden init
dbwarden make-migrations "create initial tables"

Output: both upgrade and rollback in the same file.

-- upgrade
CREATE TABLE IF NOT EXISTS users (
    id INTEGER PRIMARY KEY,
    email VARCHAR(255) NOT NULL UNIQUE,
    bio TEXT
);
COMMENT ON TABLE users IS 'Core user accounts';

CREATE TABLE IF NOT EXISTS posts (
    id INTEGER PRIMARY KEY,
    title VARCHAR(255) NOT NULL,
    body TEXT NOT NULL,
    user_id INTEGER NOT NULL REFERENCES users(id),
    created_at TIMESTAMP NOT NULL
);
CREATE INDEX IF NOT EXISTS ix_posts_created_at ON posts (created_at);

-- rollback
DROP TABLE posts;
DROP TABLE users;

4. Apply

dbwarden migrate

5. Check status

dbwarden status

Typical workflow

  1. Define or update your SQLAlchemy models with class Meta annotations
  2. Run dbwarden make-migrations to generate SQL
  3. Review the generated .sql file and its rollback section
  4. Run dbwarden migrate to apply
  5. Verify with dbwarden status

Migration engine

Model-driven generation: DBWarden reads your SQLAlchemy models directly. When you change a model, it diffs the new state against the last snapshot and generates the SQL to reconcile them.

Plain SQL output: Generated migrations are .sql files. No migration runtime, no generated Python. Review them, commit them, execute them directly against any environment.

Rollback included: Every migration carries both upgrade and rollback SQL in the same file. Rollback SQL is generated automatically: you do not write it.

Schema snapshots: After every migration, a checksummed JSON snapshot is written to .dbwarden/schemas/. Snapshots power rename detection, offline diffing, and column-level comparisons without querying the live database.

Column-level diffing: Type, nullability, default, and comment changes generate precise ALTER COLUMN statements.

Typed class Meta: The _MetaValidator metaclass validates every attribute on class Meta at import time. Typos that would have silently produced wrong DDL now raise DBWardenConfigError immediately.

class Meta(MyTableMeta):
    my_engin = "InnoDB"  # DBWardenConfigError: unknown attr 'my_engin'

Supported index features:

  • Partial indexes (WHERE clause)
  • Covering indexes (INCLUDE columns)
  • USING access methods
  • NULLS NOT DISTINCT (PostgreSQL 15+)
  • Per-column sort order
  • Storage parameters (WITH (fillfactor=...))
  • ClickHouse skip indexes via ChIndexSpec

Pre-deploy impact analysis

Before applying schema changes, DBWarden can scan your codebase to identify what will be affected. It uses AST analysis with a grep fallback, so results reflect actual code structure rather than text matches.

dbwarden check-impact 0042 --database primary

Output:

drop_column on users.username
  References: 2
    app/routes/users.py:34  attribute_access
      .username
    app/templates/profile.jinja2:12  grep
      user.username

Run this before any destructive deploy to surface breaking changes before they reach production.


Offline migrations

Export model state once, then generate migrations on any machine without a database connection. Designed for CI pipelines and local development without a running database.

dbwarden export-models --database primary
git add .dbwarden/model_state.json

Then on any machine, with no database required:

dbwarden make-migrations "add bio column" --offline

The model state file is updated in place after each migration.


Reverse-engineer models

Generate SQLAlchemy models from a live database with round-trip support (PostgreSQL, MySQL, ClickHouse, SQLite):

dbwarden generate-models --database primary --tables users,posts
dbwarden generate-models --database primary --base app.database:Base

By default each generated file declares its own Base = declarative_base(). Use --base to import a custom Base class from your project instead (e.g. --base app.database:Base or --base app.database:DeclarativeBase). The generated output includes class Meta blocks with all detected backend-specific metadata.


Supported databases

Database Round-trip Notes
PostgreSQL Full Primary backend, full schema fidelity
MySQL Full DDL parity focus
ClickHouse Full Analytics backend, MergeTree engine family
SQLite Dev only Local development and SQL translation
MariaDB No Schema layer complete; snapshot gaps remain

PostgreSQL

First-class support with full round-trip schema fidelity. Supported features include identity and generated columns, partitioning, table inheritance, exclusion constraints, deferrable constraints, advanced indexes via PgIndexSpec, per-column storage and collation, enum type creation, and full type normalization (SERIAL, TIMESTAMPTZ, NUMERIC, JSONB, UUID, ARRAY, TSTZRANGE).

MySQL

Full round-trip support with MyTableMeta / MyColumnMeta and my.field() spec objects. Engine-level options (my_engine, my_charset, my_collate, my_row_format), column-level options (unsigned, charset, collate, on_update), and model reverse-engineering via generate-models.

uv add "dbwarden[mysql]"

ClickHouse

First-class analytics backend support. MergeTree engine family via ChEngineSpec, replicated engines, projections, dictionaries, materialized views, skip indexes via ChIndexSpec, column codecs, LowCardinality and Nullable type wrappers.

uv add "dbwarden[clickhouse]"

MariaDB

Schema layer is complete with MdbTableMeta / MdbColumnMeta and mdb.field() spec objects including MariaDB-specific features (page_compressed, invisible, without_overlaps). Snapshot capture and reverse-engineering of MariaDB-specific features are not yet complete.


Seed lifecycle

DBWarden manages versioned database seeds alongside migrations. Seeds are defined as Python classes and applied with checksum drift detection.

from dbwarden import Seed

class CountrySeed(Seed):
    __seed_database__ = "primary"
    rows = [
        Country(code="US", name="United States"),
        Country(code="UY", name="Uruguay"),
    ]

Rows take model instances: full IDE autocomplete on every field. Versions are assigned automatically by class order, no manual numbering.

Conflict resolution, auto-apply after dbwarden migrate, and SQL export for stateless production deployment are all supported.

dbwarden seed export   # renders seeds as plain SQL for stateless deploy
dbwarden seed list     # shows applied seeds and checksum status

Developer experience

Dev mode: Run SQLite locally against a PostgreSQL production schema with automatic SQL translation.

Sandbox and dry-run: Test migrations in a temporary database or preview SQL without touching anything.

Multi-database: One project, multiple databases, full isolation between them. Use model_tables to assign table ownership per database when sharing model paths.

Observability: Prometheus metrics (6 families), structured JSON logging, and health/status endpoints.

Generate models: Reverse-engineer a live database (PostgreSQL, MySQL, ClickHouse) into SQLAlchemy models with dbwarden generate-models.

dbwarden diff: Read-only comparison tool. Outputs as Rich table, JSON, or raw SQL. Supports --offline mode.

Graceful disconnection: Automatic retry logic and clear error messages when a database is unreachable.


FastAPI integration

DBWarden includes optional FastAPI integration for projects that use it. It is not required.

from contextlib import asynccontextmanager
from fastapi import FastAPI
from dbwarden.fastapi import dbwarden_lifespan

@asynccontextmanager
async def lifespan(app: FastAPI):
    async with dbwarden_lifespan(app, mode="check"):
        yield

app = FastAPI(lifespan=lifespan)

On startup: schema validation or auto-migration, readiness gate, connection pool warmup, optional seed application. On shutdown: engine pools and ClickHouse clients disposed.

Sessions are exposed directly from the configuration object:

@app.get("/users")
async def list_users(session: primary.async_session):
    result = await session.execute(select(User))
    return result.scalars().all()

Health and management routers:

from dbwarden.fastapi import DBWardenHealthRouter, DBWardenRouter

app.include_router(DBWardenHealthRouter(), prefix="/health")
app.include_router(DBWardenRouter(), prefix="/db")

DBWardenHealthRouter exposes /liveness, /readiness, and per-database status. DBWardenRouter exposes GET /status and POST /migrate.

Auto-generated Pydantic schemas

@auto_schema generates CreateSchema, UpdateSchema, and PublicSchema from model annotations, eliminating duplicated definitions between your ORM layer and your API layer.

from dbwarden.databases import auto_schema

@auto_schema
class User(Base):
    __tablename__ = "users"

    id = Column(Integer, primary_key=True)
    email = Column(String(255), nullable=False)
    password_hash = Column(String(255), nullable=False)

    class Meta(TableMeta):
        class password_hash:
            public = False
user = User.CreateSchema(email="a@b.com", password_hash="secret")
user.to_schema()  # PublicSchema excludes password_hash automatically

License

MIT


DBWarden is built for teams that want explicit, reviewable, reproducible database changes, derived from the models they already maintain, not from migration scripts they have to write.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbwarden-0.12.4.tar.gz (884.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbwarden-0.12.4-py3-none-any.whl (211.7 kB view details)

Uploaded Python 3

File details

Details for the file dbwarden-0.12.4.tar.gz.

File metadata

  • Download URL: dbwarden-0.12.4.tar.gz
  • Upload date:
  • Size: 884.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.5

File hashes

Hashes for dbwarden-0.12.4.tar.gz
Algorithm Hash digest
SHA256 656fa5a646266c9e0def8f888a2a2bab63ee5a949e156f512e9793d2c96f93bf
MD5 bc6bf78891a15318c5d24d48cc134b8b
BLAKE2b-256 aa670e448d53e327dc6069ba1d14b963f402f28e44e505b53bd0b175d75a7467

See more details on using hashes here.

File details

Details for the file dbwarden-0.12.4-py3-none-any.whl.

File metadata

  • Download URL: dbwarden-0.12.4-py3-none-any.whl
  • Upload date:
  • Size: 211.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.5

File hashes

Hashes for dbwarden-0.12.4-py3-none-any.whl
Algorithm Hash digest
SHA256 fe92f7f13d3992defe45a041212bd77b018055eeb3efdfd208213b027b1527db
MD5 32037964305154e1b56a3ea0b706de8c
BLAKE2b-256 b8ecb5fdf10b00b80a73ff2166698c060a9c1bed71b88ce486a5af8cd7e70730

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page