Skip to main content

Generate typed models from your database for Python, Go, and TypeScript.

Project description

db2model

Generate typed models from your database for Python, Go, and TypeScript.

Features

  • Database-first: generate from existing DB
  • Typed output
  • Customizable generation rules

Generation supported

  • python
    • postgresql

Install

pip install db2model

Quick start

It is strongly recommended to use the library within python script as it offers way more control than cli.

Within a script

import logging
from pathlib import Path

from db2model.config import Db2ModelSettings, DbSettings, PathSettings
from db2model.generator.python import generate_python_models
from db2model.types import SqlDialect

from .config import db2model_settings

logging.basicConfig(level=logging.DEBUG)

logger = logging.getLogger()

db2model_settings = Db2ModelSettings(
    path_settings=PathSettings(output_folder_root_path=Path("./dest_folder")),
    db_settings=DbSettings(
        user=postgres_config.user,
        password=postgres_config.password,
        host=postgres_config.host,
        port=postgres_config.port,
        sql_dialect=SqlDialect.POSTGRESQL,
    ),
    db_names=["my_db1", "my_db2"],
    globally_ignored_tables=[
        "_yoyo_log",
        "_yoyo_migration",
        "_yoyo_version",
        "yoyo_lock",
        "spatial_ref_sys",
    ],
    db_to_ignored_tables_map={"my_db1": ["specific_table"]},

    ## Specific to Postgresql
    db_to_schemas={
        "my_db1": ["auth", "app1_schema1", "app1_schema2"],
        "my_db2": ["public", "app2_schema1"],
    },
    globally_ignored_schemas=["cron", "information_schema", "topology"],
    db_to_schemas_to_ignored_tables_map={
        "my_db1": {
            "auth": ["specific_table_of_auth"],
        },
        "my_db2": {
            "public": ["specific_table_of_public"],
            "app2_schema1": [
                "specific_table_of_schema1",
                "other_specific_table_of_schema1",
            ],
        },
    },

    ## Specific to python typing
    # These fields will not be arguments of the __init__ class function
    init_false_column_names=["created_at", "updated_at", "deleted_at"],
)

if __name__ == "__main__":
    generate_python_models(db2model_settings, logger)

Will generate

dest_folder/
├── python/
│   ├── my_app1/
│   │   ├── __init__.py
│   │   ├── auth/
│   │   │   ├── __init__.py
│   │   │   ├── table1.py
│   │   │   ├── ...
│   │   │   └── tableN.py
│   │   ├── app1_schema1/
│   │   │   └── ...
│   │   ├── app1_schema2/
│   │   │   └── ...
│   └── my_app2/
│       ├── __init__.py
│       ├── public/
│       │   └── ...
│       └── app2_schema1/
│           └── ...
├── go/
│   ├── my_app1/
...

Using cli

Limited usage.

db2model generate \
  --db-url postgresql://user:pass@localhost:5432/mydb \
  --lang python \
  --output-path ./models
  ## To ignore tables
  --ignored-tables table_to_ignore1
  --ignored-tables table_to_ignore2
  --ignored-tables table_to_ignore3
  ## If dialect is postgresql you must provide the schemas targetted
  --schemas public
  --schemas my_schema1

Example

Input table:

CREATE TABLE sessions (
    id UUID DEFAULT uuidv7(),
    user_id UUID NOT NULL,
    created_at TIMESTAMPTZ NOT NULL DEFAULT now(),
    expires_at TIMESTAMPTZ NOT NULL,
    last_used_at TIMESTAMPTZ,
    revoked_at TIMESTAMPTZ,
    ip_address INET,
    user_agent TEXT,

    CONSTRAINT pk_sessions_id PRIMARY KEY (id),

    CONSTRAINT fk_sessions_users FOREIGN KEY (user_id)
        REFERENCES users (id)
        ON DELETE CASCADE
);

CREATE INDEX idx_sessions_expiresat
    ON sessions (expires_at);

CREATE INDEX idx_sessions_revokedat
    ON sessions (revoked_at);

CREATE INDEX idx_sessions_userid
    ON sessions (user_id);

Generated (Python):

class Sessions(Base):
    __tablename__ = "sessions"
    __table_args__ = (
        ForeignKeyConstraint(
            ["user_id"], ["auth.users.id"], ondelete="CASCADE", name="fk_sessions_users"
        ),
        PrimaryKeyConstraint("id", name="pk_sessions_id"),
        Index("idx_sessions_expiresat", "expires_at"),
        Index("idx_sessions_revokedat", "revoked_at"),
        Index("idx_sessions_userid", "user_id"),
        {"schema": "auth"},
    )

    id: Mapped[uuid.UUID] = mapped_column(
        Uuid, primary_key=True, server_default=text("uuidv7()"), init=False
    )
    user_id: Mapped[uuid.UUID] = mapped_column(Uuid, nullable=False, init=False)
    created_at: Mapped[datetime.datetime] = mapped_column(
        DateTime(True), nullable=False, server_default=text("now()"), init=False
    )
    expires_at: Mapped[datetime.datetime] = mapped_column(
        DateTime(True), nullable=False
    )
    user: Mapped["Users"] = relationship("Users", back_populates="sessions")
    last_used_at: Mapped[Optional[datetime.datetime]] = mapped_column(
        DateTime(True), default=None
    )
    revoked_at: Mapped[Optional[datetime.datetime]] = mapped_column(
        DateTime(True), default=None
    )
    ip_address: Mapped[Optional[Any]] = mapped_column(INET, default=None)
    user_agent: Mapped[Optional[str]] = mapped_column(Text, default=None)

Roadmap

  • Generate in GO & Typescript.
  • Support other sql dialects.

Limitations

  • Two tables within the same database cannot have the same name.
  • In python models, init=False is only applied to child tables if the column holding the foreign key starts with the name of the parent table;
    • If the parent table is users and the column is user_id, behaves as expected.
    • If the parent table is users and the column is agent_id, then init=False will not be applied.
  • Does not support cross-db foreign constraint (neither SqlAlchemy though).

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

db2model-0.1.4.tar.gz (46.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

db2model-0.1.4-py3-none-any.whl (15.2 kB view details)

Uploaded Python 3

File details

Details for the file db2model-0.1.4.tar.gz.

File metadata

  • Download URL: db2model-0.1.4.tar.gz
  • Upload date:
  • Size: 46.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.26 {"installer":{"name":"uv","version":"0.9.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for db2model-0.1.4.tar.gz
Algorithm Hash digest
SHA256 c7c8ba058d7e71e361a6c41eb9d29883c4ea4caae79837eeadbd55d63fbfc503
MD5 d484393ca50f4eafbfa816245d03bb6f
BLAKE2b-256 0c5ef1cbe10b3fa48b08013691ee1a8f08edb41911d7b3c3e08cd1e3544134ce

See more details on using hashes here.

File details

Details for the file db2model-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: db2model-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 15.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.26 {"installer":{"name":"uv","version":"0.9.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for db2model-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4263e1379d615bb53c2f601f7d4869fb442a50bc461851148c64c79dff028bb2
MD5 cbfd7af997601e037370ad19b1ea9922
BLAKE2b-256 f3061d9d1cfe655d37ae6814052694878e662629cead03d6db58821d0b9d5a29

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page