Skip to main content

Export Snowflake object definitions for use in a DCM project

Project description

dcmassist

Turn an existing Snowflake database into a DCM project in seconds.

You've decided to manage your Snowflake schema with Declarative Change Management. Now you need a DEFINE TABLE … block for every table, view, schema, stage, sequence, file format, and tag you already have. Hand-writing thousands of these is the wrong way to start.

Point dcmassist at your database and it produces a complete, ready-to-commit DCM project — manifest.yml, Makefile, definitions, optional macros, the lot.

uvx dcmassist export --database MYDB --out-folder ./my-dcm-project

That's it. Commit, deploy, done.

Why dcmassist

  • Zero-to-DCM in one command. No bespoke scripts, no copy-pasting from GET_DDL, no fixing up identifier quoting by hand.
  • Multi-environment from day one. Database names are templated to {{ database }} automatically, so the same project deploys to dev, staging, and prod.
  • Safe with secrets. Stage definitions are synthesized without credentials — credentials live on storage integrations, not in git. You won't accidentally commit AWS keys.
  • Built for real Snowflake accounts. Paginates SHOW past the 10K-row cap. Quotes identifiers properly so leading-digit and lowercase names survive. Skips objects your role can't see instead of failing the run.
  • Predictable output. Per-type files, deterministic ordering, automatic chunking when a type grows beyond a threshold. Diffs stay readable as your project evolves.
  • Jinja macros by default. Every definition is a one-line macro invocation, so a column rename touches one file instead of hundreds. Pass --no-use-macros to emit raw DDL instead.
  • Observable runs. Live status panel while it works; a per-run log file you can tail when something looks wrong.

What you get

my-dcm-project/
├── manifest.yml                # targets, configurations, templating defaults
├── Makefile                    # deploy, plan, sync, validate
├── dcmassist-export.log        # per-run log of options + per-object results
└── sources/
    ├── definitions/
    │   ├── schema.sql          # one file per type
    │   ├── table.sql           # auto-chunked into table2.sql, table3.sql … past the threshold
    │   ├── view.sql
    │   ├── sequence.sql
    │   ├── stage.sql           # synthesized — no credentials
    │   ├── file_format.sql
    │   └── tag.sql
    └── macros/                 # default; suppress with --no-use-macros
        └── <type>.sql

Run

Requires Python ≥ 3.10, uv, and a configured snow CLI connection.

dcmassist is a one-shot tool — you run it when you need a DCM project and rarely after that. The simplest way is uvx, which fetches and runs without a permanent install:

uvx dcmassist export --database MYDB

Pin a version for reproducibility:

uvx dcmassist@0.1.15 export --database MYDB

If you'd rather keep it installed:

uv tool install dcmassist
# or
pipx install dcmassist

Quick examples

The examples below use uvx; substitute dcmassist if you've installed it.

Just tables and views from one schema, into a custom folder:

uvx dcmassist export \
    --database MYDB \
    --schema PUBLIC \
    --include Table --include View \
    --out-folder ./project

Multi-environment manifest with templated configurations:

uvx dcmassist export \
    --database MYDB \
    --target dev --target prod \
    --configuration STAGING \
    --templating-default warehouse=COMPUTE_WH

Run uvx dcmassist export --help for every option.

Type support

Implemented: Schema, Table, View, Sequence, Stage, File format, Tag.

Recognized but not yet exported: Dynamic table, Task, Alert, SQL function, Data metric function, SQL procedure, Role, Database role, Grant, Authentication policy. Including these in --include is accepted (they pass validation) but they produce no output yet — contributions welcome.

Database is intentionally never exported: DCM rejects DEFINE DATABASE for the project's own parent database.

Configuration

Environment variable Effect
DCMASSIST_EXPORT_OBJECTS_PER_FILE Max objects per chunked SQL file (default: 100). Lower it if your DDL files grow uncomfortably large.
DCMASSIST_NO_STATUS=1 Disable the live status panel (also auto-disabled on non-TTY and NO_COLOR=1).
Exit code Meaning
0 Success
4 Ran to completion but exported nothing — every object failed (typically permission errors)
5 Setup error — bad env var, or non-empty output folder without --force

Known limitations

  • Pre-existing objects not owned by your role. dcmassist exports every object the running role can see, but snow dcm plan only succeeds for objects the running role owns. Visible-but-not-owned objects produce errors like File_format 'JSON' already exists, but current role has no privileges on it during snow dcm plan. The cleanest workaround is to run dcmassist export (and the resulting snow dcm plan) as a role that owns the objects you want to manage — typically ACCOUNTADMIN, or a custom role with ownership on the relevant schemas. Alternatively, prune the unwanted objects from the generated sources/definitions/*.sql files before deploying.

Project status

Pre-1.0. The output layout, CLI flags, and log format are stable enough to use; expect breaking changes between minor versions until 1.0. Issues and pull requests welcome at github.com/jamiekt/dcmassist.

License

MIT.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dcmassist-0.8.42.tar.gz (184.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dcmassist-0.8.42-py3-none-any.whl (51.3 kB view details)

Uploaded Python 3

File details

Details for the file dcmassist-0.8.42.tar.gz.

File metadata

  • Download URL: dcmassist-0.8.42.tar.gz
  • Upload date:
  • Size: 184.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for dcmassist-0.8.42.tar.gz
Algorithm Hash digest
SHA256 5c61bb0b76b835f8c15ee2651cb0b595ea541813b94d47e5e32468b53535bcee
MD5 6959f2d0f305dfa15c4703883a70f2c6
BLAKE2b-256 159b4833ed0d52676e51ca8370a9a3b6a2b5296274da8603e8275112b9aa6723

See more details on using hashes here.

Provenance

The following attestation bundles were made for dcmassist-0.8.42.tar.gz:

Publisher: ci.yml on jamiekt/dcmassist

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dcmassist-0.8.42-py3-none-any.whl.

File metadata

  • Download URL: dcmassist-0.8.42-py3-none-any.whl
  • Upload date:
  • Size: 51.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for dcmassist-0.8.42-py3-none-any.whl
Algorithm Hash digest
SHA256 dd9494f677dfa3056bd5071856fc95b96703fa3e8a8185f511a45e6e1360c927
MD5 3bba9db5f92861a8c1d95fc654cf81f4
BLAKE2b-256 5dddef63fd1a54569f96c021e39bd0248deebdcef0c155399c1f2bc170390606

See more details on using hashes here.

Provenance

The following attestation bundles were made for dcmassist-0.8.42-py3-none-any.whl:

Publisher: ci.yml on jamiekt/dcmassist

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page