Skip to main content

Export Snowflake object definitions for use in a DCM project

Project description

dcmassist

Turn an existing Snowflake database into a DCM project in seconds.

You've decided to manage your Snowflake schema with Declarative Change Management. Now you need a DEFINE TABLE … block for every table, view, schema, stage, sequence, file format, and tag you already have. Hand-writing thousands of these is the wrong way to start.

Point dcmassist at your database and it produces a complete, ready-to-commit DCM project — manifest.yml, Makefile, definitions, optional macros, the lot.

uvx dcmassist export --database MYDB --out-folder ./my-dcm-project

That's it. Commit, deploy, done.

Why dcmassist

  • Zero-to-DCM in one command. No bespoke scripts, no copy-pasting from GET_DDL, no fixing up identifier quoting by hand.
  • Multi-environment from day one. Database names are templated to {{ database }} automatically, so the same project deploys to dev, staging, and prod.
  • Safe with secrets. Stage definitions are synthesized without credentials — credentials live on storage integrations, not in git. You won't accidentally commit AWS keys.
  • Built for real Snowflake accounts. Paginates SHOW past the 10K-row cap. Quotes identifiers properly so leading-digit and lowercase names survive. Skips objects your role can't see instead of failing the run.
  • Predictable output. Per-type files, deterministic ordering, automatic chunking when a type grows beyond a threshold. Diffs stay readable as your project evolves.
  • Jinja macros by default. Every definition is a one-line macro invocation, so a column rename touches one file instead of hundreds. Pass --no-use-macros to emit raw DDL instead.
  • Observable runs. Live status panel while it works; a per-run log file you can tail when something looks wrong.

What you get

my-dcm-project/
├── manifest.yml                # targets, configurations, templating defaults
├── Makefile                    # deploy, plan, sync, validate
├── dcmassist-export.log        # per-run log of options + per-object results
└── sources/
    ├── definitions/
    │   ├── schema.sql          # one file per type
    │   ├── table.sql           # auto-chunked into table2.sql, table3.sql … past the threshold
    │   ├── view.sql
    │   ├── sequence.sql
    │   ├── stage.sql           # synthesized — no credentials
    │   ├── file_format.sql
    │   └── tag.sql
    └── macros/                 # default; suppress with --no-use-macros
        └── <type>.sql

Run

Requires Python ≥ 3.10, uv, and a configured snow CLI connection.

dcmassist is a one-shot tool — you run it when you need a DCM project and rarely after that. The simplest way is uvx, which fetches and runs without a permanent install:

uvx dcmassist export --database MYDB

Pin a version for reproducibility:

uvx dcmassist@0.1.15 export --database MYDB

If you'd rather keep it installed:

uv tool install dcmassist
# or
pipx install dcmassist

Quick examples

The examples below use uvx; substitute dcmassist if you've installed it.

Just tables and views from one schema, into a custom folder:

uvx dcmassist export \
    --database MYDB \
    --schema PUBLIC \
    --include Table --include View \
    --out-folder ./project

Multi-environment manifest with templated configurations:

uvx dcmassist export \
    --database MYDB \
    --target dev --target prod \
    --configuration STAGING \
    --templating-default warehouse=COMPUTE_WH

Run uvx dcmassist export --help for every option.

Type support

Implemented: Schema, Table, View, Sequence, Stage, File format, Tag.

Recognized but not yet exported: Dynamic table, Task, Alert, SQL function, Data metric function, SQL procedure, Role, Database role, Grant, Authentication policy. Including these in --include is accepted (they pass validation) but they produce no output yet — contributions welcome.

Database is intentionally never exported: DCM rejects DEFINE DATABASE for the project's own parent database.

Configuration

Environment variable Effect
DCMASSIST_EXPORT_OBJECTS_PER_FILE Max objects per chunked SQL file (default: 100). Lower it if your DDL files grow uncomfortably large.
DCMASSIST_NO_STATUS=1 Disable the live status panel (also auto-disabled on non-TTY and NO_COLOR=1).
Exit code Meaning
0 Success
4 Ran to completion but exported nothing — every object failed (typically permission errors)
5 Setup error — bad env var, or non-empty output folder without --force

Known limitations

  • Pre-existing objects not owned by your role. dcmassist exports every object the running role can see, but snow dcm plan only succeeds for objects the running role owns. Visible-but-not-owned objects produce errors like File_format 'JSON' already exists, but current role has no privileges on it during snow dcm plan. The cleanest workaround is to run dcmassist export (and the resulting snow dcm plan) as a role that owns the objects you want to manage — typically ACCOUNTADMIN, or a custom role with ownership on the relevant schemas. Alternatively, prune the unwanted objects from the generated sources/definitions/*.sql files before deploying.

Project status

Pre-1.0. The output layout, CLI flags, and log format are stable enough to use; expect breaking changes between minor versions until 1.0. Issues and pull requests welcome at github.com/jamiekt/dcmassist.

License

MIT.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dcmassist-0.7.39.tar.gz (184.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dcmassist-0.7.39-py3-none-any.whl (51.2 kB view details)

Uploaded Python 3

File details

Details for the file dcmassist-0.7.39.tar.gz.

File metadata

  • Download URL: dcmassist-0.7.39.tar.gz
  • Upload date:
  • Size: 184.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for dcmassist-0.7.39.tar.gz
Algorithm Hash digest
SHA256 fb8dc8f73b420ac12cc836e7d900b49585521154d8912bbbb8ce550a51cb32b8
MD5 78cdad73ccca29f9993c9e3ec218726c
BLAKE2b-256 7a9ee53d9a14940700815e04e2bfd8a52554801128735a95ef72951835af3008

See more details on using hashes here.

Provenance

The following attestation bundles were made for dcmassist-0.7.39.tar.gz:

Publisher: ci.yml on jamiekt/dcmassist

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dcmassist-0.7.39-py3-none-any.whl.

File metadata

  • Download URL: dcmassist-0.7.39-py3-none-any.whl
  • Upload date:
  • Size: 51.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for dcmassist-0.7.39-py3-none-any.whl
Algorithm Hash digest
SHA256 ca1765fa5aee6b39da1a4758d24d6e2f7198a5f22f1c77beb7826f8daa4def48
MD5 9dac4490bc4478989ba2919a593de459
BLAKE2b-256 d25d7f10ffbe197a574c3a09371140d0c2fa4ae8aa684239f3cfdb039d65fc85

See more details on using hashes here.

Provenance

The following attestation bundles were made for dcmassist-0.7.39-py3-none-any.whl:

Publisher: ci.yml on jamiekt/dcmassist

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page