DataSecOps Framework CLI for Snowflake Native App
Project description
DataSecOps CLI
A command-line interface for the Data Engineers DataSecOps Native App on Snowflake. Streamlines dbt development, source control workflows, and framework configuration management for teams using the DataSecOps Framework.
What is this?
The DataSecOps CLI is the local developer companion to the Data Engineers DataSecOps Native App — a Snowflake Native App that provides governance, configuration management, and standardised development workflows for data teams.
This CLI connects to the native app and gives developers:
- dbt development commands — run, build, test, lint, and manage dbt projects via dbt Fusion
- Source control operations — branching, committing, rebasing, and deploying via GitPython with naming conventions enforced by the framework
- Configuration downloads — pull SQLFluff rules, CI/CD pipelines, dbt packages, and Cortex Code skills from the native app to your local project
- MCP server — expose framework governance rules to AI coding assistants (VS Code, Cursor, Cortex Code, Claude Code)
Installation
pip install datasecops-cli
With MCP server support:
pip install "datasecops-cli[mcp]"
Requires Python 3.10 or later.
Prerequisites
- A Snowflake connection configured in
~/.snowflake/connections.toml - The Data Engineers DataSecOps Native App installed in your Snowflake account
- A project profile created in the native app
Optional:
- dbt Fusion — required for dbt commands (
dbtf). Install from https://docs.getdbt.com/docs/core/installation - Cortex Code for skill downloads
- Node.js 18+ for GitHub/Azure DevOps MCP servers
Quick Start
1. Configure your project
datasecops setup
This prompts for your Snowflake connection name and native app database, then writes .datasecops.yml.
If you skip this step, running datasecops will offer to run setup automatically.
2. Run the CLI
datasecops
Features
| Menu | Capabilities |
|---|---|
| Development | dbt run, build, test, lint (SQLFluff), deps, seed, compile, snapshot, freshness, docs |
| Git | Branch create/checkout/delete, commit & push, rebase, squash, deploy to environment branches, cherry-pick |
| Downloads | SQLFluff config, CI/CD pipelines (GitHub Actions / Azure DevOps), dbt packages, Cortex Code skills |
Non-Interactive Mode (CI/CD)
The download subcommand lets you pull framework config in CI/CD pipelines without interactive prompts:
# Download specific items
datasecops download sqlfluff
datasecops download sqlfluff packages
datasecops download pipelines macros
# Install framework-pinned package versions
datasecops download install-sqlfluff
datasecops download install-dbt
# Download config and install packages together
datasecops download sqlfluff install-sqlfluff
# Download and install everything
datasecops download all
Available items: sqlfluff, pipelines, packages, macros, scripts, install-sqlfluff, install-dbt, all
The pipeline platform (GitHub / Azure DevOps) is auto-detected from the native app's source control configuration.
Pipeline Setup
Your pipeline needs two things:
-
A
.datasecops.ymlin the repo (already committed — contains no secrets):connection_name: "ci" app_database: "DATA_ENGINEERS_DATASECOPS_FRAMEWORK"
-
A Snowflake connection in
~/.snowflake/connections.tomlfor the CI service account:# GitHub Actions example - name: Configure Snowflake connection run: | mkdir -p ~/.snowflake cat > ~/.snowflake/connections.toml << EOF [ci] account = "${{ vars.SNOWFLAKE_ACCOUNT }}" user = "${{ vars.SNOWFLAKE_USER }}" authenticator = "snowflake_jwt" private_key_file = "/tmp/rsa_key.p8" warehouse = "CI_WH" role = "CI_ROLE" EOF - name: Download SQLFluff config run: datasecops download sqlfluff
The exit code is 0 on success, 1 if any download fails.
MCP Server
The package includes an MCP (Model Context Protocol) server that exposes your framework's governance configuration to AI coding assistants. Instead of static skill files, the MCP server gives AI tools live access to your native app's current rules.
Available Tools
| Category | Tools |
|---|---|
| Configuration | get_branching_rules, get_linting_rules, get_dbt_packages, get_pipeline_config, get_dbt_versions |
| Project | get_project_settings, get_project_profiles, get_deployment_targets, get_available_skills |
| Linting | lint_sql, fix_sql, lint_project |
| Source Control | validate_branch_name, get_deployment_workflow |
Setup for AI Tools
Cortex Code:
cortex mcp add datasecops-framework -- datasecops-mcp
VS Code / Cursor — add to .vscode/mcp.json or .cursor/mcp.json:
{
"mcpServers": {
"datasecops-framework": {
"command": "datasecops-mcp",
"args": []
}
}
}
Recommended MCP Server Stack
For full integration with Snowflake, dbt, and your source control platform, configure these MCP servers alongside the framework server:
| Server | Purpose | Install |
|---|---|---|
| datasecops-framework | Governance rules, linting, branch validation | Included (datasecops-mcp) |
| dbt | Lineage, model discovery, codegen, semantic layer | pip install dbt-mcp |
| GitHub | PRs, issues, CI checks, releases | npx -y @modelcontextprotocol/server-github |
| Azure DevOps | PRs, pipelines, work items, boards | npx -y @tiberriver256/mcp-server-azure-devops |
See the Getting Started Guide for full configuration instructions for each editor and platform.
Configuration
The CLI reads from a .datasecops.yml file in your project root (created by the setup script):
connection_name: "my_connection"
app_database: "DATA_ENGINEERS_DATASECOPS_FRAMEWORK"
Project profiles, linting rules, pipeline templates, and deployment targets are all managed centrally in the native app and pulled down by the CLI.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file datasecops_cli-0.4.9.tar.gz.
File metadata
- Download URL: datasecops_cli-0.4.9.tar.gz
- Upload date:
- Size: 79.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aab823cc18eb8fc232cfc32bd574fd2abdb335bf6ee5799b0360b278c5a77f38
|
|
| MD5 |
2c38ff8fe85510a0b1c5a9a610e85cbb
|
|
| BLAKE2b-256 |
049af95acb84d10447721da432abded343a51ff014dbecbb0e974f2ba071b947
|
Provenance
The following attestation bundles were made for datasecops_cli-0.4.9.tar.gz:
Publisher:
auto-tag.yml on DataEngineersNZ/snowflake-datasecops-framework-cli
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datasecops_cli-0.4.9.tar.gz -
Subject digest:
aab823cc18eb8fc232cfc32bd574fd2abdb335bf6ee5799b0360b278c5a77f38 - Sigstore transparency entry: 1590929370
- Sigstore integration time:
-
Permalink:
DataEngineersNZ/snowflake-datasecops-framework-cli@b3e8554b850487d54f238840296c686c84e12a81 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/DataEngineersNZ
-
Access:
internal
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
auto-tag.yml@b3e8554b850487d54f238840296c686c84e12a81 -
Trigger Event:
push
-
Statement type:
File details
Details for the file datasecops_cli-0.4.9-py3-none-any.whl.
File metadata
- Download URL: datasecops_cli-0.4.9-py3-none-any.whl
- Upload date:
- Size: 54.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ec9906c050e8f8985e09ae3ab6cb5eefca091abdb8beaad394e9e4af16164283
|
|
| MD5 |
5f9694419492f175a3c6cc354bf2c22a
|
|
| BLAKE2b-256 |
4fe49c8828dda6724ad3e19c81ffe27efa2d62dc232b733e609731fa7891af2c
|
Provenance
The following attestation bundles were made for datasecops_cli-0.4.9-py3-none-any.whl:
Publisher:
auto-tag.yml on DataEngineersNZ/snowflake-datasecops-framework-cli
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datasecops_cli-0.4.9-py3-none-any.whl -
Subject digest:
ec9906c050e8f8985e09ae3ab6cb5eefca091abdb8beaad394e9e4af16164283 - Sigstore transparency entry: 1590929401
- Sigstore integration time:
-
Permalink:
DataEngineersNZ/snowflake-datasecops-framework-cli@b3e8554b850487d54f238840296c686c84e12a81 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/DataEngineersNZ
-
Access:
internal
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
auto-tag.yml@b3e8554b850487d54f238840296c686c84e12a81 -
Trigger Event:
push
-
Statement type: