Drop, create and alter Snowflake objects and set permissions with Permifrost
Project description
tundri is a Python package to declaratively create, drop, and alter Snowflake objects and manage their permissions with Permifrost.
Motivation
Permifrost is great at managing permissions, but it doesn't create or alter objects. As GitLab's data team handbook states:
Object creation and deletion is not managed by permifrost
With only Permifrost, one would have to manually create the objects and then run Permifrost to set the permissions. This is error prone and time consuming. That is where tundri comes in.
In a nutshell
tundri reads the Permifrost spec file and compares with the current state of the Snowflake account. It then creates, drops, and alters the objects to match. It leverages Permifrost's YAML meta tags to set attributes like default_role for users and warehouse_size for warehouses. Once the objects are created, tundri runs Permifrost to set the permissions.
Reconciliation logic
tundri compares the desired state (spec) with the current Snowflake state and generates the minimum set of DDL statements needed:
| Scenario | Action |
|---|---|
| Object in spec, not in Snowflake | CREATE |
| Object in Snowflake, not in spec | DROP |
| Object in both, params changed | ALTER ... SET ... |
| Param removed from spec, has value in Snowflake | ALTER ... UNSET ... |
[!NOTE] Schemas are never dropped — tundri only creates them.
[!NOTE] When a param (e.g.
rsa_public_key,comment,default_warehouse) is removed from the spec but still has a non-empty value in Snowflake, tundri generates anALTER ... UNSET <param>statement to reset it to the Snowflake default. Params with no value in Snowflake are silently ignored.
Getting started
Prerequisites
- Credentials to a Snowflake user account with the
securityadminrole - A Permifrost spec file
Install
pip install tundri
Configure
Permifrost
Add a valid Permifrost spec file to your repository. You can use the files in the examples folder as reference.
Snowflake
Set up your Snowflake connection details in the environment variables listed below.
[!TIP] You can use a
.envfile to store your credentials. Place it in the same folder as the Permifrost spec file.
PERMISSION_BOT_ACCOUNT=abc134.west-europe.azure # Your account identifier
PERMISSION_BOT_USER=PERMIFROST
PERMISSION_BOT_PASSWORD=...
PERMISSION_BOT_ROLE=SECURITYADMIN # Permifrost requires it to be `SECURITYADMIN`
PERMISSION_BOT_DATABASE=PERMIFROST
PERMISSION_BOT_WAREHOUSE=ADMIN
Usage
The run subcommand is going to drop/create objects and run Permifrost.
Dry run
tundri run --permifrost_spec_path examples/permifrost.yml --dry
Normal run
tundri run --permifrost_spec_path examples/permifrost.yml
Getting help
tundri --help
Development
Local setup
Install the development dependencies
uv sync
Run tests
Run the tests
uv run pytest -v
Formatting
Run the command below to format the code
uv run black .
Testing locally
Dry run with the example spec file
uv run tundri run --dry -p examples/permifrost.yml
Contributing
Release process
The release process is automated using GitHub Actions. Here's how it works:
-
Adding new features or bug fixes
- PR tests run automatically to verify the changes on each PR
- Multiple PRs can be merged to main until a release-ready state is reached
-
Initiating a Release
- A maintainer triggers the manual release workflow
- They specify the version bump type (
major,minor, orpatch) - This creates a release branch and PR with updated version
-
Release Creation
- When the release PR is merged to main:
- A Git tag is created (e.g.,
v1.2.3) - A GitHub release is created
- The package is published to PyPI
- A Git tag is created (e.g.,
- When the release PR is merged to main:
The process requires the following GitHub secrets to be configured:
PYPI_API_TOKEN: For production PyPI publishingTEST_PYPI_API_TOKEN: For TestPyPI publishingSNOWFLAKE_*: Snowflake credentials for running tests
For full details on the release workflow, see RELEASE_WORKFLOW.md.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tundri-1.4.1.tar.gz.
File metadata
- Download URL: tundri-1.4.1.tar.gz
- Upload date:
- Size: 439.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8305be412f42e7b44b07825929e53db56b4385512234f2837fb24cd4c47bdd39
|
|
| MD5 |
83c37602db9f8e845a9c5c44514c1238
|
|
| BLAKE2b-256 |
f8ac24f402db9ee71b88cba2ac57871f19130195d5d8f39ab9de3cfc450f5acf
|
File details
Details for the file tundri-1.4.1-py3-none-any.whl.
File metadata
- Download URL: tundri-1.4.1-py3-none-any.whl
- Upload date:
- Size: 16.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
10fda7621f0977d4dde7ecac29fa774e387a805d2c73fba0e2e911d1551478d6
|
|
| MD5 |
d16e1c0a62bf2fdb522c28ea5c80cfa9
|
|
| BLAKE2b-256 |
e779113e23021cb15caaa94e5a898f5e44bc97ecda9e6b08f0f51c185e114449
|