Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Snowfinch is general purpose python library which allows developers to quickly convert on prem databases SQL to SnowFlake, perform lightweight ETL, assist in managing CICD pipelines and data tokenization.

Why SnowFinch

  • Unavailability of any tool for migrating Teradata/MS SQL Server DDLs to Snowflake DDL with constraints

  • Time consuming manual process for migrating large number of tables and high volume of data

  • Manual validation of migrated data resulting in inaccuracy and inefficiency of the process

Introduction

SnowFinch is the tool of choice for * Schema Mapping and Auto conversion of DDL, Stored procedures, BTEQ scripts * Dynamic creation of the converted objects on SnowFlake using python connectors DB API * deploying your artifacts s3 and bitbucket in an automated fashion

Features

  • Command-line tool

  • Python API - expressive, powerful, and great for working with other packages _ (e.g. pandas)

  • Config Driven - manage connection information and credentials securely using the snowfinch yaml config and snowfinch secret commands

  • Fully Automated - Up to 80% automated code conversion to SnowSQL

  • Dynamic Snowflake object creation - directly performs the DML operation on snowflake

  • CICD - Uploads the source code to S3 bucket or Bitbucket

  • Tokenization - Handles tokenization and de-tokenization

  • DBAPI2 Compliant - DB Driver (Adapter) agnostic. Use your favourite driver that complies with DB-API 2.0

  • S3 Integration - provides functionality to download and upload data to S3 buckets, and internal stages (Snowflake)

Getting Started

Assuming that you have Python and virtualenv installed, set up your environment and install the required dependencies like this or you can install the library using pip:

$ virtualenv snowfinch
$ source snowfinch/bin/activate
$ pip install --upgrade setuptools pip
$ pip install --index-url https://test.pypi.org/simple/ --no-deps snowfinch==0.1.dev3

Install the latest SnowFinch release via pip:

python -m pip install --index-url https://test.pypi.org/simple/ --no-deps snowfinch==0.1.dev3

Using SnowFinch

After installing SnowFinch

for MS SQL Server:

python  snowfinch.py -c /path/to/snowfinch-app-dev.yaml -p=dev -m=ddl -d=mssql -dt=True
python  snowfinch.py -c /path/to/snowfinch-app-dev.yaml -p=dev -m=sproc -d=mssql -dt=True
python  snowfinch.py -c /path/to/snowfinch-app-dev.yaml -p=dev -m=full -d=mssql -dt=True
python  snowfinch.py -c /path/to/snowfinch-app-dev.yaml -p=dev -m=s3 -d=mssql

for Teradata:

python  snowfinch.py --config /path/to/snowfinch-app-dev.yaml --profile=dev --mode=ddl --dialect=teradata -dt=False
python  snowfinch.py --config /path/to/snowfinch-app-dev.yaml --profile=dev --mode=sproc --dialect=teradata -dt=True
python  snowfinch.py --config /path/to/snowfinch-app-dev.yaml --profile=dev --mode=full --dialect=teradata -dt=False
python  snowfinch.py --config /path/to/snowfinch-app-dev.yaml --profile=dev --mode=s3 --dialect=teradata

Getting Help

Please use the below resources for getting help * Please email us on the snowfinch-support@anthem.com * Open a SNOW ticket using snowfinch support * If it turns out that you may have found a bug, please snowfinch issues

Release files for snowfinch 0.1.dev15

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for snowfinch 0.1.dev15
File Size Uploaded
snowfinch-0.1.dev15.tar.gz 161.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for snowfinch 0.1.dev15
File Interpreter ABI Platform
snowfinch-0.1.dev15-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 225.1 kB

Release files / snowfinch-0.1.dev15.tar.gz

Download URL snowfinch-0.1.dev15.tar.gz
Size 161.6 kB
Tags Source
SHA-256 checksum
How to use checksums
014ab75c4d2cc77fd2399a54c4274dccd144f0e14addf727368a81dcd856a847
BLAKE2b-256 checksum
How to use checksums
02657fb53742ed60cb3577f8ac1a53aa3c20638b47c367104894886121b760df
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.8.2

Release files / snowfinch-0.1.dev15-py2.py3-none-any.whl

Download URL snowfinch-0.1.dev15-py2.py3-none-any.whl
Size 63.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
4bffadc480453afa960ec2c345d3efde9d443ec9346c60ce30ae517c361e112f
BLAKE2b-256 checksum
How to use checksums
493b78ffceeff33169e6d242543e161d7d8263870dcbfba9632eec06cf219e9c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.8.2
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page