simple data validation
Project description
data_check
data_check is a simple data validation tool. Write SQL queries and CSV files with the expected result sets and data_check will test the result sets against the queries. You can also use CSV files to populate tables with data for pipeline tests with data_check.
data_check should work with any database that works with SQLAlchemy. Currently data_check is tested against PostgreSQL, MySQL, SQLite, Oracle and Microsoft SQL Server.
Quickstart
You need Python 3.6.2 or above to run data_check. The easiest way to install data_check is via pipx:
pipx install data-check
The data_check Git repository is also a sample data_check project. Clone the repository, switch to the folder and run data_check:
git clone git@github.com:andrjas/data_check.git
cd data_check
data_check
This will run the tests in the checks folder using the default connection as set in data_check.yml.
See the documentation how to install data_check in different environments with additional database drivers and other usages of data_check.
Project layout
data_check has a simple layout for projects: a single configuration file and a folder with the test files. You can also organize the test files in subfolders.
data_check.yml # The configuration file
checks/ # Default folder for data tests
some_test.sql # SQL file with the query to run against the database
some_test.csv # CSV file with the expected result
subfolder/ # Tests can be nested in subfolders
Documentation
See the documentation how to setup data_check, how to create a new project and more options.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for data_check-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7a27abfb67d2fb7b8a9c6bbe166b3e33932787587ef8952c3511ffd30fcda86 |
|
MD5 | 9db29d2d4b6e9de9e61ac76913a8fd9b |
|
BLAKE2b-256 | f28c4c30c1f30028ebdd30197b811fc71d7f8685726f218982ccd2c07afd0988 |