Skip to main content

Conduct quality assurance testing on database tables

Project description

The SQL Test module assists in testing of data between SQL database tables. This is the development version of the module.

Use examples include comparing data in a view to those in a table derived from a star schema, or comparing results from a table derived from an external source to a table built via ETL.

Main Features

  • Class: SQLTest

    1. Creates and runs SQL database queries based on attributes provided with class instantiation or custom SQL query string.
    2. Completes five built in tests based on field-type categorizations of count, low_distinct, high_distinct, numeric, id_check.
    3. Flags fields above a specified difference threshold for "priority review".
    4. Displays a summary of results.
    5. Saves results and summary as specified.
  • Function: compare_tables

    1. Auto-detects the type of test to be run.
    2. Utilizes methods of SQLUnitTest to complete a full comparison of table values.
  • Function: sql_query

    1. Conducts basic database queries

Functionality Overview

The concept behind the testing is that database information can often be segmented by a field, such as dates. Testing can be done by comparing field values across these groupings. For a more detailed description of the available functionality, check out the development page.

Basic Query

Run Test Battery

Setup Code

A summarized version of results (as a DataFrame or image), indicating the percentage difference between table fields (and the test type used), is available via the test battery.

Visual Summary

Setup

First Installation

The files sql_secrets.py and sql_config.py provide examples of how the SQLAlchemy engines can be configured. These files should be customized for personal use. You can find these files in your Python/environment directory under Lib/site-packages/sql_test/.

When updating these files, do not change the name or location of the files. Doing so will cause errors in the future if updating.

Dependencies

All dependencies are downloaded on installation if not already present. This module utilizes:

Acknowledgements

Testing is completed using the PostgreSQL DVD Rental sample database.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for sql-test, version 0.1.5
Filename, size File type Python version Upload date Hashes
Filename, size sql_test-0.1.5-py3-none-any.whl (16.0 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size sql_test-0.1.5.tar.gz (16.1 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page