PiperRider CLI
Project description
PipeRider: Data Reliability Automated
PipeRider ensures data reliability through automating constant data testing and monitoring.
Key Features:
- Instant quality assessment in HTML report: sample report
- Report comparison: sample comparsion report
- Extensible custom assertions
- Works with existing dbt projects
- Automatic test recommendations
Read more about why we created PipeRider.
Getting started
Install PipeRider
pip install piperider
By default, PipeRider supports built-in SQLite connector, extra connectors are available:
connectors | install | supported since |
---|---|---|
snowflake | pip install 'piperider[snowflake]' | |
postgres | pip install 'piperider[postgres]' | |
bigquery | pip install 'piperider[bigquery]' | PipeRider v0.7.0 |
redshift | pip install 'piperider[redshift]' | PipeRider v0.7.0 |
duckdb | pip install 'piperider[duckdb]' | PipeRider v0.8.0 |
csv | pip install 'piperider[csv]' | PipeRider v0.8.0 |
parquet | pip install 'piperider[parquet]' | PipeRider v0.8.0 |
Use comma to install multiple connectors in one line:
pip install 'piperider[postgres,snowflake]'
You can follow the quick start guide to learn more about PipeRider.
Attach PipeRider to a dbt project
piperider init
creates /.piperider
under a dbt project root and generates necessary configurations.
Scan data quality from models
piperider run
scans the models from data sources and creates assessment results in /.piperider/output
Generate reports
piperider generate-report
generate a static HTML report.
Generate comparison view
You can use piperider compare-report
to compare 2 reports.
Learn More
PipeRider Resources | Description |
---|---|
Documentation | PipeRider Main Doc Site |
Sample_Project | Sample Project with with sqlite |
dbt_Sample_Project | Sample Project with dbt |
Roadmap | PipeRider Roadmap |
Get involved
Contributions
We welcome contributions. See the Set up dev environment and the Contributing guildline to get started.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for piperider-nightly-0.9.0.20220912.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16fcf5184b39226ff916fb5730ebd6eab44b65d8d51bdf7191e1a03792adefab |
|
MD5 | 2e18445ac1ecb39ecb71eca2f679d329 |
|
BLAKE2b-256 | e410038ed1a9bfca7e36edecf3818ef6cf196ff626014b6a30a255ca924bd588 |
Hashes for piperider_nightly-0.9.0.20220912-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9226e69fc071320c0d5ecee76befbb1f3bc818c96436596307ba8f5906b2c0e0 |
|
MD5 | d36cd2b797b8b7172773c1bb8ee7cad2 |
|
BLAKE2b-256 | dc7f53b204349c0c094ea6ddb0bd85417d8c58bc552cadc40a19d8211b98ef51 |