PipeRider: Data Reliability Automated
PipeRider ensures data reliability through automating constant data testing and monitoring.
Key Features:
- Instant quality assessment in HTML report: sample report
- Report comparison: sample comparsion report
- Extensible custom assertions
- Works with existing dbt projects
- Automatic test recommendations
Read more about why we created PipeRider.
Getting started
Install PipeRider
pip install piperider
By default, PipeRider supports built-in SQLite connector, extra connectors are available:
| connectors | install | supported since |
|---|---|---|
| snowflake | pip install 'piperider[snowflake]' | |
| postgres | pip install 'piperider[postgres]' | |
| bigquery | pip install 'piperider[bigquery]' | PipeRider v0.7.0 |
| redshift | pip install 'piperider[redshift]' | PipeRider v0.7.0 |
| duckdb | pip install 'piperider[duckdb]' | PipeRider v0.8.0 |
| csv | pip install 'piperider[csv]' | PipeRider v0.8.0 |
| parquet | pip install 'piperider[parquet]' | PipeRider v0.8.0 |
Use comma to install multiple connectors in one line:
pip install 'piperider[postgres,snowflake]'
You can follow the quick start guide to learn more about PipeRider.
Attach PipeRider to a dbt project
piperider init creates /.piperider under a dbt project root and generates necessary configurations.
Scan data quality from models
piperider run scans the models from data sources and creates assessment results in /.piperider/output
Generate reports
piperider generate-report generate a static HTML report.
Generate comparison view
You can use piperider compare-report to compare 2 reports.
Learn More
| PipeRider Resources | Description |
|---|---|
| Documentation | PipeRider Main Doc Site |
| Sample_Project | Sample Project with with sqlite |
| dbt_Sample_Project | Sample Project with dbt |
| Roadmap | PipeRider Roadmap |
Get involved
Contributions
We welcome contributions. See the Set up dev environment and the Contributing guildline to get started.
1 maintainer
Metadata
1 maintainer
Release files for piperider-nightly 0.9.0.20220911
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| piperider-nightly-0.9.0.20220911.tar.gz | 3.6 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| piperider_nightly-0.9.0.20220911-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 7.3 MB
Release files / piperider-nightly-0.9.0.20220911.tar.gz
| Download URL | piperider-nightly-0.9.0.20220911.tar.gz |
|---|---|
| Size | 3.6 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
91a7a685a4aa8e310bcd27ae2a416aa66e852aeabd9018e5be4f52c81c61486b
|
|
BLAKE2b-256 checksum How to use checksums |
2c630b852242ff25d12df895771d7b66614a0b124a857532286d6a0090d9a733
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.8.13
|
Release files / piperider_nightly-0.9.0.20220911-py3-none-any.whl
| Download URL | piperider_nightly-0.9.0.20220911-py3-none-any.whl |
|---|---|
| Size | 3.7 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c692bd07b1674f33f7e92c7a6c2ac1a9dfd1fe2d5f892df6a39895efa0795f20
|
|
BLAKE2b-256 checksum How to use checksums |
d8f30334a9f25212f20a8a1fc4b2170d6fb44058ec33d474b4ed3bef1ddc50cf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.8.13
|
