re-data 0.2.0a0

re_data - data quality framework

re_data

re_data is a data quality framework. It lets you do queries similar to those:

select * from anomalies_in_row_counts;

select * from recent_schema_changes;

select * from all_tables_freshness order by last_update_time;

select * from daily_null_percent where table = 'X' and col = 'Y';

in your Snowflake, Redshift, BigQuery, Postgres DB.

Build as dbt-package & optional python lib.

It lets you know what's happening in your data.

And you can visualize it, any way you want in your favorite BI tool.

Getting started

Check out docs :notebook_with_decorative_cover: :notebook_with_decorative_cover:

Source code

As dbt packages, currenlty need to be a seperate github repos - most of source code of re_data is here

Community

Join Slack for questions about using re_data and discussion with people making it :slightly_smiling_face:

Integrations

We support almost all of the main data warehouses supported by dbt. We plan to add support for Spark (now officially supported by dbt).

Integration	Status
	BigQuery	Supported
	PostgreSQL	Supported
	Redshift	Supported
	Snowflake	Supported
	Apache Spark	Planned

License

re_data is licensed under the MIT license. See the LICENSE file for licensing information.

Contributing

We love all contributions :heart_eyes: bigger and smaller.

Check out the current list of issues here and see if you like anything from there. Also, feel welcome to join our Slack and suggest ideas or set up a live session here.

And if you got this far and like what we are building, support us! Star https://github.com/re-data/re-data on Github :star_struck: