Package to sync tables across DBs, i.e. EL in ELT/ETL
Project description
dbrep
Package to sync tables across DBs, i.e. EL in ELT/ETL
What it is
It is tool for loading data from one DB and uploading into another. That is it. It is the simplest EL-tool.
What it is NOT
- It is NOT orchestrator. You may use existing one, like Airflow, Prefect or Dagster.
- It is NOT data transformation tool. You may use DBT or others.
- It is NOT data ingestion tool -- it won't grab data from external resources.
Distinctive features
Simple
It does not try to solve miriad of problems, but nicely fits into existing data-engineering stack with (airflow, dbt and other tools).
Stateless
It does not store state of jobs or tables, besides connection configs.
Robust
Since it is stateless there is only a handful of things that could go wrong.
Type-aware
Types are not lost in translation. I.e. if it was a number(10,0) in Oracle, it won't suddenly become a Float64 in ClickHouse.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dbrep-0.0.12.tar.gz
(16.2 kB
view hashes)
Built Distribution
dbrep-0.0.12-py3-none-any.whl
(20.0 kB
view hashes)