Skip to main content

Package to sync tables across DBs, i.e. EL in ELT/ETL

Project description

dbrep

Package to sync tables across DBs, i.e. EL in ELT/ETL

What it is

It is tool for loading data from one DB and uploading into another. That is it. It is the simplest EL-tool.

What it is NOT

  • It is NOT orchestrator. You may use existing one, like Airflow, Prefect or Dagster.
  • It is NOT data transformation tool. You may use DBT or others.
  • It is NOT data ingestion tool -- it won't grab data from external resources.

Distinctive features

Simple

It does not try to solve miriad of problems, but nicely fits into existing data-engineering stack with (airflow, dbt and other tools).

Stateless

It does not store state of jobs or tables, besides connection configs.

Robust

Since it is stateless there is only a handful of things that could go wrong.

Type-aware

Types are not lost in translation. I.e. if it was a number(10,0) in Oracle, it won't suddenly become a Float64 in ClickHouse.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbrep-0.0.12.tar.gz (16.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbrep-0.0.12-py3-none-any.whl (20.0 kB view details)

Uploaded Python 3

File details

Details for the file dbrep-0.0.12.tar.gz.

File metadata

  • Download URL: dbrep-0.0.12.tar.gz
  • Upload date:
  • Size: 16.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.14

File hashes

Hashes for dbrep-0.0.12.tar.gz
Algorithm Hash digest
SHA256 f4b64ff251fc3bd301a6155e0a29cb88b7a1040cb15a118a7156e67b40a8c443
MD5 789d8ed28aa93f80e006ab5a4fbe4615
BLAKE2b-256 195081de9de5af149ac188febd443a0e62c5d2a06e82464a25c9ee7591fd32f7

See more details on using hashes here.

File details

Details for the file dbrep-0.0.12-py3-none-any.whl.

File metadata

  • Download URL: dbrep-0.0.12-py3-none-any.whl
  • Upload date:
  • Size: 20.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.14

File hashes

Hashes for dbrep-0.0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 4a1f1eda4b5ee47334cac0d22011de4130f772af32a4c06153f61937934e6d45
MD5 381e9fb13fb720eec5db728225421afe
BLAKE2b-256 9d4a940a053ce2e3761902cbc73393fb11ee93bf0259f88150d3619a7c7ecc5f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page