TopMind ETL converter
Project description
ETL table converter
config-from db to db dialect - sql-alchemy dialect
sql_credentials = {
"pg": {
"dialect": "postgresql",
"database": os.getenv("PG_DATABASE"),
"schema": os.getenv("PG_SCHEMA"),
"user": os.getenv("PG_USER"),
"host": os.getenv("PG_HOST"),
"port": os.getenv("PG_PORT"),
"password": os.getenv("PG_PASSWORD")
},
"ch": {
"dialect": "clickhouse+native",
"database": os.getenv("CH_DATABASE"),
"user": os.getenv("CH_USER"),
"host": os.getenv("CH_HOST"),
"port": os.getenv("CH_PORT"),
"password": os.getenv("CH_PASSWORD")
},
"vertica": {
"dialect": "vertica+vertica_python",
"database": os.getenv("VERTICA_DATABASE"),
"schema": os.getenv("VERTICA_SCHEMA"),
"user": os.getenv("VERTICA_USER"),
"host": os.getenv("VERTICA_HOST"),
"port": os.getenv("VERTICA_PORT"),
"password": os.getenv("VERTICA_PASSWORD")
},
}
Usage
pip3 install etl-table-converter-talenttech-oss
from converter.fields_converter import FieldsConverter
from_db="vertica"
to_db="ch"
converter = FieldsConverter(sql_credentials, from_db, to_db)
tables = [
"table_name1",
"table_name2"
]
converter.create_list_of_tables(tables, dir="/")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for etl-table-converter-talenttech-oss-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 115237d1a72e04e449f9a998f7fa04eb2433a5cf817b4ccf5ec50568ed2ad602 |
|
MD5 | df9de02afdee8547c377be0f414dff8a |
|
BLAKE2b-256 | c16ca106a16af7968df925b31ef0700c23e8011ad1b0c748be6e2818dc2132f0 |
Close
Hashes for etl_table_converter_talenttech_oss-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e796f6b0566f6aae6ce143bded7c53038b96896a2c4e5c7dea794bd204e2c82c |
|
MD5 | a499297aeab360e67a7eb3017df63cc2 |
|
BLAKE2b-256 | 8ac5899b00d19cdc5c7107c26d689f6ce9462e57508261a3629772ddb6c98afa |