A python command line tool to provide the commands necessary to run on citus to have a balanced cluster
Project description
# Citus loader
Citus loader is a tool that will allow you to do dump and restore on citus formations.
Here is how it works:
## citus-dump
The command citus-dump will:
Do a schema dump of your formation
Create a file with the distribute statements
Take a pg_dump of each of your nodes and coordinator.
Here are the options you can configure:
host: should the the host of your initial formation
db: database you want to dump
port: default 5432
pwd: password
pg_dump: if necessary, the path to the pg_dump you want to use
pg_dump_jobs: value of the –jobs argument in pg_dump
parallel_tasks: number of pg_dump tasks running in parallel
dump_schema: default True, take a pg_dump of the schema
dump_data: default True, take a pg_dump of the data
ignore_write_locks: by default, citus-dump will try to lock the tables to ensure that before running pg_dump, no insert/update/delete statement is running on the workers.
config_file: path to your yaml file with the configuration for the citus-dump command
We strongly recommend using a yaml configurattion file. You can find an example in tests/configuration.yml
## citus-restore
On your destination formation, citus-restore will:
Restore the schema
Distribute the tables
Restore the shards to their appropriate worker.
host: should the the host of your destination formation
db: database you want to reestore
port: default 5432
pwd: password
pg_restore: if necessary, the path to the pg_dump you want to use
pg_restore_jobs: value of the –jobs argument in pg_restore
parallel_tasks: number of pg_dump tasks running in parallel
restore_schema: default True, restores the schema and distribute the tables
restore_data: default True, does a pg_restore of the shards data
config_file: path to your yaml file with the configuration for the citus-restore command
We strongly recommend using a yaml configurattion file. You can find an example in tests/configuration.yml
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for py_citus_loader-1.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f08b8eb647d9e3250e2c0d5c1844701957ee60cc06091f49b40513f648c2cd27 |
|
MD5 | 8908fa8b673c3ecc652d3826df974a98 |
|
BLAKE2b-256 | ad9aef461f8e9d06d35d24baff3058b9ab2f82cd8a82de4918ac5ecac95f355e |