Skip to main content

Datapunt Amsterdam postgres table partitioning module

Project description

# pg_partition
Utility to partition new/existing PostgreSql database tables. Data can be migrated. Only date range partition type is supported.

Required environment variables:
```
DATABASE_HOST : hostname/ip of the PostgreSql server
DATABASE_NAME : database to operate on
DATABASE_USER : PostgreSql login
DATABASE_PASSWORD : PostgreSql password
```

#### Install ####
```
pip install -r requirements.txt
```

#### Usage ####
```
usage: pg_partition.py [-h] {create,add} ...

positional arguments:
{create,add}

optional arguments:
-h, --help show this help message and exit
```

#### Create Usage ####
```
usage: pg_partition.py create [-h] [--type {day,week,month}] table column

positional arguments:
table table to be partitioned
column column to be used for range

optional arguments:
-h, --help show this help message and exit
--type {day,week,month}
```

#### Add Usage ####
```
usage: pg_partition.py add [-h] [--num NUM] [--date DATE]
table {day,week,month}

positional arguments:
table table to be partitioned
{day,week,month}

optional arguments:
-h, --help show this help message and exit
--num NUM partitions to create
--date DATE start date (yyyymmdd)
```

#### Creating partitions ####
```
# Convert 'table' to a range partitioned table by 'column'
# No data is migrated
python pg_partition.py create table column

# Convert 'table' to a range partitioned table by 'column'
# Data is migrated in week partitions
python pg_partition.py create table column --type week
```

#### Adding partitions ####
```
# Adds 10 day partitions starting from 20180101 to 'table'
python pg_partition.py add table day --num 10 --date 20180101

```


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
datapunt_pg_partitioning-2019.2.27.3-py3-none-any.whl (15.5 kB) Copy SHA256 hash SHA256 Wheel py3
datapunt-pg-partitioning-2019.2.27.3.tar.gz (5.5 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page