Copy data from MySQL to PostgreSQL
Project description
MySQL to PostgreSQL
Copy rows from MySQL to PostgreSQL quickly.
Example
Example
export PGHOST=localhost
export PGUSER=postgres
export MYSQL_DATABASE=example
export MYSQL_HOST=127.0.0.1
export MYSQL_USER=root
docker run -d -e MYSQL_ALLOW_EMPTY_PASSWORD=true -e MYSQL_DATABASE -p 3306:3306 --name mysql --rm mysql
mysql -D "$MYSQL_DATABASE" -u "$MYSQL_USER" <<EOF
CREATE TABLE example (a int, b text);
INSERT INTO example (a, b) VALUES (1, 'a'), (2, 'b'), (3, 'c');
EOF
docker run -d -e POSTGRES_HOST_AUTH_METHOD=trust -p 5432:5432 --name postgres --rm postgres
psql <<EOF
CREATE TABLE example (a int, b text);
EOF
mysql2pg
psql <<EOF
TABLE example;
EOF
docker stop mysql
docker stop postgres
INFO Found 1 tables
INFO Truncating 1 tables
INFO Copying table example
INFO Copied 3 rows to table example (0.00s)
a | b
---+---
1 | a
2 | b
3 | c
(3 rows)
Install
pip3 install mysql2pg
Documentation
Mysql2pg copies records from MySQL tables to existing PostgreSQL tables.
Mysql2pg also resets sequences, based on the maximum column value.
Performance is limited by network bandwidth, database resources, record size, and parallelism. In anecdotal usage, performance is 1m+ records/min serially.
Usage
usage: mysql2pg [-h] [--log-level {critical,error,warning,info,debug}] [--parallelism PARALLELISM]
[--pg-search-path PG_SEARCH_PATH]
[tables ...]
Copy records from MySQL to PostgreSQL
positional arguments:
tables
options:
-h, --help show this help message and exit
--log-level {critical,error,warning,info,debug}
--parallelism PARALLELISM
Number of tables to process in parallel (default: 10)
--pg-search-path PG_SEARCH_PATH
PostgreSQL search path (default: None)
Supported
- Parallelism
- Foreign keys
- PostgreSQL schema
Not supported
- Creating PostgreSQL tables. If you need to convert schema, look at other tools like mysql2postgres.
Implementation
-
MySQL tables are discovered.
-
PostgreSQL tables are truncated.
-
PostgreSQL triggers (including foreign keys) are disabled.
-
Records are streamed from MySQL and uploaded to PostgreSQL via the COPY command.
-
Sequences are discovered and reset based on the maximum value in the column.
Tables are processed in parallel.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mysql2pg-1.4.1.tar.gz
.
File metadata
- Download URL: mysql2pg-1.4.1.tar.gz
- Upload date:
- Size: 4.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d69763aac84be3954fc84ad8084a7e3de71ed576dd8ba8290755e86c6502a13 |
|
MD5 | d03870881923b9853673cea7cd00f1c4 |
|
BLAKE2b-256 | 13fd5766aed89ebd22fdbd72e6517747236e736f83206752c293ca1b21fd44ee |
File details
Details for the file mysql2pg-1.4.1-py3-none-any.whl
.
File metadata
- Download URL: mysql2pg-1.4.1-py3-none-any.whl
- Upload date:
- Size: 3.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dd83c0c92d4d65890a52a997247d61b17ab7dcb0ce95f1bd2974fe14904257e1 |
|
MD5 | e005c4439df01cc4636cb85485ce6aa8 |
|
BLAKE2b-256 | 9c630a44dbebd1d185edfce8a66f7b9458e5eac53901efc09d8900c06752fe68 |