Export PostgreSQL databases to Google Cloud Platform BigQuery
Project description
PostgreSQL to BigQuery
Install with: pip install psql2bigquery
Get usage instructions with: psql2bigquery run --help
Sample usage
poetry run psql2bigquery run \
--db-host localhost \
--db-port 5432 \
--db-user username \
--db-password secret-password \
--db-name my_api \
--gcp-project my-project \
--gcp-dataset my_api \
--include table_name_a \
--include table_name_b \
--gcp-credential-path /path/to/credential.json
Logging
There's a possibility to use Sentry.io for error logging.
Just set the environment variable SENTRY_DSN
and psql2bigquery will automatically configure the logger.
Additionally, the environment variable ENV
can be used as Sentry environment.
Contributing
- Fork this project
- Install dependencies with
make dependencies
- Make sure you have Python 3 installed. (pyenv)[https://github.com/pyenv/pyenv#installation] is highly recommended
- You can test the client locally (without installing the package) with
poetry run psql2bigquery <command>
- Make a PR with as much details as possible
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
psql2bigquery-0.0.3.tar.gz
(6.3 kB
view hashes)
Built Distribution
Close
Hashes for psql2bigquery-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2a130f2e5d83a8e5a128a03fea26bdb994e96e11d8c6fc21cbda0d594b85f1f |
|
MD5 | a2921650c08d605c5e854bc443848842 |
|
BLAKE2b-256 | cc17c5273bce3bb9c31d0602cfbfa81779b9548276ba710297b445d32d3a8afe |