url2pg - v0.1.0
This repository ingests data from a CSV/Parquet url into a Postgres table overwriting the previous table if it exists.
Installation
uv add url2pg
or
pip install url2pg
Usage:
url2pg \
--user=<postgres_user:default=root> \
--password=<postgres_password:default=root> \
--host=<postgres_host:default=localhost> \
--port=<postgres_port:default=5432> \
--db=<*_db> \
--table_name=<*_destiny_table> \
--url_file=<*_source_url>
You can use as a Docker image as well:
docker run -it \
--network=<*_destiny_network> \
cesarbouli/url2pg \
--user=<postgres_user:default=root> \
--password=<postgres_password:default=root> \
--host=<postgres_host:default=localhost> \
--port=<postgres_port:default=5432> \
--db=<*_db> \
--table_name=<*_destiny_table> \
--url_file=<*_source_url>
In your docker compose file:
services:
ingestion-data:
image: cesarbouli/url2pg
command: --db=<_db_> (...)
(...)
Docker image: https://hub.docker.com/r/cesarbouli/url2pg \
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
url2pg-0.1.0.tar.gz
(2.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file url2pg-0.1.0.tar.gz.
File metadata
- Download URL: url2pg-0.1.0.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.9.17 {"installer":{"name":"uv","version":"0.9.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2904465a3881ec152080e51666d1a3497d6f9868915bcdfd109d66f340c7180a
|
|
| MD5 |
23766e07ae1dd5937c4820b1fcb97533
|
|
| BLAKE2b-256 |
3e726c7787e606272e76f8cc6166c855f9630042b8a1a795dd9ab0b136112b04
|
File details
Details for the file url2pg-0.1.0-py3-none-any.whl.
File metadata
- Download URL: url2pg-0.1.0-py3-none-any.whl
- Upload date:
- Size: 3.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.9.17 {"installer":{"name":"uv","version":"0.9.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
36d041d67ce7ffb07f469e55309e74b7dc526163ecf8038c05fc9f76c4dcb2aa
|
|
| MD5 |
77458f04438db6679c6ca1ead2adebf2
|
|
| BLAKE2b-256 |
0f94a0ef7655840446b468be8eb5c027668eb8507ad4ea3cf29556152745a6a0
|
