Simple decorator for multiprocessing and psql insertion
Project description
gerardo
gerardo provides decorators to easily compute in parallel and store the results in a PostgreSQL database.
Usage
See examples/example.py
for more details.
from gerardo import psql_mp_insert, psql_handler
# Set a PostgreSQL handler
pghost = os.environ["PGHOST"]
DSN = {
"host": pghost,
"port": "",
"user": "",
"password": "",
"dbname": "example_db",
}
PSQL_TABLE = "test_table"
COLUMNS = [('x', 'INT'), ('y', 'INT')]
PH = psql_handler(DSN, PSQL_TABLE, COLUMNS)
# Define a single-variable function.
@psql_mp_insert(PH)
def f(x):
return (x[0]+x[1], x[0]*x[1])
# Compute by forming a list of arguments
list_args = [(x, y) for x in range(5) for y in range(10)]
f(list_args)
Installation
pip install gerardo --user
Homepage
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gerardo-0.1.1.tar.gz
(2.8 kB
view hashes)