Skip to main content

Shared utilities for Investify services

Project description

investify-utils

Shared utilities for Investify services.

Installation

# Sync PostgreSQL client (psycopg3 + SQLAlchemy + pangres)
pip install investify-utils[postgres]

# Async PostgreSQL client (asyncpg + SQLAlchemy)
pip install investify-utils[postgres-async]

PostgreSQL Clients

Sync Client (PostgresClient)

Uses psycopg3 + SQLAlchemy for connection pooling, pangres for upsert.

from investify_utils.postgres import PostgresClient

client = PostgresClient(
    host="localhost",
    port=5432,
    username="user",
    password="pass",
    database="db",
    # SQLAlchemy pool options
    pool_size=5,
    pool_recycle=3600,
)

# Read
df = client.read("SELECT * FROM table")

# Insert (uses COPY protocol)
client.insert(df, table="my_table", schema="public")

# Upsert (DataFrame index = primary keys)
df = df.set_index(["id"])
client.upsert(df, table="my_table", schema="public")

# Execute DDL/DML
client.execute("DELETE FROM table WHERE id = 1")

# Close (important for Celery workers)
client.close()

Async Client (AsyncPostgresClient)

Uses asyncpg + SQLAlchemy async engine. Read-only.

from investify_utils.postgres import AsyncPostgresClient

client = AsyncPostgresClient(
    host="localhost",
    port=5432,
    username="user",
    password="pass",
    database="db",
    # SQLAlchemy pool options
    pool_size=5,
    pool_recycle=3600,
)

# In async context
df = await client.read("SELECT * FROM table")
await client.close()

# Or as context manager
async with AsyncPostgresClient(...) as client:
    df = await client.read("SELECT * FROM table")

Celery Integration

Both clients use lazy initialization, safe for Celery prefork workers.

# instances/postgres_core.py
from investify_utils.postgres import PostgresClient
from config import settings

postgres_core = PostgresClient(**settings.postgres.model_dump())
# celery_app.py
from celery.signals import worker_process_init

@worker_process_init.connect
def init_worker(**_kwargs):
    # Reset engine for each worker (optional with lazy init)
    from instances.postgres_core import postgres_core
    postgres_core.close()

Development

uv sync
uv run ruff check investify_utils/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

investify_utils-2.0.0a11.tar.gz (11.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

investify_utils-2.0.0a11-py3-none-any.whl (16.4 kB view details)

Uploaded Python 3

File details

Details for the file investify_utils-2.0.0a11.tar.gz.

File metadata

  • Download URL: investify_utils-2.0.0a11.tar.gz
  • Upload date:
  • Size: 11.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.0

File hashes

Hashes for investify_utils-2.0.0a11.tar.gz
Algorithm Hash digest
SHA256 cd97199264404114bfa9b2cf693af194da8349ce39a484eca68bfe98d3445274
MD5 286df8bfa4d58afc0bad35a909db576d
BLAKE2b-256 8ca5304c92fdbfbcc11c752d7a3b5f553994ef35bf49baeb9dd2cc9b11f7fb84

See more details on using hashes here.

File details

Details for the file investify_utils-2.0.0a11-py3-none-any.whl.

File metadata

File hashes

Hashes for investify_utils-2.0.0a11-py3-none-any.whl
Algorithm Hash digest
SHA256 c43cef10359bda32aa4423e26e6c0972cb3c3403ebb77dc4a2d58f9a3d1f2254
MD5 aafa9bae0ddff561bded632cd6f56de9
BLAKE2b-256 d350db79f76973e71e9c034f2b3a5e78799b20a65adbde610db1a75fb4df6073

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page