Skip to main content

Shared utilities for Investify services

Project description

investify-utils

Shared utilities for Investify services.

Installation

# Sync PostgreSQL client (psycopg3 + SQLAlchemy + pangres)
pip install investify-utils[postgres]

# Async PostgreSQL client (asyncpg + SQLAlchemy)
pip install investify-utils[postgres-async]

PostgreSQL Clients

Sync Client (PostgresClient)

Uses psycopg3 + SQLAlchemy for connection pooling, pangres for upsert.

from investify_utils.postgres import PostgresClient

client = PostgresClient(
    host="localhost",
    port=5432,
    username="user",
    password="pass",
    database="db",
    # SQLAlchemy pool options
    pool_size=5,
    pool_recycle=3600,
)

# Read
df = client.read("SELECT * FROM table")

# Insert (uses COPY protocol)
client.insert(df, table="my_table", schema="public")

# Upsert (DataFrame index = primary keys)
df = df.set_index(["id"])
client.upsert(df, table="my_table", schema="public")

# Execute DDL/DML
client.execute("DELETE FROM table WHERE id = 1")

# Close (important for Celery workers)
client.close()

Async Client (AsyncPostgresClient)

Uses asyncpg + SQLAlchemy async engine. Read-only.

from investify_utils.postgres import AsyncPostgresClient

client = AsyncPostgresClient(
    host="localhost",
    port=5432,
    username="user",
    password="pass",
    database="db",
    # SQLAlchemy pool options
    pool_size=5,
    pool_recycle=3600,
)

# In async context
df = await client.read("SELECT * FROM table")
await client.close()

# Or as context manager
async with AsyncPostgresClient(...) as client:
    df = await client.read("SELECT * FROM table")

Celery Integration

Both clients use lazy initialization, safe for Celery prefork workers.

# instances/postgres_core.py
from investify_utils.postgres import PostgresClient
from config import settings

postgres_core = PostgresClient(**settings.postgres.model_dump())
# celery_app.py
from celery.signals import worker_process_init

@worker_process_init.connect
def init_worker(**_kwargs):
    # Reset engine for each worker (optional with lazy init)
    from instances.postgres_core import postgres_core
    postgres_core.close()

Development

uv sync
uv run ruff check investify_utils/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

investify_utils-2.0.0a9.tar.gz (12.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

investify_utils-2.0.0a9-py3-none-any.whl (18.0 kB view details)

Uploaded Python 3

File details

Details for the file investify_utils-2.0.0a9.tar.gz.

File metadata

  • Download URL: investify_utils-2.0.0a9.tar.gz
  • Upload date:
  • Size: 12.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.0

File hashes

Hashes for investify_utils-2.0.0a9.tar.gz
Algorithm Hash digest
SHA256 31ec25e92915e4d491ffe9923ba4c78a28b61fcfd7eda9e0391feae786897335
MD5 1eee8a071891d3a2d16263e00216c510
BLAKE2b-256 941fc791fe4809096ea2a2dceb6bd68e47828faf5449795f27e6f54863bb51ca

See more details on using hashes here.

File details

Details for the file investify_utils-2.0.0a9-py3-none-any.whl.

File metadata

File hashes

Hashes for investify_utils-2.0.0a9-py3-none-any.whl
Algorithm Hash digest
SHA256 2fda3b7a6f29d7a44353764988407fbf7cffab7edd32a9bb5b531ee30385c873
MD5 6907eb434a25abcc38290f5a17ee5b83
BLAKE2b-256 f79cd6ad626f427b47ef780a2828beebd55c7254e3f02f8c4aa69ccbe4c607d7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page