Skip to main content

A Python package that seamlessly integrates PostgreSQL, Jinja templating, and Pydantic for type-safe database queries

Project description

pgjinja

A Python library that combines PostgreSQL with Jinja2 templates to create dynamic SQL queries with a clean, async interface.

Description

pgjinja simplifies database interactions by allowing you to:

  • Keep SQL queries in separate template files
  • Use Jinja2 templating for dynamic query generation
  • Execute queries asynchronously
  • Automatically map query results to Pydantic models

This approach helps separate SQL logic from application code, making your database interactions more maintainable and testable.

Installation

pip install pgjinja

Usage Example

Here's a simple example of how to use pgjinja to query merchants from a database:

# src/my_db.py
from functools import cache

from src.models.merchant import Merchant

from src.postgres import PostgresAsync


# Create a PostgreSQL connection
@cache
def get_postgres():
    return PostgresAsync(
        user="user",
        password="password",
        host="dev.postgres",
        template_dir="template",
        dbname="dbname",
    )


# Query using a template with parameters
async def select_merchant(limit: int = 3) -> list[Merchant]:
    params = dict(limit=limit)
    template = "select_merchant.sql.jinja"
    return await get_postgres().query(template, params, Merchant)

# Add other database operations here
# ...
# main.py
import asyncio

import src.my_db as db


# Example usage
async def main():
    merchants = await db.select_merchant(limit=5)  # clean and very readable
    # Even with a more complex query, the interface is still the same

    print(merchants)


if __name__ == "__main__":
    asyncio.run(main())

SQL Template Example

Create a file template/select_merchant.sql.jinja:

SELECT id, name
FROM merchants
WHERE active = true
ORDER BY name
LIMIT {{ limit }}

Configuration

The PostgresAsync class accepts the following configuration parameters:

Parameter Description Default
user PostgreSQL user (Required)
password PostgreSQL password (Required)
host Database host localhost
port Database port 5432
dbname Database name public
template_dir Directory containing SQL templates Current directory
template_extension File extension to append to template names Empty string

Asynchronous Execution and Connection Pooling

pgjinja leverages modern Python's async capabilities and PostgreSQL connection pooling for optimal performance:

  • Async/await pattern: All database operations use the async/await pattern for non-blocking execution
  • Connection pooling: Built-in connection pooling via psycopg_pool reduces connection overhead
  • Resource management: Connections are automatically returned to the pool after query execution
  • Concurrent queries: Multiple queries can be executed concurrently without blocking the main thread

This approach is particularly beneficial for web applications and API services where database operations should not block the event loop while waiting for results.

Dependencies

  • asyncio - For asynchronous operations
  • pydantic - For data validation and model mapping
  • jinjasql - For SQL templating with Jinja2
  • psycopg - PostgreSQL database adapter for Python
  • psycopg_pool - Connection pooling for psycopg

License

MIT License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgjinja-0.1.1.tar.gz (15.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgjinja-0.1.1-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file pgjinja-0.1.1.tar.gz.

File metadata

  • Download URL: pgjinja-0.1.1.tar.gz
  • Upload date:
  • Size: 15.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for pgjinja-0.1.1.tar.gz
Algorithm Hash digest
SHA256 665c4602501619f281732106490c28cab28dd04d9b37c3fcec71bd68a0c02c60
MD5 f80671878a3f192ad500a2753cda29ab
BLAKE2b-256 7cccd3f30ae3526d567846cdbe5b4441686cefef3d311a254a422aaf70c0d1dc

See more details on using hashes here.

File details

Details for the file pgjinja-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: pgjinja-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for pgjinja-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e0afa316f8562669f4c4f99d5dfb1f9d515c8144455583ce56bce04ada68700c
MD5 c623da5df8a089856673693767fdb20a
BLAKE2b-256 bf5460d755f7681c490d1524c1bab1c73a351ddfe24e1805ccb67130c2a70d3f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page