Skip to main content

A simple SQL database helper package for Python.

Project description

SQLPyHelper

PyPI version Documentation PyPI downloads Python versions License: MIT GitHub stars

SQLPyHelper is a lightweight Python library that gives you a single, consistent API across SQLite, PostgreSQL, MySQL, SQL Server, and Oracle โ€” without the overhead of an ORM.

If you need to run queries, manage transactions, pool connections, or back up tables across multiple database types without learning SQLAlchemy's abstraction layer or wiring up five different drivers manually, SQLPyHelper handles that boilerplate for you.

# Works identically across all five supported databases
with SQLPyHelper(db_type="postgres", host="localhost", user="user", 
                 password="pass", database="mydb") as db:
    db.execute_query("INSERT INTO orders (item) VALUES (%s)", ("Laptop",))
    results = db.fetch_all()

๐Ÿ“– Table of Contents


๐Ÿš€ Features in v0.1.8

  • Unified connection pooling for multiple databases.
  • Automatic reconnection for lost connections.
  • Transaction support (BEGIN, ROLLBACK, COMMIT).
  • Secure parameterized queries to prevent SQL injection.
  • Bulk insertion & dynamic table creation.
  • Logging & error handling for better debugging.
  • CSV export & database backups.
  • Cross-database migration โ€” copy tables between any two supported databases.
  • Async support โ€” AsyncSQLPyHelper for FastAPI and asyncio applications.

๐Ÿ“ฆ Installation

Install the base package (includes SQLite support out of the box):

pip install sqlpyhelper

Install with your database driver:

pip install sqlpyhelper[postgres]    # PostgreSQL
pip install sqlpyhelper[mysql]       # MySQL
pip install sqlpyhelper[sqlserver]   # SQL Server
pip install sqlpyhelper[oracle]      # Oracle
pip install sqlpyhelper[all]         # All databases

๐Ÿ“Œ Package on PyPI: SQLPyHelper on PyPI

For local development:

git clone https://github.com/adebayopeter/sqlpyhelper.git
cd sqlpyhelper
pip install -r requirements.txt

โš™๏ธ Setup Using .env

Create a .env file in your project root to manage database configurations securely by renaming .env_example.

# .env_example (Rename to .env)
DB_TYPE=postgres
DB_HOST=localhost
DB_USER=your_user
DB_PASSWORD=your_secure_password
DB_NAME=database_name
DB_DRIVER={ODBC Driver 17 for SQL Server}
ORACLE_SID=XE
ORACLE_DB_PORT=1521

Loading .env in Code

from dotenv import load_dotenv
import os

load_dotenv()
db_type = os.getenv("DB_TYPE")
host = os.getenv("DB_HOST")
user = os.getenv("DB_USER")
password = os.getenv("DB_PASSWORD")
database = os.getenv("DB_NAME")

๐Ÿ›  Usage Examples

Initialize SQLPyHelper

from sqlpyhelper.db_helper import SQLPyHelper
db = SQLPyHelper()  # Auto-detects database type based on `DB_TYPE`

SQLite Example

db.execute_query("CREATE TABLE users (id INTEGER PRIMARY KEY, name TEXT)")
db.execute_query("INSERT INTO users (name) VALUES (?)", ("Alice",))
print(db.fetch_all()) # Expected Output: [(1, 'Alice')]
db.close()

PostgreSQL Example

db.execute_query("CREATE TABLE customers (id SERIAL PRIMARY KEY, name TEXT)")
db.execute_query("INSERT INTO customers (name) VALUES (%s)", ("Bob",))
db.begin_transaction()
db.execute_query("DELETE FROM customers WHERE name=%s", ("Bob",))
db.rollback_transaction()  # Undo delete

MySQL Example

db.execute_query("CREATE TABLE users (id INT PRIMARY KEY, name VARCHAR(100))")
db.execute_query("INSERT INTO users (id, name) VALUES (%s, %s)", (1, "Alice"))
print(db.fetch_by_param("users", "id", 1))  # Expected Output: [(1, 'Alice')]
db.close()

SQL Server Example

db.execute_query("CREATE TABLE orders (order_id INT PRIMARY KEY, item NVARCHAR(100))")
db.insert_bulk("orders", [{"order_id": 1, "item": "Laptop"}, {"order_id": 2, "item": "Mouse"}])
db.backup_table("orders", "orders_backup.csv")  # Export data to CSV

Oracle Example

db.execute_query("CREATE TABLE employees (id NUMBER PRIMARY KEY, name VARCHAR2(100))")
db.execute_query("INSERT INTO employees (id, name) VALUES (:1, :2)", (1, "Charlie"))
db.setup_connection_pool(min_conn=2, max_conn=10)  # Enable pooling for better performance
conn = db.get_connection_from_pool()
db.return_connection_to_pool(conn)

Async Example (FastAPI / asyncio)

import asyncio
from sqlpyhelper.async_helper import AsyncSQLPyHelper

async def main():
    async with AsyncSQLPyHelper(db_type="sqlite", database="my.db") as db:
        await db.execute(
            "CREATE TABLE IF NOT EXISTS users (id INTEGER, name TEXT)"
        )
        await db.execute(
            "INSERT INTO users VALUES ($1, $2)", 1, "Alice"
        )
        rows = await db.fetch_all("SELECT * FROM users")
        print(rows)

asyncio.run(main())

๐Ÿ“‚ Project Structure

๐Ÿ“ฆ SQLPyHelper/
โ”œโ”€ sqlpyhelper/
โ”‚  โ”œโ”€ __init__.py
โ”‚  โ”œโ”€ db_helper.py
โ”‚  โ”œโ”€ async_helper.py
โ”‚  โ”œโ”€ automation_utils.py
โ”‚  โ”œโ”€ cli.py
โ”‚  โ””โ”€ migration.py
โ”œโ”€ test/
โ”‚  โ”œโ”€ test_sqlpyhelper.py
โ”‚  โ”œโ”€ test_async_helper.py
โ”‚  โ””โ”€ test_migration.py
โ”œโ”€ docs/
โ”œโ”€ .env_example
โ”œโ”€ .gitignore
โ”œโ”€ setup.py
โ”œโ”€ setup.cfg
โ”œโ”€ pyproject.toml
โ”œโ”€ CHANGELOG.md
โ”œโ”€ CONTRIBUTING.md
โ”œโ”€ pre-commit.sh
โ”œโ”€ README.md
โ””โ”€ requirements.txt

๐Ÿ“Œ Available Methods in SQLPyHelper

Method Description
execute_query(query, params=None) Executes a SQL query with optional parameters.
fetch_one() Retrieves a single row from query results.
fetch_all() Retrieves all rows from query results.
fetch_by_param(table, column, value) Fetches rows dynamically based on a given parameter.
create_table(table_name, columns_dict) Creates a table dynamically with a dictionary format.
insert_bulk(table, data_list) Inserts multiple rows at once efficiently.
backup_table(table, backup_file.csv) Exports table data to CSV format.
setup_connection_pool() Initializes database connection pooling.
get_connection_from_pool() Fetches a connection from the pool.
return_connection_to_pool(conn) Returns connection back to pool.
begin_transaction() Begins an explicit transaction.
rollback_transaction() Rolls back uncommitted transactions.
commit_transaction() Commits the current transaction.
close() Closes the database connection safely.
__enter__ / __exit__() Use as a context manager โ€” connection closes automatically.
AsyncSQLPyHelper Async-native class for FastAPI/asyncio โ€” see Async docs.

๐ŸŒ Contributing

We welcome contributions from the open-source community! Follow these steps to contribute:

  1. Fork the repo: SQLPyHelper GitHub Repository
  2. Clone your fork:
    git clone https://github.com/adebayopeter/sqlpyhelper.git
    
  3. Create a new branch:
    git checkout -b feature-new-functionality
    
  4. Make changes, commit, and push:
    git commit -m "Added new feature"
    git push origin feature-new-functionality
    
  5. Submit a Pull Request!

โ˜• Support the Project

If you find SQLPyHelper useful, consider buying me a coffee to support continued development! Donate Here: PayPal

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlpyhelper-0.2.1.tar.gz (24.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sqlpyhelper-0.2.1-py3-none-any.whl (20.8 kB view details)

Uploaded Python 3

File details

Details for the file sqlpyhelper-0.2.1.tar.gz.

File metadata

  • Download URL: sqlpyhelper-0.2.1.tar.gz
  • Upload date:
  • Size: 24.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for sqlpyhelper-0.2.1.tar.gz
Algorithm Hash digest
SHA256 30cf3301aecc3af7e724f623a94521d1b9d8a0b8d326ea32a616b550e1405f78
MD5 87c7542ec6fdac7a2a6bc78eac04bf55
BLAKE2b-256 d9e5986e669707eae3cdc8d80498be4d818671b802adc046bce91b4c93d13b13

See more details on using hashes here.

File details

Details for the file sqlpyhelper-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: sqlpyhelper-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 20.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for sqlpyhelper-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 76b09c0da72910513ceb334f7e9e1e3529d3e5d2ce3be5ea61cb6640b18bd865
MD5 4011ad9735eeba3db468c60bf33d836c
BLAKE2b-256 5c95ca290b97a50f55a76cc3027b0318bdff503adea3bdf44a2293f16a686f01

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page