Skip to main content

A simple SQL database helper package for Python.

Project description

SQLPyHelper

PyPI version Documentation PyPI downloads Python versions License: MIT GitHub stars

SQLPyHelper is a lightweight Python library that gives you a single, consistent API across SQLite, PostgreSQL, MySQL, SQL Server, and Oracle โ€” without the overhead of an ORM.

If you need to run queries, manage transactions, pool connections, or back up tables across multiple database types without learning SQLAlchemy's abstraction layer or wiring up five different drivers manually, SQLPyHelper handles that boilerplate for you.

# Works identically across all five supported databases
with SQLPyHelper(db_type="postgres", host="localhost", user="user", 
                 password="pass", database="mydb") as db:
    db.execute_query("INSERT INTO orders (item) VALUES (%s)", ("Laptop",))
    results = db.fetch_all()

๐Ÿ“– Table of Contents


๐Ÿš€ Features in v0.1.8

  • Unified connection pooling for multiple databases.
  • Automatic reconnection for lost connections.
  • Transaction support (BEGIN, ROLLBACK, COMMIT).
  • Secure parameterized queries to prevent SQL injection.
  • Bulk insertion & dynamic table creation.
  • Logging & error handling for better debugging.
  • CSV export & database backups.
  • Cross-database migration โ€” copy tables between any two supported databases.
  • Async support โ€” AsyncSQLPyHelper for FastAPI and asyncio applications.

๐Ÿ“ฆ Installation

Install the base package (includes SQLite support out of the box):

pip install sqlpyhelper

Install with your database driver:

pip install sqlpyhelper[postgres]    # PostgreSQL
pip install sqlpyhelper[mysql]       # MySQL
pip install sqlpyhelper[sqlserver]   # SQL Server
pip install sqlpyhelper[oracle]      # Oracle
pip install sqlpyhelper[all]         # All databases

๐Ÿ“Œ Package on PyPI: SQLPyHelper on PyPI

For local development:

git clone https://github.com/adebayopeter/sqlpyhelper.git
cd sqlpyhelper
pip install -r requirements.txt

โš™๏ธ Setup Using .env

Create a .env file in your project root to manage database configurations securely by renaming .env_example.

# .env_example (Rename to .env)
DB_TYPE=postgres
DB_HOST=localhost
DB_USER=your_user
DB_PASSWORD=your_secure_password
DB_NAME=database_name
DB_DRIVER={ODBC Driver 17 for SQL Server}
ORACLE_SID=XE
ORACLE_DB_PORT=1521

Loading .env in Code

from dotenv import load_dotenv
import os

load_dotenv()
db_type = os.getenv("DB_TYPE")
host = os.getenv("DB_HOST")
user = os.getenv("DB_USER")
password = os.getenv("DB_PASSWORD")
database = os.getenv("DB_NAME")

๐Ÿ›  Usage Examples

Initialize SQLPyHelper

from sqlpyhelper.db_helper import SQLPyHelper
db = SQLPyHelper()  # Auto-detects database type based on `DB_TYPE`

SQLite Example

db.execute_query("CREATE TABLE users (id INTEGER PRIMARY KEY, name TEXT)")
db.execute_query("INSERT INTO users (name) VALUES (?)", ("Alice",))
print(db.fetch_all()) # Expected Output: [(1, 'Alice')]
db.close()

PostgreSQL Example

db.execute_query("CREATE TABLE customers (id SERIAL PRIMARY KEY, name TEXT)")
db.execute_query("INSERT INTO customers (name) VALUES (%s)", ("Bob",))
db.begin_transaction()
db.execute_query("DELETE FROM customers WHERE name=%s", ("Bob",))
db.rollback_transaction()  # Undo delete

MySQL Example

db.execute_query("CREATE TABLE users (id INT PRIMARY KEY, name VARCHAR(100))")
db.execute_query("INSERT INTO users (id, name) VALUES (%s, %s)", (1, "Alice"))
print(db.fetch_by_param("users", "id", 1))  # Expected Output: [(1, 'Alice')]
db.close()

SQL Server Example

db.execute_query("CREATE TABLE orders (order_id INT PRIMARY KEY, item NVARCHAR(100))")
db.insert_bulk("orders", [{"order_id": 1, "item": "Laptop"}, {"order_id": 2, "item": "Mouse"}])
db.backup_table("orders", "orders_backup.csv")  # Export data to CSV

Oracle Example

db.execute_query("CREATE TABLE employees (id NUMBER PRIMARY KEY, name VARCHAR2(100))")
db.execute_query("INSERT INTO employees (id, name) VALUES (:1, :2)", (1, "Charlie"))
db.setup_connection_pool(min_conn=2, max_conn=10)  # Enable pooling for better performance
conn = db.get_connection_from_pool()
db.return_connection_to_pool(conn)

Async Example (FastAPI / asyncio)

import asyncio
from sqlpyhelper.async_helper import AsyncSQLPyHelper

async def main():
    async with AsyncSQLPyHelper(db_type="sqlite", database="my.db") as db:
        await db.execute(
            "CREATE TABLE IF NOT EXISTS users (id INTEGER, name TEXT)"
        )
        await db.execute(
            "INSERT INTO users VALUES ($1, $2)", 1, "Alice"
        )
        rows = await db.fetch_all("SELECT * FROM users")
        print(rows)

asyncio.run(main())

๐Ÿ“‚ Project Structure

๐Ÿ“ฆ SQLPyHelper/
โ”œโ”€ sqlpyhelper/
โ”‚  โ”œโ”€ __init__.py
โ”‚  โ”œโ”€ db_helper.py
โ”‚  โ”œโ”€ async_helper.py
โ”‚  โ”œโ”€ automation_utils.py
โ”‚  โ”œโ”€ cli.py
โ”‚  โ””โ”€ migration.py
โ”œโ”€ test/
โ”‚  โ”œโ”€ test_sqlpyhelper.py
โ”‚  โ”œโ”€ test_async_helper.py
โ”‚  โ””โ”€ test_migration.py
โ”œโ”€ docs/
โ”œโ”€ .env_example
โ”œโ”€ .gitignore
โ”œโ”€ setup.py
โ”œโ”€ setup.cfg
โ”œโ”€ pyproject.toml
โ”œโ”€ CHANGELOG.md
โ”œโ”€ CONTRIBUTING.md
โ”œโ”€ pre-commit.sh
โ”œโ”€ README.md
โ””โ”€ requirements.txt

๐Ÿ“Œ Available Methods in SQLPyHelper

Method Description
execute_query(query, params=None) Executes a SQL query with optional parameters.
fetch_one() Retrieves a single row from query results.
fetch_all() Retrieves all rows from query results.
fetch_by_param(table, column, value) Fetches rows dynamically based on a given parameter.
create_table(table_name, columns_dict) Creates a table dynamically with a dictionary format.
insert_bulk(table, data_list) Inserts multiple rows at once efficiently.
backup_table(table, backup_file.csv) Exports table data to CSV format.
setup_connection_pool() Initializes database connection pooling.
get_connection_from_pool() Fetches a connection from the pool.
return_connection_to_pool(conn) Returns connection back to pool.
begin_transaction() Begins an explicit transaction.
rollback_transaction() Rolls back uncommitted transactions.
commit_transaction() Commits the current transaction.
close() Closes the database connection safely.
__enter__ / __exit__() Use as a context manager โ€” connection closes automatically.
AsyncSQLPyHelper Async-native class for FastAPI/asyncio โ€” see Async docs.

๐ŸŒ Contributing

We welcome contributions from the open-source community! Follow these steps to contribute:

  1. Fork the repo: SQLPyHelper GitHub Repository
  2. Clone your fork:
    git clone https://github.com/adebayopeter/sqlpyhelper.git
    
  3. Create a new branch:
    git checkout -b feature-new-functionality
    
  4. Make changes, commit, and push:
    git commit -m "Added new feature"
    git push origin feature-new-functionality
    
  5. Submit a Pull Request!

โ˜• Support the Project

If you find SQLPyHelper useful, consider buying me a coffee to support continued development! Donate Here: PayPal

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlpyhelper-0.1.9.tar.gz (24.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sqlpyhelper-0.1.9-py3-none-any.whl (20.8 kB view details)

Uploaded Python 3

File details

Details for the file sqlpyhelper-0.1.9.tar.gz.

File metadata

  • Download URL: sqlpyhelper-0.1.9.tar.gz
  • Upload date:
  • Size: 24.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for sqlpyhelper-0.1.9.tar.gz
Algorithm Hash digest
SHA256 4b2f5aedd38d1520426d79422a02df50300897c153e5b86fa1fa8680a45601ee
MD5 0b75193acc4cfc35adb5824ef854bdff
BLAKE2b-256 d967daf0225ac4ef0ab2068f7b50d9946a0be61c0cf90f86e40db25a4e0e2d86

See more details on using hashes here.

File details

Details for the file sqlpyhelper-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: sqlpyhelper-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 20.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for sqlpyhelper-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 28c9af6c8a7159ed7ef8520cd69cc0132e457d4e2da814d35294fd1ad4cd6f35
MD5 db6be0086298e8671323f89d217c82b7
BLAKE2b-256 43e95aa71c9bf753bf583f7ade751104d9de969aa095d2c2a768acd4a12ab17c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page