SQLThunder

What is it ?

SQLThunder is a fast, flexible SQL client for Python designed for real-world workloads across PostgreSQL, MySQL, and SQLite. It offers a cleaner, high-level API over SQLAlchemy, with support for multi-threaded operations, flexible result formats, YAML-based configuration, and a built-in CLI.

The best thing about SQLThunder: no boilerplate code !

Table of Contents

• Features
• Installation
• Example Usage
• CLI Usage
• Documentation
• Contributing
• License

Features

• Threaded execution for fast inserts, updates, and deletes — designed for large-scale data workflows
• Declarative inserts with automatic SQL generation from dictionaries or DataFrames
• Key-based pagination and chunked queries for scalable data extraction
• Flexible result formats: return data as pandas.DataFrame, list of rows, or raw SQLAlchemy objects
• Graceful error handling with optional success flags and failure DataFrames
• YAML-based configuration for clean, environment-agnostic connection setup
• Built-in CLI for quick querying, inserting, and executing SQL without writing code
• Full test coverage including unit tests, integration tests, and Dockerized database backends
• Minimal boilerplate — write less code and get more done

Installation

pip install sqlthunder

Example Usage

from SQLThunder import DBClient

client = DBClient("config.yaml")
df = client.query("SELECT * FROM trades WHERE symbol = 'AAPL')

import pandas as pd
from SQLThunder import DBClient

df = pd.read_excel("data.xlsx")
client = DBClient("config.yaml")
failed_rows, success_flag = client.insert_batch(df, "my_schema.my_table", on_duplicate="ignore", return_status=True)

from SQLThunder import DBClient

client = DBClient("config.yaml")
client.execute(
    """
    CREATE TABLE IF NOT EXISTS trades (
        id INT PRIMARY KEY,
        symbol VARCHAR(10) NOT NULL,
        price DECIMAL(10, 2) NOT NULL,
        trade_time DATETIME DEFAULT CURRENT_TIMESTAMP
    )
    """
)

CLI Usage

# Run a query
sqlthunder query "SELECT * FROM trades" -c config.yaml --print

# Insert from file
sqlthunder insert data.xlsx schema.table -c config.yaml

# Run DDL or DML
sqlthunder execute "DELETE FROM logs" -c config.yaml

Documentation

https://sqlthunder.readthedocs.io

Contributing

See CONTRIBUTE.txt to get started. PRs and feedback are welcome!

License

MIT — see LICENSE for details.