Skip to main content

A Python package to execute SQL queries and procedures and manage backups.

Project description

sql_via_code

Overview

sql_via_code is a library for executing SQL queries, stored procedures, table backups, and reading queries from files, all with a clean and simple interface.


Features

  1. Query Execution: Execute SQL queries and fetch the results as a pandas DataFrame.
  2. Stored Procedure Execution: Run stored procedures with input parameters.
  3. Table Backup: Automatically back up a specified table's data before executing a query or procedure.
  4. Query from File: Read and execute SQL queries from external files to improve maintainability.
  5. Engine Management: Close all active database engines cleanly using close_engines.

Functions

get_query_from_db

Executes a SQL query and optionally backs up a table.

Parameters:

  • query (str): SQL query to execute.
  • table_to_backup (str or None): Table to back up. Pass None to skip the backup.
  • env_file_name (str, optional): Path to the .env file for database credentials (default is .env).
  • params (dict, optional): Query parameters.

Returns:

  • A pandas.DataFrame containing query results.

exec_procedure_from_db

Executes a stored procedure and optionally backs up a table.

Parameters:

  • procedure_name (str): Name of the stored procedure.
  • table_to_backup (str or None): Table to back up. Pass None to skip the backup.
  • env_file_name (str, optional): Path to the .env file for database credentials (default is .env).
  • params (dict, optional): Procedure parameters.

Returns:

  • A pandas.DataFrame containing procedure output.

get_query_from_file

Reads and executes an SQL query from a file.

Parameters:

  • file_path (str): Path to the .sql or .txt file containing the query.
  • table_to_backup (str or None): Table to back up before executing the query. Pass None to skip the backup.
  • env_file_name (str, optional): Path to the .env file for database credentials.
  • params (tuple or dict, optional): Parameters to bind to the SQL query.

Returns:

  • A pandas.DataFrame containing query results.

Example:

from sql_via_code import get_query_from_file

Read and execute a query from a file

result_df = get_query_from_file("queries/select_employees.sql", table_to_backup="employees") print(result_df)


close_engines

Closes all active database engines.

Important:
It is recommended to call this function at the end of your program to ensure that all database connections are closed properly and no resources are leaked.

Usage:

from sql_via_code import close_engines

Close all active database engines

close_engines()


Installation

To install the package and dependencies:

bash pip install sql_via_code


Dependencies

The project requires the following libraries:

  • pandas==2.2.3
  • SQLAlchemy==2.0.36
  • python-dotenv==1.0.1
  • pyodbc==5.2.0
  • aiofiles==24.1.0
  • tabulate==0.9.0
  • asyncpg==0.30.0 (for PostgreSQL)
  • aiomysql==0.2.0 (for MySQL)
  • aiosqlite==0.20.0 (for SQLite)

Environment Setup

Ensure you have a .env file in the root directory with the following database configuration:

plaintext DB_TYPE=your_db_type USER=your_username PASSWORD=your_password HOST=your_host NAME=your_database_name DRIVER=your_driver

Example .env file for MSSQL:

plaintext DB_TYPE=mssql USER=admin PASSWORD=secretpassword HOST=127.0.0.1 NAME=my_database DRIVER=ODBC Driver 17 for SQL Server

Example .env file for SQLite:

plaintext DB_TYPE=sqlite NAME=example.db


Usage Examples

Example 1: Executing a Query with Backup

python from sql_via_code import get_query_from_db

query = "SELECT * FROM employees" result_df = await get_query_from_db(query, table_to_backup="employees") print(result_df)


Example 2: Executing a Stored Procedure

python from sql_via_code import exec_procedure_from_db

procedure_name = "sp_get_employee_data" params = {"department": "Sales"} result_df = await exec_procedure_from_db(procedure_name, table_to_backup="employees", params=params) print(result_df)


Example 3: Reading Query from File

from sql_via_code import get_query_from_file, get_query_from_db, close_engines

query = get_query_from_file("queries/select_employees.sql", table_to_backup="employees") result_df = get_query_from_db(query, table_to_backup="employees") print(result_df)

Final step: Close all engines

close_engines()


Supported Databases

Database DB_TYPE Required Fields
SQLite sqlite NAME
PostgreSQL postgresql USER, PASSWORD, HOST, NAME
MySQL mysql USER, PASSWORD, HOST, NAME
MSSQL mssql USER, PASSWORD, HOST, NAME, DRIVER
Oracle oracle USER, PASSWORD, HOST, NAME

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sql_via_code-0.3.1.tar.gz (10.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sql_via_code-0.3.1-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file sql_via_code-0.3.1.tar.gz.

File metadata

  • Download URL: sql_via_code-0.3.1.tar.gz
  • Upload date:
  • Size: 10.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.6

File hashes

Hashes for sql_via_code-0.3.1.tar.gz
Algorithm Hash digest
SHA256 3657acc7156ea1c9ed1b4b503ef922c83f1623e66816730057fa233fcc6c2f76
MD5 d5104e4015cef793783bc0c6714d00d5
BLAKE2b-256 d79c64683416d8f5d472fd224de0725255fd4fe7c1eb7aca1fb01dcea38c9a32

See more details on using hashes here.

File details

Details for the file sql_via_code-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: sql_via_code-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 8.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.6

File hashes

Hashes for sql_via_code-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 bf3a54dc4bced131bc99fef07a6ec053dbd517d1df84aa0103822a3c53707246
MD5 11bdf7e4d76d726358c451c846d334e3
BLAKE2b-256 39c684299b41bdaba2827b52fbc0371995262c385b58a2e597bae456e56902e0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page