Skip to main content

Package to work with mysql database from python

Project description

sqlalchemy_helper_tool

A lightweight Python utility class for simplified interaction with MySQL databases using SQLAlchemy and Pandas. It provides convenient methods to read, write, and modify data or schema with minimal boilerplate.

Features

  • Easy connection setup to a MySQL database using SQLAlchemy
  • Execute raw SQL queries
  • Inspect tables and columns
  • Read SQL results into Pandas DataFrames
  • Append, replace, or ignore duplicate rows when writing
  • Dynamically add or remove columns
  • Parameterized queries
  • Auto-handle nulls in inserts
  • Safe "replace" of data while preserving table schema

Installation

Install via pip (requires sqlalchemy, pymysql, and pandas):

pip install sqlalchemy_helper_tool

Clone this repository if needed:

git clone https://github.com/anakings/sqlalchemy_helper_tool.git

Usage

from sqlalchemy_helper_tool import DbApi

db = DbApi(
    server='localhost',
    database='my_db',
    username='user',
    password='pass'
)

# Run a SQL query
result = db.execute_query("SELECT COUNT(*) FROM users")

# Read a SQL query as DataFrame
df = db.read_sql("SELECT * FROM users LIMIT 10")

# Check if a table exists
exists = db.table_in_db("users")

# Add a new column after an existing one
db.add_column("users", "new_col", "existing_col")

# Write DataFrame ignoring duplicates
db.write_sql_key(df, "users")

# Append rows to an existing table
db.write_sql_df_append(df, "users")

# Replace all data in a table but keep schema
db.write_sql_df_replace(df, "users")

# Replace values in a specific column using a key
db.replace_sql_values(df, "users", column_replace="status", columns_key="id")

# Delete all rows in a table
db.delete_table("users")

# Drop a column
db.delete_column("users", "new_col")

Class: DbApi

Initialization

DbApi(server, database, username, password, dict_params=None)

Key Methods

Method Description
execute_query(query) Executes a raw SQL query
read_sql(query, dict_params=None) Executes a SQL query and returns a DataFrame
table_in_db(table_name) Checks if table exists
table_info(table_name) Returns column metadata
read_columns_table_db(table_name) Returns column names as list
add_column(table_name, column_name, after_column) Adds a column
delete_column(table_name, column_name) Removes a column
delete_table(table_name) Deletes all rows in a table
write_sql_key(df, table_name) Inserts ignoring duplicates
write_sql_key2(df, table_name) Like above, but handles nulls and escapes column names
write_sql_df_append(df, table_name) Appends to table
write_sql_df_replace(df, table_name) Deletes all rows and inserts new ones, preserving schema
replace_sql_values(df, table_name, column_replace, columns_key) Replaces specific values via ON DUPLICATE KEY UPDATE

Requirements

  • Python 3.6+
  • SQLAlchemy
  • pymysql
  • pandas

License

MIT License

Author

Anabel Reyes

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlalchemy_helper_tool-1.7.2.tar.gz (8.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sqlalchemy_helper_tool-1.7.2-py3-none-any.whl (7.9 kB view details)

Uploaded Python 3

File details

Details for the file sqlalchemy_helper_tool-1.7.2.tar.gz.

File metadata

  • Download URL: sqlalchemy_helper_tool-1.7.2.tar.gz
  • Upload date:
  • Size: 8.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.0

File hashes

Hashes for sqlalchemy_helper_tool-1.7.2.tar.gz
Algorithm Hash digest
SHA256 f862cd5d458bc826ee380fe38c22e2a9de2336fdf88718f63ec05d618d4fef31
MD5 9f1e7cd5ae8239a68f2e7a3c62d5ba63
BLAKE2b-256 f9ca5dcb81c6bb50ffcee19d04d1b5b81f5cae7a7d1d7a981c2a02feb3cd7657

See more details on using hashes here.

File details

Details for the file sqlalchemy_helper_tool-1.7.2-py3-none-any.whl.

File metadata

File hashes

Hashes for sqlalchemy_helper_tool-1.7.2-py3-none-any.whl
Algorithm Hash digest
SHA256 4b90e0d0f99c006c96f409bc63c135ff349e85c5bb90ab84c9b0050d5b93c043
MD5 f60b8355d32eeb90b381bf64a883cef7
BLAKE2b-256 b09c9ffe1f336779fba5870e01de604e0fe11d6de21ce9a9818ecc6704742efc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page