Skip to main content

A Python package for seamless SQL Server database management, supporting secure connections, query execution, batch fetching, caching, and result exporting.

Project description

📌 PyDBManager - SQL Server Database Manager

Python SQL Server MIT License

Welcome to PyDBManager – a Python package for managing SQL Server connections and queries easily and efficiently! 🌟

This guide will help you:

  • ✅ Install PyDBManager
  • ✅ Set up your .env file for SQL or Windows Authentication
  • ✅ Perform SQL operations using Python
  • ✅ Create tables, insert, update, and bulk load DataFrames
  • ✅ Save query results and use batch fetching

1. Install PyDBManager

Run the following command to install PyDBManager:

pip install pydbmanager

If installation is successful, continue to the next step!


2. Create .env File to Store Database Credentials

To avoid hardcoding credentials, create a .env file in your project directory.

Steps

  1. Create a .env file in your project root.
  2. Add the following credentials (update as needed):
    DB_SERVER=localhost
    DB_DATABASE=your_database_name
    DB_DRIVER=ODBC Driver 17 for SQL Server
    
    # For SQL Authentication
    DB_USERNAME=your_username
    DB_PASSWORD=your_password
    DB_AUTH_MODE=sql
    
    # For Windows Authentication
    # DB_AUTH_MODE=windows
    
  3. Ensure .env is ignored by Git (Add .env to .gitignore).

3. Verify .env File

Run this script to check if the values are loaded correctly:

import os
from dotenv import load_dotenv

# Load environment variables
load_dotenv()

print("\u2705 Database Configuration Loaded:")
print(f"SERVER: {os.getenv('DB_SERVER')}")
print(f"DATABASE: {os.getenv('DB_DATABASE')}")
print(f"AUTH MODE: {os.getenv('DB_AUTH_MODE')}")
print(f"USERNAME: {os.getenv('DB_USERNAME')}")
print(f"PASSWORD: {'*' * len(os.getenv('DB_PASSWORD')) if os.getenv('DB_PASSWORD') else 'Not Set'}")
print(f"DRIVER: {os.getenv('DB_DRIVER')}")

4. Connect to the Database (SQL or Windows Authentication)

from pydbmanager.connection import DatabaseConnection

# Initialize and test database connection
db = DatabaseConnection()
conn = db.create_connection()

if conn:
    print("\u2705 Connection Successful!")
    db.close_connection()
else:
    print("\u274c Connection Failed!")

5. Perform SQL Operations

🔹 Query Data as DataFrame

from pydbmanager.operations import DatabaseOperations

db_ops = DatabaseOperations()
df = db_ops.query_data("SELECT * FROM users", batch_size=5)
print(df)

🔹 Insert a New Record

insert_query = """
INSERT INTO users (name, email, age, gender, phone_number, address, city, country)
VALUES ('John Doe', 'john.doe@example.com', 29, 'Male', '123-456-7890', '123 Elm St', 'New York', 'USA')
"""
db_ops.execute_query(insert_query)

🔹 Update a Record

update_query = """
UPDATE users SET age = 30 WHERE email = 'john.doe@example.com'
"""
db_ops.execute_query(update_query)

🔹 Delete a Record

delete_query = """
DELETE FROM users WHERE email = 'john.doe@example.com'
"""
db_ops.execute_query(delete_query)

🔹 Create Table

create_table_sql = """
IF NOT EXISTS (
    SELECT * FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_NAME = 'users'
)
BEGIN
    CREATE TABLE users (
        id INT IDENTITY(1,1) PRIMARY KEY,
        name VARCHAR(100),
        email VARCHAR(100),
        age INT,
        gender VARCHAR(10),
        phone_number VARCHAR(20),
        address VARCHAR(255),
        city VARCHAR(100),
        country VARCHAR(100)
    );
END
"""
db_ops.create_table(create_table_sql)

🔹 Insert a DataFrame to SQL

import pandas as pd

# Example DataFrame
df_users = pd.DataFrame([
    {
        'name': 'Jane Smith',
        'email': 'jane.smith@example.com',
        'age': 32,
        'gender': 'Female',
        'phone_number': '555-555-5555',
        'address': '456 Oak Ave',
        'city': 'Chicago',
        'country': 'USA'
    }
])

db_ops.insert_dataframe(df_users, 'users')

🔹 Update SQL Table with DataFrame

Note: key_columns should include the column(s) used to uniquely identify each row (like id or email). These are used in the SQL WHERE clause to apply updates only to matching rows.

# Assume df_users contains updated user data
# Example update: change age for a known email

df_users_update = pd.DataFrame([
    {
        'email': 'jane.smith@example.com',
        'age': 33  # updated age
    }
])

db_ops.update_table_with_dataframe(df_users_update, 'users', key_columns=['email'])

6. Save Query Results to File

# Save to CSV
results_df.to_csv("output.csv", index=False)
print("\u2705 Data saved to output.csv")

7. Closing the Connection

db_ops.close()
print("\u2705 Database connection closed.")

✅ Congratulations! 🎉

You’ve successfully used PyDBManager to:

  • Connect to SQL Server using SQL or Windows authentication
  • Run queries and commands
  • Work with DataFrames and tables
  • Create, update, and insert into SQL Server tables
  • Save data to files and close connections cleanly

Contributing & License

I welcome contributions! Feel free to submit issues and pull requests. 💪

This project is MIT Licensed — you are free to modify and distribute it as needed. 🏆

🔥 Happy Coding!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pydbmanager-0.1.6.tar.gz (9.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pydbmanager-0.1.6-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file pydbmanager-0.1.6.tar.gz.

File metadata

  • Download URL: pydbmanager-0.1.6.tar.gz
  • Upload date:
  • Size: 9.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.17

File hashes

Hashes for pydbmanager-0.1.6.tar.gz
Algorithm Hash digest
SHA256 05a946b7245aa1d6a8ac4dc022aa5ebfe9c871f9eac579067726466bb4f5c12c
MD5 cce3f22106385e87a01ee9ccef8603a8
BLAKE2b-256 2f15fd1d597216b9facd35e4a6bcd9ce16567a03f7712854d98ab654250b8279

See more details on using hashes here.

File details

Details for the file pydbmanager-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: pydbmanager-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 9.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.17

File hashes

Hashes for pydbmanager-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 0c6f7dfc9fffd60c529ee40b134828f3a5e08f3bf1e2128e8acd4ccf690e84fa
MD5 a0d6ca0f694ed3823404008be448d0d0
BLAKE2b-256 d8f164d56b65f8f79fccd365c70eefb30014380054ca920b9f3a2fd18e6a11f7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page