Skip to main content

A Python package for seamless SQL Server database management, supporting secure connections, query execution, batch fetching, caching, and result exporting.

Project description

📌 PyDBManager - SQL Server Database Manager

Python SQL Server MIT License

Welcome to PyDBManager – a Python package for managing SQL Server connections and queries easily and efficiently! 🌟

This guide will help you:

  • ✅ Install PyDBManager
  • ✅ Set up your .env file for SQL or Windows Authentication
  • ✅ Perform SQL operations using Python
  • ✅ Create tables, insert, update, and bulk load DataFrames
  • ✅ Save query results and use batch fetching

1. Install PyDBManager

Run the following command to install PyDBManager:

pip install pydbmanager

If installation is successful, continue to the next step!


2. Create .env File to Store Database Credentials

To avoid hardcoding credentials, create a .env file in your project directory.

Steps

  1. Create a .env file in your project root.
  2. Add the following credentials (update as needed):
    DB_SERVER=localhost
    DB_DATABASE=your_database_name
    DB_DRIVER=ODBC Driver 17 for SQL Server
    
    # For SQL Authentication
    DB_USERNAME=your_username
    DB_PASSWORD=your_password
    DB_AUTH_MODE=sql
    
    # For Windows Authentication
    # DB_AUTH_MODE=windows
    
  3. Ensure .env is ignored by Git (Add .env to .gitignore).

3. Verify .env File

Run this script to check if the values are loaded correctly:

import os
from dotenv import load_dotenv

# Load environment variables
load_dotenv()

print("\u2705 Database Configuration Loaded:")
print(f"SERVER: {os.getenv('DB_SERVER')}")
print(f"DATABASE: {os.getenv('DB_DATABASE')}")
print(f"AUTH MODE: {os.getenv('DB_AUTH_MODE')}")
print(f"USERNAME: {os.getenv('DB_USERNAME')}")
print(f"PASSWORD: {'*' * len(os.getenv('DB_PASSWORD')) if os.getenv('DB_PASSWORD') else 'Not Set'}")
print(f"DRIVER: {os.getenv('DB_DRIVER')}")

4. Connect to the Database (SQL or Windows Authentication)

from pydbmanager.connection import DatabaseConnection

# Initialize and test database connection
db = DatabaseConnection()
conn = db.create_connection()

if conn:
    print("\u2705 Connection Successful!")
    db.close_connection()
else:
    print("\u274c Connection Failed!")

5. Perform SQL Operations

🔹 Query Data as DataFrame

from pydbmanager.operations import DatabaseOperations

db_ops = DatabaseOperations()
df = db_ops.query_data("SELECT * FROM users", batch_size=5)
print(df)

🔹 Insert a New Record

insert_query = """
INSERT INTO users (name, email, age, gender, phone_number, address, city, country)
VALUES ('John Doe', 'john.doe@example.com', 29, 'Male', '123-456-7890', '123 Elm St', 'New York', 'USA')
"""
db_ops.execute_query(insert_query)

🔹 Update a Record

update_query = """
UPDATE users SET age = 30 WHERE email = 'john.doe@example.com'
"""
db_ops.execute_query(update_query)

🔹 Delete a Record

delete_query = """
DELETE FROM users WHERE email = 'john.doe@example.com'
"""
db_ops.execute_query(delete_query)

🔹 Create Table

create_table_sql = """
IF NOT EXISTS (
    SELECT * FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_NAME = 'users'
)
BEGIN
    CREATE TABLE users (
        id INT IDENTITY(1,1) PRIMARY KEY,
        name VARCHAR(100),
        email VARCHAR(100),
        age INT,
        gender VARCHAR(10),
        phone_number VARCHAR(20),
        address VARCHAR(255),
        city VARCHAR(100),
        country VARCHAR(100)
    );
END
"""
db_ops.create_table(create_table_sql)

🔹 Insert a DataFrame to SQL

import pandas as pd

# Example DataFrame
df_users = pd.DataFrame([
    {
        'name': 'Jane Smith',
        'email': 'jane.smith@example.com',
        'age': 32,
        'gender': 'Female',
        'phone_number': '555-555-5555',
        'address': '456 Oak Ave',
        'city': 'Chicago',
        'country': 'USA'
    }
])

db_ops.insert_dataframe(df_users, 'users')

🔹 Update SQL Table with DataFrame

Note: key_columns should include the column(s) used to uniquely identify each row (like id or email). These are used in the SQL WHERE clause to apply updates only to matching rows.

# Assume df_users contains updated user data
# Example update: change age for a known email

df_users_update = pd.DataFrame([
    {
        'email': 'jane.smith@example.com',
        'age': 33  # updated age
    }
])

db_ops.update_table_with_dataframe(df_users_update, 'users', key_columns=['email'])

6. Save Query Results to File

# Save to CSV
results_df.to_csv("output.csv", index=False)
print("\u2705 Data saved to output.csv")

7. Closing the Connection

db_ops.close()
print("\u2705 Database connection closed.")

✅ Congratulations! 🎉

You’ve successfully used PyDBManager to:

  • Connect to SQL Server using SQL or Windows authentication
  • Run queries and commands
  • Work with DataFrames and tables
  • Create, update, and insert into SQL Server tables
  • Save data to files and close connections cleanly

Contributing & License

I welcome contributions! Feel free to submit issues and pull requests. 💪

This project is MIT Licensed — you are free to modify and distribute it as needed. 🏆

🔥 Happy Coding!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pydbmanager-0.1.7.tar.gz (9.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pydbmanager-0.1.7-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file pydbmanager-0.1.7.tar.gz.

File metadata

  • Download URL: pydbmanager-0.1.7.tar.gz
  • Upload date:
  • Size: 9.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.17

File hashes

Hashes for pydbmanager-0.1.7.tar.gz
Algorithm Hash digest
SHA256 3bab7b709f9ef0006cef7de6fec5be1e7fbca1450633f0fdff5c1e8222d3442e
MD5 b8aabeece3d8fcb91cf88a72672a9f13
BLAKE2b-256 09356ba6f6f9b69983d126fd06cba96b213156216c2034f96c2af3e970e16f4b

See more details on using hashes here.

File details

Details for the file pydbmanager-0.1.7-py3-none-any.whl.

File metadata

  • Download URL: pydbmanager-0.1.7-py3-none-any.whl
  • Upload date:
  • Size: 9.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.17

File hashes

Hashes for pydbmanager-0.1.7-py3-none-any.whl
Algorithm Hash digest
SHA256 b8b4ae983c4f1d2923908cd7d42f850a787ef69760ae43acd443865770ba8221
MD5 470ee9c3854ca1b67882cdea3822ca59
BLAKE2b-256 66f4ec1dbe6f455fa620b3410abcb0a0785560e4da38782506837d197f2f4242

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page