generic-repo 1.0.0

A powerful, production-ready Python package for DynamoDB operations with repository pattern

Generic DynamoDB Repository

A powerful, production-ready Python package that provides a generic repository pattern implementation for Amazon DynamoDB. This package offers a clean, standardized interface for common database operations, making DynamoDB integration simpler and more maintainable.

🚀 Features

• Simple & Composite Key Support: Works with both simple primary key tables and composite key (partition + sort key) tables
• Comprehensive CRUD Operations: Create, Read, Update, Delete operations with error handling
• Batch Operations: Efficient batch save and delete operations that automatically handle DynamoDB's 25-item limit
• Advanced Querying: Query operations with automatic pagination support
• Index Support: Query operations on Global Secondary Indexes (GSI) and Local Secondary Indexes (LSI)
• Automatic Data Serialization: Handles Python to DynamoDB data type conversion seamlessly
• Built-in Expiration: Optional automatic item expiration using TTL
• Debug Mode: Testing-friendly debug mode that skips actual database operations
• Comprehensive Logging: Built-in logging support for monitoring and debugging
• Type Hints: Full type annotations for better IDE support and code quality

📦 Installation

From PyPI (Recommended)

pip install generic-repo

From GitHub

pip install git+https://github.com/subratamal/generic-repo.git

For Development

git clone https://github.com/subratamal/generic-repo.git
cd generic-repo
pip install -e .

🔧 Requirements

• Python 3.9+
• boto3 ~= 1.38.29
• botocore ~= 1.38.29

📖 Quick Start

Basic Setup

import boto3
from generic_repo import GenericRepository

# Initialize DynamoDB resource
dynamodb = boto3.resource('dynamodb', region_name='us-east-1')
table = dynamodb.Table('your-table-name')

# Create repository instance
repo = GenericRepository(
    table=table,
    primary_key_name='id',
    data_expiration_days=30,  # Optional: items expire after 30 days
    debug_mode=False
)

Basic Operations

# Save an item
item_data = {'name': 'John Doe', 'email': '[e-mail]', 'age': 30}
saved_item = repo.save('user-123', item_data)

# Load an item
user = repo.load('user-123')
if user:
    print(f"User: {user['name']}")

# Load with exception if not found
try:
    user = repo.load_or_throw('user-123')
    print(f"User: {user['name']}")
except ValueError as e:
    print(f"User not found: {e}")

# Delete an item
repo.delete('user-123')

Composite Key Operations

# For tables with partition key + sort key
composite_data = {
    'partition_key': 'USER',
    'sort_key': 'profile#123',
    'name': 'John Doe',
    'email': '[e-mail]'
}

# Save with composite key
repo.save_with_composite_key(composite_data)

# Load with composite key
key_dict = {'partition_key': 'USER', 'sort_key': 'profile#123'}
user = repo.load_by_composite_key(key_dict)

# Delete with composite key
repo.delete_by_composite_key(key_dict)

Batch Operations

# Batch save multiple items
users = [
    {'id': 'user-1', 'name': 'Alice', 'email': '[e-mail]'},
    {'id': 'user-2', 'name': 'Bob', 'email': '[e-mail]'},
    {'id': 'user-3', 'name': 'Charlie', 'email': '[e-mail]'}
]
repo.save_batch(users)

# Batch delete by keys
keys_to_delete = [
    {'id': 'user-1'},
    {'id': 'user-2'},
    {'id': 'user-3'}
]
repo.delete_batch_by_keys(keys_to_delete)

Query Operations

# Find all items with a specific partition key
items = repo.find_all('USER')

# Scan all items in the table (use carefully!)
for item in repo.load_all():
    print(f"Item: {item}")

# Count items in table
total_items = repo.count()
print(f"Total items: {total_items}")

Index-Based Queries

# Query using Global Secondary Index (GSI)
items = repo.find_all_with_index(
    index_name='email-index',
    key_name='email', 
    key_value='[e-mail]'
)

# Find first matching item from index
item = repo.find_one_with_index(
    index_name='status-index',
    key_name='status',
    key_value='active'
)

🏗️ Advanced Configuration

Custom Logger

import logging

# Setup custom logger
logger = logging.getLogger('my-app')
logger.setLevel(logging.INFO)

repo = GenericRepository(
    table=table,
    primary_key_name='id',
    logger=logger
)

Debug Mode for Testing

# Enable debug mode to skip actual database operations
repo = GenericRepository(
    table=table,
    primary_key_name='id',
    debug_mode=True  # Perfect for unit testing
)

Automatic Item Expiration

# Items will automatically expire after 7 days
repo = GenericRepository(
    table=table,
    primary_key_name='id',
    data_expiration_days=7
)

🧪 Testing

The package includes comprehensive test coverage. Run tests with:

# Install development dependencies
pip install -e .[dev]

# Run tests
python -m pytest tests/

# Run with coverage
python -m pytest tests/ --cov=generic_repo --cov-report=html

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request. For major changes, please open an issue first to discuss what you would like to change.

Development Setup

git clone https://github.com/subratamal/generic-repo.git
cd generic-repo
pip install -e .[dev]

Code Quality

This project uses:

• Ruff for linting and formatting
• Type hints for better code quality
• Comprehensive docstrings for documentation

# Format code
ruff check --fix .
ruff format .

📄 License

This project is licensed under the Proprietary License. See the LICENSE file for details.

🔗 Links

• GitHub Repository: https://github.com/subratamal/generic-repo
• PyPI Package: https://pypi.org/project/generic-repo/
• Documentation: https://github.com/subratamal/generic-repo/wiki
• Issue Tracker: https://github.com/subratamal/generic-repo/issues

📞 Support

• Email: [e-mail]
• GitHub Issues: https://github.com/subratamal/generic-repo/issues

🎯 Roadmap

• Async/await support for better performance
• More advanced query builders
• Built-in caching layer
• CloudFormation templates for common DynamoDB setups
• Integration with AWS CDK

---

Made with ❤️ by Subrat