canonmap 0.4.0

A data matching and canonicalization library with multipl database connector support

CanonMap

A powerful data matching and canonicalization library with MySQL connector support.

Features

• Data Matching: Advanced algorithms for fuzzy string matching and record linkage
• MySQL Integration: Seamless connection and management of MySQL databases
• Canonicalization: Standardize and normalize data across different formats
• Rich Logging: Beautiful console output with structured logging
• FastAPI Support: Optional FastAPI integration for web services

Installation

pip install canonmap

For development dependencies:

pip install canonmap[dev]

For FastAPI support:

pip install canonmap[fastapi]

Quick Start

Command Line Interface

CanonMap provides a CLI tool for quick project setup:

# Create a new API project (default name: app)
cm create-api

# Create a new API project with custom name
cm create-api --name my-api

# Create a new API project with spaces (will be normalized)
cm create-api --name "My API"

The CLI will automatically:

• Normalize directory names to follow Python conventions
• Auto-increment names if the directory already exists (app, app-2, app-3, etc.)
• Copy and customize the example API template
• Replace all references from "app" to your chosen name

Basic Usage

from canonmap import make_console_handler
from canonmap.connectors.mysql_connector import MySQLConnector

# Set up logging
make_console_handler(set_root=True)

# Create a MySQL connector
connector = MySQLConnector(
    host="localhost",
    port=3306,
    user="your_user",
    password="your_password",
    database="your_database"
)

# Use the connector for data operations
# ... your data matching and canonicalization code

Data Matching Example

from canonmap.connectors.mysql_connector.matching import Matcher

# Initialize matcher
matcher = Matcher()

# Perform fuzzy matching
matches = matcher.find_matches(
    source_data=source_records,
    target_data=target_records,
    fields_to_match=["name", "address"],
    threshold=0.8
)

Documentation

For detailed documentation, visit the project homepage.

Development

Setup

1. Clone the repository:

git clone https://github.com/yourusername/canonmap.git
cd canonmap

2. Install development dependencies:

pip install -e ".[dev]"

3. Run tests:

pytest

Code Quality

This project uses several tools to maintain code quality:

• Black: Code formatting
• isort: Import sorting
• flake8: Linting
• mypy: Type checking
• pytest: Testing

Run all quality checks:

black src/ tests/
isort src/ tests/
flake8 src/ tests/
mypy src/
pytest

Contributing

1. Fork the repository
2. Create a feature branch
3. Make your changes
4. Add tests for new functionality
5. Ensure all tests pass
6. Submit a pull request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Changelog

See CHANGELOG.md for a list of changes and version history.

Support

• Issues: GitHub Issues
• Documentation: Project README