easymdm 0.1.1

easymdm is an open source mdm system, usefull for user data consolidation.

Prerequisite

Define a yaml file for configuration details like below, Need to pass its name and location to CLI as shown below

sqlite:
  - DB_PATH: 'D:\path	o\database\'
    DB_NAME: 'mydatabase.db'

blocking:
  columns:
    - first_name
    - last_name
similarity:
  - column: first_name
    method: jarowinkler
  - column: middle_name
    method: jarowinkler
  - column: last_name
    method: jarowinkler
  - column: address
    method: levenshtein
  - column: city
    method: jarowinkler
  - column: zip_code
    method: exact

thresholds:
  review: 0.6
  auto_merge: 0.8

survivorship:
  rules:
    - column: Last_Updated_On
      strategy: most_recent # longest_string

priority_rule:
  conditions:
    - column: original
      value: 1
    - column: Address
      value: *STREET*

CLI Run

uv run roar --help

For flat file
> uv run roar --source file --name D:\path	o_your_file\123.csv --config D:\path	o_your_config

Local Test Run

uv run .\src\easymdm\cli.py --source file --name .\sample\testdata.csv --config .\sample\testdata.yaml --outpath .\sample\
uv run .\src\easymdm\cli.py --source duckdb --name .\sample\testdata.csv --config .\sample\testdata.yaml --outpath .\sample\

Pylint Action

    if: contains(github.event.head_commit.message, 'CheckCodeQuality')