Python library for end to end Entity Matching.
Project description
py_entitymatching
This project seeks to build a Python software package to match entities between two tables using supervised learning. This problem is often referred as entity matching (EM). Given two tables A and B, the goal of EM is to discover the tuple pairs between two tables that refer to the same real-world entities. There are two main steps involved in entity matching: blocking and matching. The blocking step aims to remove obvious non-matching tuple pairs and reduce the set considered for matching. Entity matching in practice involves many steps than just blocking and matching. While performing EM users often execute many steps, e.g. exploring, cleaning, debugging, sampling, estimating accuracy, etc. Current EM systems however do not cover the entire EM pipeline, providing support only for a few steps (e.g., blocking, matching), while ignoring less well-known yet equally critical steps (e.g., debgging, sampling). This package seeks to support all the steps involved in EM pipeline.
The package is free, open-source, and BSD-licensed.
Important links
Project Homepage: https://sites.google.com/site/anhaidgroup/projects/magellan/py_entitymatching
Code repository: https://github.com/anhaidgroup/py_entitymatching
User Manual: http://anhaidgroup.github.io/py_entitymatching/v0.4.0/index.html
Guides: http://anhaidgroup.github.io/py_entitymatching/v0.4.0/user_manual/guides.html
How to Contribute: http://anhaidgroup.github.io/py_entitymatching/v0.4.0/contributing.html
Issue Tracker: https://github.com/anhaidgroup/py_entitymatching/issues
Dependencies
The required dependencies to build the packages are:
numpy 1.7.0 or higher. Tested on version 1.19.4.
pandas (provides data structures to store and manage tables). Tested on version 1.1.4.
scikit-learn 0.22 or higher (provides implementations for common machine learning algorithms). Tested on version 0.23.2.
joblib (provides multiprocessing capabilities). Tested on version 0.17.0.
py_stringsimjoin (provides implementations for string similarity joins). Tested on version 0.3.2.
py_stringmatching (provides a set of string tokenizers and string similarity functions). Tested on version 0.4.2.
cloudpickle (provides functions to serialize Python constructs). Tested on version 1.6.0.
pyprind (library to display progress indicators). Tested on version 2.9.8.
pyparsing (library to parse strings). Tested on version 2.4.7.
six (provides functions to write compatible code across Python 2 and 3). Tested on version 1.15.0.
Platforms
py_entitymatching has been tested on Linux, OS X and Windows.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.