Skip to main content

Perform fuzzy matching against two pandas dataframes with optional exact matches

Project description

FuzzyExact

Perform fuzzy matching against two pandas dataframes with optional exact matches.

Requirements

Python 2.7 or higher
Pandas
FuzzyWuzzy
python-Levenshtein (optional)


Installation

pip install fuzzyexact

Usage

import fuzzyexact

remove_punctuation

fuzzyexact.remove_punctuation(df, 'column_name')

remove_punctuation is a helper function which strips all punctuation out of a column in pandas dataframe and returns the cleaned dataframe

clean_address

fuzzyexact.clean_address(df, 'address_column_name')

clean_address is a helper function which cleans an address column of a pandas dataframe by capitalizing, abbreviating road types (street>ST, road>RD), and stripping out building and suite numbers.

fuzzyexact

fuzzyexact.fuzzyexact(df_left, df_right, id_col='Source_ID', key=('first_name', 'address'), block1='state', block2='last_name', threshold=80)

FuzzyExact leverages FuzzyWuzzy's process.extractOne ability, integrates it into pandas dataframes, and enables for up to two exact matches (or blocks) to significantly speed up performance of matching against large datasets. The function returns all rows from df_left along with the best match for each row in df_right. The id_col argument is an optional argument which allows the user to supply an id column from df_right to allow for easier lookups of matched records. The fuzzy match is performed against the key supplied by the user. block1 and block2 are optional arguments which specify exact matches between the two dataframes. The threshold is defaulted to 80, but can be altered by the user and will feed the cutoff to define a "good" match in FuzzyWuzzy's process.extractOne function.

Contact

Project: https://github.com/eric-tomasi/fuzzyexact
Email: etomasi2323@gmail.com

Acknowledgments

FuzzyWuzzy

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fuzzyexact-1.0.0.tar.gz (3.1 kB view hashes)

Uploaded Source

Built Distribution

fuzzyexact-1.0.0-py3-none-any.whl (4.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page