Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.2.2.tar.gz (29.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.2.2-py3-none-any.whl (35.5 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.2.2.tar.gz.

File metadata

  • Download URL: liken-0.2.2.tar.gz
  • Upload date:
  • Size: 29.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.2.tar.gz
Algorithm Hash digest
SHA256 20b1915eac0a8815cf04be6ed6e491fb598f722b86e637f4a755732e1454e64a
MD5 4af68740d420fa93c9608b169c0af805
BLAKE2b-256 9836d8c8dff7edb9020df6e73a5fe62b2f15a77b089dacf3d55e7afceb6954ce

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.2.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: liken-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 35.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 1d8e3e4d59fb3401462a135968acfebdda81ade46e7cacb6d07d7dfe8fab788b
MD5 535708004f59b20b7b0ee6750aeaa773
BLAKE2b-256 ed7409ccfec47fe49b1bb85e384fdad926e627e38fe8035bb726a4ba5052b201

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.2-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page