Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.2.0.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.2.0-py3-none-any.whl (35.2 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.2.0.tar.gz.

File metadata

  • Download URL: liken-0.2.0.tar.gz
  • Upload date:
  • Size: 29.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.0.tar.gz
Algorithm Hash digest
SHA256 69d174c329916e2714cdb9151f34adcb814828312972328205abebb28625c7ad
MD5 90b5109b795d326d527779e4271cec77
BLAKE2b-256 b2cfe22893c94c5dd9ddc8558ff3f2914d4b5510a66c50e97e7fa195763467b9

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.0.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 35.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a98b9c2ff6bca019709bb7f47271988e758646aa120b771186081d22f12611ff
MD5 39bdfde4fd42fe7b56e0f496da09248f
BLAKE2b-256 322f9fe40705d3153a4b84acf93067a9a9e3b01ca699894edb8f261562a8b733

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.0-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page