Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.2.1.tar.gz (29.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.2.1-py3-none-any.whl (35.2 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.2.1.tar.gz.

File metadata

  • Download URL: liken-0.2.1.tar.gz
  • Upload date:
  • Size: 29.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.1.tar.gz
Algorithm Hash digest
SHA256 7d134f28831bb17dc822aae7254146e2412b933f613713b6cfb5afa11feaba55
MD5 ef2e2c32ce7edbb65434610bb66f4d50
BLAKE2b-256 da470e23b159f2c36d96809147e030970fe68259a0fff1c15f9e83cbd40d730a

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.1.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: liken-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 35.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f607476b3afb612c3c5e5de1a86fee29de271de689c31bf53aaefb2dc4a37611
MD5 a3a5e65e37f15c5e07ff0a3c56bf1470
BLAKE2b-256 f5de7dd3003a958e5626bea4e15a86f88b93f048277e97fc6293022deb6f7475

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.2.1-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page