Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = liken.Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.1.1.tar.gz (29.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.1.1-py3-none-any.whl (34.6 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.1.1.tar.gz.

File metadata

  • Download URL: liken-0.1.1.tar.gz
  • Upload date:
  • Size: 29.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.1.tar.gz
Algorithm Hash digest
SHA256 6cffcc98657ab1e65a5dbd2b569aa4a6e275a3519fafaa89713cbe15f180ef81
MD5 851a82d7ef5f294fd52af68213e9a372
BLAKE2b-256 91d0309fa10477e9d696303b03d698dc252b7dbcbed7023fa03434cdecd7d0e7

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.1.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: liken-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 34.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 ac96b212bf61a91145d9227c065108c417c2edb4e63683ab7d11b46db375c8f6
MD5 b90c1fef3e4aa22d70b83d1e4d69efab
BLAKE2b-256 98e5299f349c16b2cc243f69d5dd9dd77b75ac20f23a5244ef02655704968465

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.1-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page