Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.1.3.tar.gz (29.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.1.3-py3-none-any.whl (34.6 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.1.3.tar.gz.

File metadata

  • Download URL: liken-0.1.3.tar.gz
  • Upload date:
  • Size: 29.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.3.tar.gz
Algorithm Hash digest
SHA256 60141da4239d9d2b15fca9b8c6c0d6eb0d6fceec4726996ed4646eaf92519ea1
MD5 9621ed0561ad6528ee4b56da3358462b
BLAKE2b-256 a3154d8894eebc432573a623e29a55cb1bcd5eaa2a4ae911914283b5434bd9cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.3.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: liken-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 34.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 fc686d1dcec3f43e88c1be47f3a51cc18b649420d7fd214e70914c747a97cdd1
MD5 9033a5c3724a54c21dc5414152d1ef26
BLAKE2b-256 a45fc19fd4de4666fd5a5416a31ef07917e9ab9620b0f2308adfd60aa522ea8a

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.3-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page