Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.3.0.tar.gz (30.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.3.0-py3-none-any.whl (35.7 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.3.0.tar.gz.

File metadata

  • Download URL: liken-0.3.0.tar.gz
  • Upload date:
  • Size: 30.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.3.0.tar.gz
Algorithm Hash digest
SHA256 9af7dae3d4dc030f5770e787726fa5e259291181be66bdf55276106d5237570d
MD5 63be9074513b7f1ed43cf7c37d6680c5
BLAKE2b-256 1d5f6945e1ac6bf49641054be04d06c9a1b92b3e1496f1d148fdc8d4cada0b42

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.3.0.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 35.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 77c31aa13cf54639a2dd924c8e14123785a50a98720c576e71ee1902480f65bc
MD5 20c870bd5660b5d5bb6da1685730e80a
BLAKE2b-256 37f1eaea90dbd8103b4fd0fbab4b7d13fee111546e7e836bcde8a5903953f9a2

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.3.0-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page