Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = liken.Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.1.0.tar.gz (29.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.1.0-py3-none-any.whl (34.6 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.1.0.tar.gz.

File metadata

  • Download URL: liken-0.1.0.tar.gz
  • Upload date:
  • Size: 29.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.0.tar.gz
Algorithm Hash digest
SHA256 c20460d012acd6df4543f4bd9c9f3ef3a8abb019687ef561b13a90d5b3ce68d3
MD5 7367d73e34c44e59e203de21617329fa
BLAKE2b-256 fe3394c19238723fc0b23141970a1914083cb35963aba711290dec658a9de032

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.0.tar.gz:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file liken-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 34.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for liken-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0988f1d6ed36e217874d8039754f356c43fd2aea0f5a79919f9f3e7e059828e6
MD5 f6dac62717bd429cbdddc387cfc587ff
BLAKE2b-256 a7d2179e1cbae6fee0e116b39fe067af8ac7b1dee90031364ba9eb262808687e

See more details on using hashes here.

Provenance

The following attestation bundles were made for liken-0.1.0-py3-none-any.whl:

Publisher: release.yml on VictorAut/liken

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page