Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.4.5.tar.gz (26.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.4.5-py3-none-any.whl (32.3 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.4.5.tar.gz.

File metadata

  • Download URL: liken-0.4.5.tar.gz
  • Upload date:
  • Size: 26.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.11 {"installer":{"name":"uv","version":"0.10.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.5.tar.gz
Algorithm Hash digest
SHA256 92ea13793725c9f1e1359dec2c6ad071263e61035d114dbc5fc0a7ebd9d76931
MD5 1ec31fac9a728ab66bb75ec9b7b03d39
BLAKE2b-256 37520bd31fca82e6d4226b25f39c66cbe96792b63f2dd147dd0969b08554465b

See more details on using hashes here.

File details

Details for the file liken-0.4.5-py3-none-any.whl.

File metadata

  • Download URL: liken-0.4.5-py3-none-any.whl
  • Upload date:
  • Size: 32.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.11 {"installer":{"name":"uv","version":"0.10.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.5-py3-none-any.whl
Algorithm Hash digest
SHA256 05c737754a47a2f3fe552083ed5a90efe6d424cac58ffa36e0d5048a5a05cda5
MD5 7223175935a02f259bd4a380d39e4960
BLAKE2b-256 6569033add0d1c73dd4de61baf245e9c704139bef575f08c136a7d88f1124eab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page