Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.4.0.tar.gz (26.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.4.0-py3-none-any.whl (32.0 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.4.0.tar.gz.

File metadata

  • Download URL: liken-0.4.0.tar.gz
  • Upload date:
  • Size: 26.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.0.tar.gz
Algorithm Hash digest
SHA256 0107a2ee9128ad32429c674e067d6d4a2fba49aa5c14064544f5aea3ae787a03
MD5 61d56afd383e629874cc294a40347a47
BLAKE2b-256 04f9f1e30e4ab5a36254a8f722e53ddf53c5f807a29ac60e2cb602a0d28fabfc

See more details on using hashes here.

File details

Details for the file liken-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 32.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 e11615b20eef82024c46f7ecedfb86f151cee26205c0ae72971dc89c4e220b92
MD5 9cd8d6de2024384db41d3190f2bc9ef6
BLAKE2b-256 c8cb4416aaefddaababcc66dd77e2230a6f7524ac151f34e900e9756e8c34dfc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page