Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.8.0.tar.gz (36.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.8.0-py3-none-any.whl (65.3 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.8.0.tar.gz.

File metadata

  • Download URL: liken-0.8.0.tar.gz
  • Upload date:
  • Size: 36.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.9 {"installer":{"name":"uv","version":"0.11.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.8.0.tar.gz
Algorithm Hash digest
SHA256 67359c488ca565e25bcb2b0c0736a9edb32b064b47374c10d51f132bc3d94b5e
MD5 ce4b94ef94a40693c629ae442c3717e2
BLAKE2b-256 bd50ef57bc0364504d0a6b50f53d6a87d7b2bc56626c53495e69d3955fb368ea

See more details on using hashes here.

File details

Details for the file liken-0.8.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.8.0-py3-none-any.whl
  • Upload date:
  • Size: 65.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.9 {"installer":{"name":"uv","version":"0.11.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9a2003b184f1ce2723b73f882707d614222c33bb126ae05cc70c67a4ea7b7d47
MD5 929d161c387b5393501b648b716c1afb
BLAKE2b-256 3ee3597ffd3789ac0f5d2e7449bae23147695c7105040c4a032a78a74e46c869

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page