Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.3.1.tar.gz (25.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.3.1-py3-none-any.whl (31.3 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.3.1.tar.gz.

File metadata

  • Download URL: liken-0.3.1.tar.gz
  • Upload date:
  • Size: 25.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.4 {"installer":{"name":"uv","version":"0.10.4","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.3.1.tar.gz
Algorithm Hash digest
SHA256 cbb8dc8364b984ab221705bd7106fba4995fa43e97bb8ff0524c00f1ccfb4c08
MD5 ae4853928cd59a4e1e1804ec9cbe7ff0
BLAKE2b-256 9ddd0a8fd98bbb72d04bc8243f00aca3d004b12cb4242cb2d2f68129096750f1

See more details on using hashes here.

File details

Details for the file liken-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: liken-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 31.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.4 {"installer":{"name":"uv","version":"0.10.4","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 87ff83c931495a2b085dc3fc94f7e06672438c4c9f075bd59617917a7893708a
MD5 750733c4e55b2d52b0faf054df3d2ba7
BLAKE2b-256 647066563bb8712c962a6cff0e0aea45a50a69a29a8f35014494206bc97c6f94

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page