Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address").collect()

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.7.2.tar.gz (31.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.7.2-py3-none-any.whl (37.2 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.7.2.tar.gz.

File metadata

  • Download URL: liken-0.7.2.tar.gz
  • Upload date:
  • Size: 31.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.2.tar.gz
Algorithm Hash digest
SHA256 664a77b0f687a8db8cdfadb88ba08091f0b834ba0f6db40ab93a8bc15b2a7900
MD5 dff048e428ddea2bde0c1eba5a9aa0b4
BLAKE2b-256 5716cb6a1c57120843e5c3c73b18b6c4ac0fa2650226224eef88328948928cfe

See more details on using hashes here.

File details

Details for the file liken-0.7.2-py3-none-any.whl.

File metadata

  • Download URL: liken-0.7.2-py3-none-any.whl
  • Upload date:
  • Size: 37.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.2-py3-none-any.whl
Algorithm Hash digest
SHA256 fcd2dd0c064334ae2b734538d0fb46fc964da94af1350767508cb64dc91949b9
MD5 df7ae87d7372282819b2f5fb2fe74fb9
BLAKE2b-256 ac6f2a234a95cb2cee325618e19343e08da78028d0cbd322e6f53dcea70ba002

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page