Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address").collect()

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.7.0.tar.gz (31.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.7.0-py3-none-any.whl (37.2 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.7.0.tar.gz.

File metadata

  • Download URL: liken-0.7.0.tar.gz
  • Upload date:
  • Size: 31.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.0.tar.gz
Algorithm Hash digest
SHA256 1f52955a07cfd85b3bdf4c3b786eea341ac457aa7bc88d5a04284a20cff59b26
MD5 231e5cbcb51451d82a7a9076969f6004
BLAKE2b-256 9f1098f1ba5fe908de1a01025c5518f39dddff3ef74ed657f3271410bf6f2de5

See more details on using hashes here.

File details

Details for the file liken-0.7.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.7.0-py3-none-any.whl
  • Upload date:
  • Size: 37.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 45ac0c88cbb0437fad4f52d9331f77dc9d015b9fabca6731a1c3f6298d8d7a80
MD5 df22a0f5b1672592484a6172cf10c39b
BLAKE2b-256 70dab2bc8cdfe3e4bc69da6bd14faa748e915f29aab133c5f78cd7842a8b938f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page