Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.9.0.tar.gz (39.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.9.0-py3-none-any.whl (68.5 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.9.0.tar.gz.

File metadata

  • Download URL: liken-0.9.0.tar.gz
  • Upload date:
  • Size: 39.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.9.0.tar.gz
Algorithm Hash digest
SHA256 1e80a253ac0043d5bd06d44e581b5bfdee28a484f23936875ebf3617edfd6e86
MD5 a83ef13b59cde50856ae7fa5eb89fe5f
BLAKE2b-256 63df055cf884f0aadf5d7c6314fa16f94c125a23b4684690e5ea27983300cfcf

See more details on using hashes here.

File details

Details for the file liken-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 68.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 abb694a43aa18a8129b38b692802423356c014090f86941050576ed797ec81a6
MD5 721346915e52c0fdd2cbb882104b728c
BLAKE2b-256 5159a00b7db95414c3aa106b32505cfc701f0083478a779d554b2ad1adf3aa5a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page