Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address").collect()

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.6.0.tar.gz (30.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.6.0-py3-none-any.whl (36.4 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.6.0.tar.gz.

File metadata

  • Download URL: liken-0.6.0.tar.gz
  • Upload date:
  • Size: 30.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.6.0.tar.gz
Algorithm Hash digest
SHA256 3a95451048af970458adc6cbe29e1cee3ffdc94c9338d794ddb338fbaaf68b37
MD5 b7b94046487c9bf1986a1d342f920dbf
BLAKE2b-256 a3f505770112327857153f737a2e7caed14dba8522e3ef30e7ab7f94917abb74

See more details on using hashes here.

File details

Details for the file liken-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: liken-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 36.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 735219ec00e9968779fb85c14451fce9a0abe166bbd31f709642beaf111e1e6b
MD5 277273f00d0c79dd2ec76129c34734d5
BLAKE2b-256 7b04dd4f1944475e7a7077021a9f3fd85cd416c962a0433846969ce4b02e6eeb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page