Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address").collect()

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.7.1.tar.gz (31.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.7.1-py3-none-any.whl (37.2 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.7.1.tar.gz.

File metadata

  • Download URL: liken-0.7.1.tar.gz
  • Upload date:
  • Size: 31.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.1.tar.gz
Algorithm Hash digest
SHA256 17294659bbbb7b393d88b798589e111a24e61eecf6185779a79c86e5ff9d97cd
MD5 277c9c4a30334e25814220527ec8b8fe
BLAKE2b-256 f4807217082e0fe83a0819b42077a99da59d67721ea6a80db5bfc26dba23eed5

See more details on using hashes here.

File details

Details for the file liken-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: liken-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 37.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5bd410a5243dec0267307797be0394c80b2e08b97e41f6e297a2b0c72668e35e
MD5 42c8a711880d479c5160ede6c41ae0f2
BLAKE2b-256 e27b9f313a3dc820e42558852605db77ca46f59eeefd6961b3b75784dbe12fc7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page