Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version PyPI Downloads Tests Coverage License

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication methods
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

import liken as lk

df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address").collect()

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.7.4.tar.gz (31.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.7.4-py3-none-any.whl (37.6 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.7.4.tar.gz.

File metadata

  • Download URL: liken-0.7.4.tar.gz
  • Upload date:
  • Size: 31.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.4.tar.gz
Algorithm Hash digest
SHA256 e294bbeb84c510a16dadaf03bd5aedaedef34b8551923ad197dce35bb3f62783
MD5 056e5447d323ac48199a41237e7ab1ac
BLAKE2b-256 0fe9ca8d8654f4cf5ac229c2a89ca0cc243474ac2a61e58972495ee0195e5e96

See more details on using hashes here.

File details

Details for the file liken-0.7.4-py3-none-any.whl.

File metadata

  • Download URL: liken-0.7.4-py3-none-any.whl
  • Upload date:
  • Size: 37.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.7.4-py3-none-any.whl
Algorithm Hash digest
SHA256 7eb16ff914832b1367eb3486879cf45ec1be945d1f92eb402b4b7ad84a75a79e
MD5 7a4bc1363d0fa19febe5a4b86b07aab6
BLAKE2b-256 07387cc6449800886a2e1413a98b2c781c8d6c25e471eb75469278727ab2bc44

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page