Skip to main content

A Python library for near deduplication and record linkage.

Project description

PyPI Version PyPI - Python Version

Introduction

Liken is a library providing enhanced deduplication tooling for DataFrames.

The key features are:

  • Near deduplication
  • Ready-to-use deduplication strategies
  • Record linkage and canonicalization
  • Rules-based deduplication
  • Pandas, Polars and PySpark support
  • Customizable in pure Python

A flexible API

Checkout the API Documentation

Installation

pip install liken

Example

from liken import Dedupe, fuzzy

lk = Dedupe(df)

lk.apply(fuzzy())

df = lk.drop_duplicates("address")

License

This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

liken-0.4.1.tar.gz (26.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

liken-0.4.1-py3-none-any.whl (32.0 kB view details)

Uploaded Python 3

File details

Details for the file liken-0.4.1.tar.gz.

File metadata

  • Download URL: liken-0.4.1.tar.gz
  • Upload date:
  • Size: 26.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.1.tar.gz
Algorithm Hash digest
SHA256 e988325fa09872fc8464139edd840cb3592e1c54bbd231c5e7f8da209ccfaceb
MD5 1120c2c0be8de73cde72768339f85bff
BLAKE2b-256 7442eb8657d789fe853014af95bea47ee3f64c57527c8a331e2f8d7a2b1dad19

See more details on using hashes here.

File details

Details for the file liken-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: liken-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 32.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for liken-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c502b7377fbf13ca08ed04a9bd3740e8f9ea276e15bea71797a7467b21f01e7d
MD5 af1b8380f1a53138c80ae3dc79471e6a
BLAKE2b-256 7e21f710bc16fffec1191bf87dc64a7faad32dc36a089d11a76ea677fc964992

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page