Introduction
Liken is a library providing enhanced deduplication tooling for DataFrames.
The key features are:
- Near deduplication
- Ready-to-use deduplication methods
- Record linkage and canonicalization
- Rules-based deduplication
- Pandas, Polars and PySpark support
- Customizable in pure Python
A flexible API
Checkout the API Documentation
Installation
pip install liken
Example
import liken as lk
df = lk.dedupe(df).apply(lk.fuzzy()).drop_duplicates("address")
Development
Local setup, checks, and prek hooks:
# Install the project
task install
# Format code
task format
# Lint and type-check
task lint
# Run unit and integration tests
task test
prek runs the same checks on every commit. Install the hooks once:
uv tool install prek
prek install
License
This project is licensed under the Apache-2.0 License. See the LICENSE file for more details.
1 maintainer
Metadata
1 maintainer
Release files for liken 0.10.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| liken-0.10.3.tar.gz | 40.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| liken-0.10.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 109.6 kB
Release files / liken-0.10.3.tar.gz
| Download URL | liken-0.10.3.tar.gz |
|---|---|
| Size | 40.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
68a5c85091c5208f19411ce350468c72e224dfeaea0a11589b6e10f2960023ec
|
|
BLAKE2b-256 checksum How to use checksums |
4083ec9ab4d04f9f6fb9e23bbb77748c04ab7196a35740bd3691a53b9b8dc7e9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.12.17 {"installer":{"name":"uv","version":"0.12.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / liken-0.10.3-py3-none-any.whl
| Download URL | liken-0.10.3-py3-none-any.whl |
|---|---|
| Size | 68.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
841120b6d58ecc8c2e509bba41822e13cf7fea5ef59a8818ba0a4ea656669b44
|
|
BLAKE2b-256 checksum How to use checksums |
171e982dfdaff39858b0bfac76f099c8929c37480724cbc83efe9abcfde1b07b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.12.17 {"installer":{"name":"uv","version":"0.12.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
