dirty_cat
dirty_cat has migrated to skrub . This repository will no longer be maintained.
Use skrub, it has all the features of dirty-cat and more.
dirty_cat is a Python library that facilitates machine-learning on dirty categorical variables.
For a detailed description of the problem of encoding dirty categorical data, see Similarity encoding for learning with dirty categorical variables [1] and Encoding high-cardinality string categorical variables [2].
What can dirty_cat do?
dirty_cat provides tools (TableVectorizer, fuzzy_join…) and encoders (GapEncoder, MinHashEncoder…) for morphological similarities, for which we usually identify three common cases: similarities, typos and variations
The first example notebook goes in-depth on how to identify and deal with dirty data using the dirty_cat library.
What dirty_cat does not
Semantic similarities are currently not supported. For example, the similarity between car and automobile is outside the reach of the methods implemented here.
This kind of problem is tackled by Natural Language Processing methods.
dirty_cat can still help with handling typos and variations in this kind of setting.
Installation
dirty_cat can be easily installed via pip:
pip install dirty_cat
Dependencies
Dependencies and minimal versions are listed in the setup file.
Contributing
If you want to encourage development of dirty_cat, the best thing to do is to spread the word!
If you encounter an issue while using dirty_cat, please open an issue and/or submit a pull request. Don’t hesitate, you’re helping to make this project better for everyone!
Additional resources
References
Metadata
Release files for dirty-cat 0.4.2.post0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| dirty_cat-0.4.2.post0.tar.gz | 103.0 kB | Without provenance | Details for dirty_cat-0.4.2.post0.tar.gz |
Release files / dirty_cat-0.4.2.post0.tar.gz
| Download URL | dirty_cat-0.4.2.post0.tar.gz |
|---|---|
| Size | 103.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4d6895b3efbc45ac451cd08d49db6ff2bd6b7e96f92e251c21ee44bf7ebbb23e
|
|
BLAKE2b-256 checksum How to use checksums |
0f5a2ff125f7dc0977ba47eeab6f5f3bfe5736f431b3db191d5f6e0bda6c67e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.12.3
|
Security for dirty-cat 0.4.2.post0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.