Extension of text_explainability for sensitivity testing (robustness, fairness)
Project description
Extension of text_explainability for sensitivity testing (robustness, fairness).
Marcel Robeer, 2021
Installation
Method | Instructions |
---|---|
pip |
Install from PyPI via pip3 install text_sensitivity . |
Local | Clone this repository and install via pip3 install -e . or locally run python3 setup.py install . |
Documentation
Full documentation of the latest version is provided at https://marcelrobeer.github.io/text_sensitivity/.
Example usage
See example_usage.md to see an example of how the package can be used, or run the lines in example_usage.py
to do explore it interactively.
Releases
text_explainability
is officially released through PyPI.
See CHANGELOG.md for a full overview of the changes for each version.
Citation
@misc{text_sensitivity,
title = {Python package text_sensitivity},
author = {Marcel Robeer and Elize Herrewijnen},
howpublished = {\url{https://git.science.uu.nl/m.j.robeer/text_sensitivity}},
year = {2021}
}
Maintenance
Contributors
- Marcel Robeer (
@m.j.robeer
) - Elize Herrewijnen (
@e.herrewijnen
)
Todo
Tasks yet to be done:
- Word-level perturbations
- Add fairness-specific metrics:
- Subgroup fairness
- Counterfactual fairness
- Add expected behavior
- Robustness: equal to prior prediction, or in some cases might expect that it deviates
- Fairness: may deviate from original prediction
- Tests
- Add tests for perturbations
- Add tests for sensitivity testing schemes
- Add visualization ability
Credits
- Edward Ma. NLP Augmentation. 2019.
- Daniele Faraglia and other contributors. Faker. 2012.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
text_sensitivity-0.1.7.tar.gz
(1.1 MB
view hashes)
Built Distributions
Close
Hashes for text_sensitivity-0.1.7-py3.9.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | d27aeb717d398d2a61470436363314c509a4525f07b482ca4ce6ef9f5d31c33a |
|
MD5 | b66da7bb5bd637da72e3f13b345bd423 |
|
BLAKE2b-256 | fc18dd5446ba5600daa659bc0155cecbca4e2c8cf10331533f41fb9548a4870f |
Close
Hashes for text_sensitivity-0.1.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4c36dbcd44f55e3587cc5483997a0bd48dd436ab0d1d1ad6cedf645b879e19d6 |
|
MD5 | 53a65d40cc39df343f5b8afa8eb5ab72 |
|
BLAKE2b-256 | ba15334ff784839549b8409814135562513ef527e2519d61b01a870909922bcd |