Skip to main content

Document Polluter

Overview

Document Polluter replaces gendered words in documents to create test data for machine learning models in order to identify bias.

Checkout the examples in the interactive notebook.

Installation

document-polluter is available on PyPI

http://pypi.python.org/pypi/document-polluter

Install via pip

$ pip install document-polluter

Install via easy_install

$ easy_install document-polluter

Install from repo

git repo <https://github.com/gregology/document-polluter>

$ git clone --recursive git://github.com/gregology/document-polluter.git
$ cd document-polluter
$ python setup.py install

Basic usage

>>> from document_polluter import DocumentPolluter
>>> documents = ['she shouted', 'my son', 'the parent']
>>> dp = DocumentPolluter(documents=documents, genre='gender')
>>> print(dp.polluted_documents['female'])
['she shouted', 'my daughter', 'the mother']

Running Test

$ python document_polluter/tests.py

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

document-polluter-0.0.4.tar.gz (3.8 kB view details)

Uploaded Source

File details

Details for the file document-polluter-0.0.4.tar.gz.

File metadata

  • Download URL: document-polluter-0.0.4.tar.gz
  • Upload date:
  • Size: 3.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.8.0

File hashes

Hashes for document-polluter-0.0.4.tar.gz
Algorithm Hash digest
SHA256 255ddc3180d318dc5233dabb8d3246aecb4e99330dd74ff012ec8cddaee52899
MD5 a91e1c3d5e4c089c0cc820aa2421e7c4
BLAKE2b-256 c73c29ed3a19763c8b92aaa369e84687189cd7dd74e4f0b50e1948fd1b4459da

See more details on using hashes here.

Release history Release notifications | RSS feed

0.0.7

1 file

0.0.6

1 file

0.0.5

1 file

This release

0.0.4 This release

1 file

0.0.3

1 file

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page