Unwanted Content Detector
A library to detect undesired, unbranded, or harmful content
Usage
In python:
pip install unwanted-content-detector --upgrade
With Pandas
import pandas as pd
from unwanted_content_detector import Detector
detector = Detector()
df = pd.DataFrame({"text": [
"this is hate speech",
"We should all do our part to protect the environment.",
'Everyone has the right to love who they want.'
]})
df['is_unwanted'] = df['text'].apply(lambda x: detector.is_unwanted(x))
To get a view of the complete options type in the terminal:
unwanted_detector
Models
| Model name | size (mb) |
|---|---|
| distilbert-finetuned | 300 mb |
Training
unwanted_detector train
Liability
This tool aims to help you to detect harmful content but it is not meant to be used as the final decision maker alone.
Release files for unwanted-content-detector 0.1.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| unwanted_content_detector-0.1.8.tar.gz | 8.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| unwanted_content_detector-0.1.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 20.8 kB
Release files / unwanted_content_detector-0.1.8.tar.gz
| Download URL | unwanted_content_detector-0.1.8.tar.gz |
|---|---|
| Size | 8.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
02ffcb499a8bfdfb174fba2f603f80ce502bcca8d10f7ea514a073880d6fad6f
|
|
BLAKE2b-256 checksum How to use checksums |
17475eaabcae69bba557d17543846c046f07fc37b440cda01f2f9da915c9fd6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.4.0 CPython/3.10.9 Darwin/22.3.0
|
Release files / unwanted_content_detector-0.1.8-py3-none-any.whl
| Download URL | unwanted_content_detector-0.1.8-py3-none-any.whl |
|---|---|
| Size | 11.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9e8a3e1a554d5e0785cf6c6182a0a4b382851f82b436c911ac454155ab80ced6
|
|
BLAKE2b-256 checksum How to use checksums |
8465698a156a8e0d50a6c8fe881296543eee848d9623b05d2361b1ad37a8fe71
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.4.0 CPython/3.10.9 Darwin/22.3.0
|