Feature
- handle over 100 dataset
- generate statistic report about processed dataset
- support many pre-processing ways
- Provide a panel for entering your parameters at runtime
- easy to adapt your own dataset and pre-processing utility
Online Explorer
https://voidful.github.io/NLPrep-Datasets/
Documentation
Learn more from the docs.
Quick Start
Installing via pip
pip install nlprep
get one of the dataset
nlprep --dataset clas_udicstm --outdir sentiment
You can also try nlprep in Google Colab:
Overview
$ nlprep
arguments:
--dataset which dataset to use
--outdir processed result output directory
optional arguments:
-h, --help show this help message and exit
--util data preprocessing utility, multiple utility are supported
--cachedir dir for caching raw dataset
--infile local dataset path
--report generate a html statistics report
Contributing
Thanks for your interest.There are many ways to contribute to this project. Get started here.
License 
Icons reference
Icons modify from Darius Dan from www.flaticon.com
Icons modify from Freepik from www.flaticon.com
Metadata
Release files for nlprep 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| nlprep-0.2.1.tar.gz | 33.5 kB | Without provenance | Details for nlprep-0.2.1.tar.gz |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| nlprep-0.2.1-py3.7.egg | Legacy Egg format | - | - | Details for nlprep-0.2.1-py3.7.egg |
| nlprep-0.2.1-py3-none-any.whl | Python 3 | none | any | Details for nlprep-0.2.1-py3-none-any.whl |
Total release size: 197.3 kB
Release files / nlprep-0.2.1.tar.gz
| Download URL | nlprep-0.2.1.tar.gz |
|---|---|
| Size | 33.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
331c14feb982fd74925213f71b107d73ec3b8a62e5f97e29a3ae1e0820cd8123
|
|
BLAKE2b-256 checksum How to use checksums |
c5c5d8ce3379cb1f35625c2280486b83d274579c6dc948d0542fc8753d3f00cf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
Release files / nlprep-0.2.1-py3.7.egg
| Download URL | nlprep-0.2.1-py3.7.egg |
|---|---|
| Size | 112.2 kB |
| Tags | Egg |
|
SHA-256 checksum How to use checksums |
4ffc137c3a2f6c154448fc894cc3498de2012a1eb9c2a9114693f816af676a22
|
|
BLAKE2b-256 checksum How to use checksums |
8c98caf33600ddc7422e7f63aa38d4aeff537326939e9b6a4f6ef792689a0de3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
Release files / nlprep-0.2.1-py3-none-any.whl
| Download URL | nlprep-0.2.1-py3-none-any.whl |
|---|---|
| Size | 51.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
07fcb242bd2a95d79b23641e15a13d3839ac3fe8cb1061839de8324ee6bd6792
|
|
BLAKE2b-256 checksum How to use checksums |
8eb41460e80ffd9e1abc1e5449402b3513f6eff1d40aa651981eaed21616ac11
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
Security for nlprep 0.2.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.