Feature
- handle over 100 dataset
- generate statistic report about processed dataset
- support many pre-processing ways
- Provide a panel for entering your parameters at runtime
- easy to adapt your own dataset and pre-processing utility
Online Explorer
https://voidful.github.io/NLPrep-Datasets/
Documentation
Learn more from the docs.
Quick Start
Installing via pip
pip install nlprep
get one of the dataset
nlprep --dataset clas_udicstm --outdir sentiment
You can also try nlprep in Google Colab:
Overview
$ nlprep
arguments:
--dataset which dataset to use
--outdir processed result output directory
optional arguments:
-h, --help show this help message and exit
--util data preprocessing utility, multiple utility are supported
--cachedir dir for caching raw dataset
--infile local dataset path
--report generate a html statistics report
Contributing
Thanks for your interest.There are many ways to contribute to this project. Get started here.
License 
Icons reference
Icons modify from Darius Dan from www.flaticon.com
Icons modify from Freepik from www.flaticon.com
1 maintainer
Metadata
1 maintainer
Release files for nlprep 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| nlprep-0.2.1.tar.gz | 33.5 kB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| nlprep-0.2.1-py3.7.egg | Legacy Egg format | - | - | Details |
| nlprep-0.2.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 197.3 kB
Release files / nlprep-0.2.1.tar.gz
| Download URL | nlprep-0.2.1.tar.gz |
|---|---|
| Size | 33.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
331c14feb982fd74925213f71b107d73ec3b8a62e5f97e29a3ae1e0820cd8123
|
|
BLAKE2b-256 checksum How to use checksums |
c5c5d8ce3379cb1f35625c2280486b83d274579c6dc948d0542fc8753d3f00cf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
Release files / nlprep-0.2.1-py3.7.egg
| Download URL | nlprep-0.2.1-py3.7.egg |
|---|---|
| Size | 112.2 kB |
| Tags | Egg |
|
SHA-256 checksum How to use checksums |
4ffc137c3a2f6c154448fc894cc3498de2012a1eb9c2a9114693f816af676a22
|
|
BLAKE2b-256 checksum How to use checksums |
8c98caf33600ddc7422e7f63aa38d4aeff537326939e9b6a4f6ef792689a0de3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
Release files / nlprep-0.2.1-py3-none-any.whl
| Download URL | nlprep-0.2.1-py3-none-any.whl |
|---|---|
| Size | 51.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
07fcb242bd2a95d79b23641e15a13d3839ac3fe8cb1061839de8324ee6bd6792
|
|
BLAKE2b-256 checksum How to use checksums |
8eb41460e80ffd9e1abc1e5449402b3513f6eff1d40aa651981eaed21616ac11
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/57.0.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.8
|
