Natural language processing augmentation library for deep neural networks
Project description
[![Build Status](https://travis-ci.org/makcedward/nlpaug.svg?branch=master)](https://travis-ci.org/makcedward/nlpaug)
[![Codacy Badge](https://api.codacy.com/project/badge/Grade/2d6d1d08016a4f78818161a89a2dfbfb)](https://www.codacy.com/app/makcedward/nlpaug?utm_source=github.com&utm_medium=referral&utm_content=makcedward/nlpaug&utm_campaign=Badge_Grade)
[![Codecov Badge](https://codecov.io/gh/makcedward/nlpaug/branch/master/graph/badge.svg)](https://codecov.io/gh/makcedward/nlpaug)
# nlpaug
This python library helps you with augmenting nlp for your machine learning projects.
## Feature
* Provide both character and word level augmentations which include:
* Character Augmentation: OCR, QWERTY(Keyboard Distance), Random Behavior
* Word Augmentation: word2vec, GloVe, WordNet, Random Behavior
* Flow orchestration is supported. Flow includes:
* Sequential: Apply data augmentations one by one
* Sometimes: Apply some augmentations randomly
## Installation
The library supports python 3.5+ in linux and window platform.
To install the library:
```bash
pip install nlpaug
```
Download word2vec or GloVe files if you use `Word2VecAug` or `GloVeAug`:
* word2vec([GoogleNews-vectors-negative300](https://code.google.com/archive/p/word2vec/))
* GloVe([glove.6B.50d](https://nlp.stanford.edu/projects/glove/))
## Recent Changes
**0.0.1**: Project initialization (Mar 20, 2019)
## Test
```
Word2vec and GloVe models are used in word insertion and substitution. Those model files are necessary in order to run test case. You have to add ".env" file in root directory and the content should be
- MODEL_DIR={MODEL FILE PATH}
```
```
Folder structure of model should be
-- root directory
- glove.6B.50d.txt
- GoogleNews-vectors-negative300.bin
```
[![Codacy Badge](https://api.codacy.com/project/badge/Grade/2d6d1d08016a4f78818161a89a2dfbfb)](https://www.codacy.com/app/makcedward/nlpaug?utm_source=github.com&utm_medium=referral&utm_content=makcedward/nlpaug&utm_campaign=Badge_Grade)
[![Codecov Badge](https://codecov.io/gh/makcedward/nlpaug/branch/master/graph/badge.svg)](https://codecov.io/gh/makcedward/nlpaug)
# nlpaug
This python library helps you with augmenting nlp for your machine learning projects.
## Feature
* Provide both character and word level augmentations which include:
* Character Augmentation: OCR, QWERTY(Keyboard Distance), Random Behavior
* Word Augmentation: word2vec, GloVe, WordNet, Random Behavior
* Flow orchestration is supported. Flow includes:
* Sequential: Apply data augmentations one by one
* Sometimes: Apply some augmentations randomly
## Installation
The library supports python 3.5+ in linux and window platform.
To install the library:
```bash
pip install nlpaug
```
Download word2vec or GloVe files if you use `Word2VecAug` or `GloVeAug`:
* word2vec([GoogleNews-vectors-negative300](https://code.google.com/archive/p/word2vec/))
* GloVe([glove.6B.50d](https://nlp.stanford.edu/projects/glove/))
## Recent Changes
**0.0.1**: Project initialization (Mar 20, 2019)
## Test
```
Word2vec and GloVe models are used in word insertion and substitution. Those model files are necessary in order to run test case. You have to add ".env" file in root directory and the content should be
- MODEL_DIR={MODEL FILE PATH}
```
```
Folder structure of model should be
-- root directory
- glove.6B.50d.txt
- GoogleNews-vectors-negative300.bin
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
nlpaug-0.0.1.tar.gz
(10.7 kB
view details)
Built Distribution
nlpaug-0.0.1-py3-none-any.whl
(23.3 kB
view details)
File details
Details for the file nlpaug-0.0.1.tar.gz
.
File metadata
- Download URL: nlpaug-0.0.1.tar.gz
- Upload date:
- Size: 10.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 033f61b90accd36e1b2bcc92df292611f4b54bbfc8094eef601858dbc796f285 |
|
MD5 | 94f0b6ce163421a1d42c2c6f30e5d47b |
|
BLAKE2b-256 | a3004740d4b718685ef3875096f3769e527d01e47efec75bb23c2a981686208b |
File details
Details for the file nlpaug-0.0.1-py3-none-any.whl
.
File metadata
- Download URL: nlpaug-0.0.1-py3-none-any.whl
- Upload date:
- Size: 23.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7ec72709f8b732841dbc653efd18c183f3f5fdef949c3f02a839e290fa506b7a |
|
MD5 | f014e34a9c3c929d9198d780eb001ed5 |
|
BLAKE2b-256 | 0fb55a4ae48eba27439c5967986caf27a05746773e276fd16aa0b5f2698241ae |