zensols-deepnlp 0.0.6

Deep learning utility library for natural language processing that aids in feature engineering and embedding layers.

DeepZensols Natural Language Processing

Deep learning utility library for natural language processing that aids in feature engineering and embedding layers (see the full documentation).

Features:

• Configurable layers with little to no need to write code.
• Natural language specific layers:
  • Easily configurable word embedding layers for Glove, Word2Vec, fastText.
  • Huggingface transformer (BERT) context based word vector layer.
  • Full Embedding+BiLSTM-CRF implementation using easy to configure constituent layers.
• NLP specific vectorizers that generate zensols deeplearn encoded and decoded batched tensors for spaCy parsed features, dependency tree features, overlapping text features and others.
• Easily swapable during runtime embedded layers as batched tensors and other linguistic vectorized features.
• Support for token, document and embedding level vectorized features.
• Transformer word piece to linguistic token mapping.
• Two full documented examples provided as both command line and Jupyter notebooks.
• Command line support for training, testing, debugging, and creating predictions.

Documentation

See the full documentation.

Obtaining

The easiest way to install the command line program is via the pip installer:

pip3 install zensols.deepnlp

Binaries are also available on pypi.

Usage and Examples

If you're in a rush, you can dive right in to the Movie Review Sentiment example, which is a working project that uses this library. However, you'll either end up reading up on the zensols deeplearn library before or during the tutorial.

The usage of this library is explained in terms of two examples:

• The Movie Review Sentiment trained and tested on the Stanford movie review and Cornell sentiment polarity data sets, which assigns a positive or negative score to a natural language movie review by critics. Also see the Jupyter movie notebook.

• The Named Entity Recognizer trained and tested on the CoNLL 2003 data set to label named entities on natural language text. Also see the Jupyter NER notebook.

Attribution

This project, or example code, uses:

• Gensim for Glove, Word2Vec and fastText word embeddings.
• Huggingface Transformers for BERT contextual word embeddings.
• bcolz for fast read access to word embedding vectors.
• zensols nlparse for feature generation from spaCy parsing.
• zensols deeplearn for deep learning network libraries.

Corpora used include:

• Stanford movie review
• Cornell sentiment polarity
• CoNLL 2003 data set

Changelog

An extensive changelog is available here.

License

MIT License

Copyright (c) 2020 - 2021 Paul Landes