Skip to main content

Deep learning utility library for natural language processing that aids in feature engineering and embedding layers.

Project description

DeepZensols Natural Language Processing

PyPI Python 3.9 Python 3.10 Build Status

Deep learning utility library for natural language processing that aids in feature engineering and embedding layers.

Features:

  • Configurable layers with little to no need to write code.
  • Natural language specific layers:
  • NLP specific vectorizers that generate zensols deeplearn encoded and decoded batched tensors for spaCy parsed features, dependency tree features, overlapping text features and others.
  • Easily swapable during runtime embedded layers as batched tensors and other linguistic vectorized features.
  • Support for token, document and embedding level vectorized features.
  • Transformer word piece to linguistic token mapping.
  • Two full documented reference models provided as both command line and Jupyter notebooks.
  • Command line support for training, testing, debugging, and creating predictions.

Documentation

Obtaining

The easiest way to install the command line program is via the pip installer:

pip3 install --use-deprecated=legacy-resolver zensols.deepnlp

Binaries are also available on pypi.

Usage and Reference Models

If you're in a rush, you can dive right in to the Clickbate Text Classification reference model, which is a working project that uses this library. However, you'll either end up reading up on the zensols deeplearn library before or during the tutorial.

The usage of this library is explained in terms of the reference models:

The unit test cases are also a good resource for the more detailed programming integration with various parts of the library.

Attribution

This project, or reference model code, uses:

Corpora used include:

Citation

If you use this project in your research please use the following BibTeX entry:

@article{Landes_DiEugenio_Caragea_2021,
  title={DeepZensols: Deep Natural Language Processing Framework},
  url={http://arxiv.org/abs/2109.03383},
  note={arXiv: 2109.03383},
  journal={arXiv:2109.03383 [cs]},
  author={Landes, Paul and Di Eugenio, Barbara and Caragea, Cornelia},
  year={2021},
  month={Sep}
}

Community

Please star the project and let me know how and where you use this API. Contributions as pull requests, feedback and any input is welcome.

Changelog

An extensive changelog is available here.

License

MIT License

Copyright (c) 2020 - 2023 Paul Landes

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

zensols.deepnlp-1.9.1-py3-none-any.whl (110.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page