keras-nlp 0.2.0.dev1

Industry-strength Natural Language Processing extensions for Keras.

KerasNLP

KerasNLP is a repository of modular building blocks (e.g. layers, metrics, losses) to support modern Natural Language Processing (NLP) workflows. Engineers working with applied NLP can leverage it to rapidly assemble training and inference pipelines that are both state-of-the-art and production-grade. Common use cases for application include sentiment analysis, named entity recognition, text generation, etc.

KerasNLP can be understood as a horizontal extension of the Keras API: they're new first-party Keras objects (layers, metrics, etc) that are too specialized to be added to core Keras, but that receive the same level of polish and backwards compatibility guarantees as the rest of the Keras API and that are maintained by the Keras team itself (unlike TFAddons).

Currently, KerasNLP is operating pre-release. Upon launch of KerasNLP 1.0, full API docs and code examples will be available.

Contributors

If you'd like to contribute, please see our contributing guide.

The fastest way to find a place to contribute is to browse our open issues and find an unclaimed issue to work on. Issues with a contributions welcome tag are places where we are actively looking for support, and a good first issue tag means we think this could be a accessible a first time contributor.

If you would like to propose a new symbol or feature, please open an issue to discuss. Be aware the design for new features may take longer than contributing pre-planned features. If you have a design in mind, please include a colab notebook showing the proposed design in a end-to-end example. Make sure to follow the Keras API design guidelines.

Roadmap

This is an early stage project, and we are actively working on a more detailed roadmap to share soon. For now, most of our immediate planning is done through GitHub issues.

At this stage, we are primarily building components for a short list of "greatest hits" NLP models (e.g. BERT, GPT-2, word2vec). We will be focusing on components that follow a established Keras interface (e.g. keras.layers.Layer, keras.metrics.Metric, or keras_nlp.tokenizers.Tokenizer).

As we progress further with the library, we will attempt to cover an ever expanding list of widely cited model architectures.

Releases

KerasNLP release are documented on our github release page and available to download from our PyPI project.

To install KerasNLP and all it's dependencies, simply run:

pip install keras-nlp

Compatibility

We follow Semantic Versioning, and plan to provide backwards compatibility guarantees both for code and saved models built with our components. While we continue with pre-release 0.y.z development, we may break compatibility at any time and APIs should not be consider stable.

Thank you to all of our wonderful contributors!