keras-ordered-neurons 0.4.0

Unofficial implementation of ON-LSTM

Keras Ordered Neurons LSTM

Unofficial implementation of ON-LSTM.

Install

pip install keras-ordered-neurons

Usage

Same as LSTM except that an extra argument chunk_size should be given:

from keras.models import Sequential
from keras.layers import Embedding, Bidirectional, Dense
from keras_ordered_neurons import ONLSTM

model = Sequential()
model.add(Embedding(input_shape=(None,), input_dim=10, output_dim=100))
model.add(Bidirectional(ONLSTM(units=50, chunk_size=5)))
model.add(Dense(units=2, activation='softmax'))
model.compile(optimizer='adam', loss='sparse_categorical_crossentropy')
model.summary()