reach 0.0.1

A light-weight package for working with pre-trained word embeddings

A light-weight package for working with pre-trained word embeddings. Useful for input into neural networks, or for doing compositional semantics.

reach can read in word vectors in word2vec or glove format without any preprocessing.

The assumption behind reach is a no-hassle approach to featurization. The vectorization and bow approaches know how to deal with OOV words, removing these problems from your code.

Similarly, reach contains OOV and PAD vectors, removing the necessity of accounting for this in your own code.

reach also includes nearest neighbour calculation for arbitrary vectors, allowing you to experiment with compositional operators.

Example

from reach import Reach.

# Word2vec style: with header.
r = Reach("path/to/embeddings", header=True)

# Glove style: without header.
r = Reach("path/to/embeddings", header=False)

# Get vectors through indexing.
# Throws a KeyError is a word is not present.
vector = r['cat']

# Compare two words.
similarity = r.similarity('cat', 'dog')

# Find most similar.
similarities = r.most_similar('cat', 5)

sentence = 'a dog is the best creature alive'.split()
corpus = [sentence, sentence, sentence]

# bow representation, consistent with word vectors, for input into neural network.
bow = r.bow(sentence)

# vectorized representation.
vectorized = r.vectorize(sentence)

# can remove OOV words automatically.
vectorized = r.vectorize(sentence, remove_oov=True)

# vectorize corpus.
transformed = r.transform(corpus)