Easy-to-use package for grouping, tagging and finding similar documents, using advanced natural language processing techniques
Easy-to-use library for grouping, tagging and finding similar documents, using advanced natural language processing techniques.
The initial purpose of this package is for finding similar or related documents. The typical use case for this is news apps that want to display related content for a particular news story.
Many developers don’t have the time to invest in learning the best practices for this, so this module provides a simple package for loading all the content to consider and then a function that given a passage of text, will find all the related stories.
How to use:
Simply install the library with pip and import the VectorSpaceModel
from clumb import VectorSpaceModel training_docs = ['Some pieces of text', 'More text'] # build the model model = VectorSpaceModel(training_docs) # find the three most similar documents similar = model.find_similar('Another text', n=3) print(similar)
- Small contextual consideration.
- Performance on large datasets
- Document clustering
- Automatic tagging
- Topic classification
- Performance improvements by pre clustering documents into large groups, then searching just the similar clusters.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.