Skip to main content

Easy-to-use package for grouping, tagging and finding similar documents, using advanced natural language processing techniques

Project description

clump

Easy-to-use library for grouping, tagging and finding similar documents, using advanced natural language processing techniques.

The initial purpose of this package is for finding similar or related documents. The typical use case for this is news apps that want to display related content for a particular news story.

Many developers don’t have the time to invest in learning the best practices for this, so this module provides a simple package for loading all the content to consider and then a function that given a passage of text, will find all the related stories.

How to use:

Simply install the library with pip and import the VectorSpaceModel

from clumb import VectorSpaceModel
training_docs = ['Some pieces of text', 'More text']

# build the model
model = VectorSpaceModel(training_docs)

# find the three most similar documents
similar = model.find_similar('Another text', n=3)
print(similar)

Current Limitations

  • Small contextual consideration.
  • Performance on large datasets 

Road Map

  • Document clustering
  • Automatic tagging
  • Topic classification
  • Performance improvements by pre clustering documents into large groups, then searching just the similar clusters.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for clump, version 0.0.5
Filename, size File type Python version Upload date Hashes
Filename, size clump-0.0.5-py3-none-any.whl (3.7 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size clump-0.0.5.tar.gz (2.5 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page