Skip to main content

Easy-to-use package for grouping, tagging and finding similar documents, using advanced natural language processing techniques

Project description

clump

Easy-to-use library for grouping, tagging and finding similar documents, using advanced natural language processing techniques.

The initial purpose of this package is for finding similar or related documents. The typical use case for this is news apps that want to display related content for a particular news story.

Many developers don’t have the time to invest in learning the best practices for this, so this module provides a simple package for loading all the content to consider and then a function that given a passage of text, will find all the related stories.

How to use:

Simply install the library with pip and import the VectorSpaceModel

from clumb import VectorSpaceModel
training_docs = ['Some pieces of text', 'More text']

# build the model
model = VectorSpaceModel(training_docs)

# find the three most similar documents
similar = model.find_similar('Another text', n=3)
print(similar)

Current Limitations

  • Small contextual consideration.
  • Performance on large datasets 

Road Map

  • Document clustering
  • Automatic tagging
  • Topic classification
  • Performance improvements by pre clustering documents into large groups, then searching just the similar clusters.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

clump-0.0.3.tar.gz (2.5 kB view hashes)

Uploaded Source

Built Distribution

clump-0.0.3-py3-none-any.whl (3.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page