cohesive 0.1

Lightweight Python library that uses sentences embeddings to create naturally coherent segments of text akin to paragraphs.

cohesive

cohesive is a lightweight segmenter that uses sentence embeddings to split documents into naturally coherent segments akin to paragraphs.

Installation

You can install 'cohesive' using pip:

pip install cohesive

Using cohesive

To start using the SDK, simply import the CohesiveTextSegmenter and create a new instance:

from cohesive import CohesiveTextSegmenter

# Instantiate the CohesiveTextSegmenter with the model that you want to use.
# By default, cohesive utilizes paraphrase-MiniLM-L6-v2, which has produced good results.
cohesive = CohesiveTextSegmenter("all-MiniLM-L6-v2")

# Then, all you need to do is call the generate_tiles method and pass in an array of sentences.
cohesive.generate_segments(sentences)