String processing library for advanced NLP and keyword extraction
Project description
Essence
Essence is string processing library designed for advanced Natural Language Processing (NLP) and Generative AI tasks. Built in Rust, bridged to Python.
Features
- Error Correction: Enhances text accuracy by correcting spelling and grammatical errors
- Noise Removal: Eliminates irrelevant information, aiding in cost-effective prompt handling especially when using APIs with usage-based pricing
- Keyword Extraction: Extracts key terms from prompts facilitating fast searches, database lookups, and other system interactions
- Prompt Compression: Reduces operational costs in AI-driven platforms by minimizing the text data processed
- High Performance: Leverages Rust's memory safety and speed for string processing
Installation
Before installing Essence, ensure that you have Rust and Python installed on your system.
-
Install Rust:
- Visit https://rustup.rs/ and follow the instructions.
-
Install Python:
- Download and install Python from https://www.python.org/downloads/.
-
Install Essence via pip:
pip install essence-nlp
# or
pip3 install essence-nlp
Usage
from essence_nlp import processing
sentence = 'Hello i am sogtware engineer, and i designing smart mashine learning system.'
# Example 1: Correcting text
corrected_sentence = processing.corrected(sentence)
print(corrected_sentence) # Output: 'hello i am software engineer and i'm designing smart machine learning system'
# Example 2: Cleaning text
clean_sentence = processing.cleaned(sentence)
print(clean_sentence) # Output: 'hello software engineer im designing smart machine learning system'
# Example 3: Extracting keywords
keywords = processing.keywords(sentence)
print(keywords) # Output: 'im designing smart machine learning system: 36\nsoftware engineer: 4\nhello: 1'
Benchmarks
Coming soon...
Credits
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
essence-nlp-2.0.0.tar.gz
(8.7 MB
view hashes)
Built Distribution
Close
Hashes for essence_nlp-2.0.0-cp311-cp311-macosx_13_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9523df8560a9392e826bd9559325bf620c60cce74262086024a511297d7c4f86 |
|
MD5 | 8fb3de97ef7a2178cb2d3814110dc707 |
|
BLAKE2b-256 | dd9fd84fdd0a46b1fab77e16d57117b15828e963a1111c676bd7c1e99b85e4fc |