Skip to main content

TextTools is a high-level NLP toolkit built on top of modern LLMs.

Project description

TextTools

📌 Overview

TextTools is a high-level NLP toolkit built on top of modern LLMs.
It provides ready-to-use utilities for translation, question detection, keyword extraction, categorization, NER extractor, and more — designed to help you integrate AI-powered text processing into your applications with minimal effort.


✨ Features

TextTools provides a rich collection of high-level NLP utilities built on top of LLMs.
Each tool is designed to work out-of-the-box with structured outputs (JSON / Pydantic).

  • Categorizer → Zero-finetuning text categorization for fast, scalable classification.
  • Keyword Extractor → Identify the most important keywords in a text.
  • Question Merger → Merge the provided questions, preserving all the main points
  • NER (Named Entity Recognition) Extractor → Extract people, places, organizations, and other entities.
  • Question Detector → Determine whether a text is a question or not.
  • Question Generator From Text → Generate high-quality, context-relevant questions from provided text.
  • Question Generator From Subject → Generate high-quality, context-relevant questions from a subject.
  • Rewriter → Rewrite text while preserving meaning or without it.
  • Summarizer → Condense long passages into clear, structured summaries.
  • Translator → Translate text across multiple languages, with support for custom rules.

🔍 with_analysis Mode

The with_analysis=True flag enhances the tool's output by providing a detailed reasoning chain behind its result. This is valuable for debugging, improving prompts, or understanding model behavior.

Please be aware: This feature works by making an additional LLM API call for each tool invocation, which will effectively double your token usage for that operation.


🚀 Installation

Install the latest release via PyPI:

pip install -U hamta-texttools

⚡ Quick Start

from openai import OpenAI

from texttools import TheTool

# Create your OpenAI client
client = OpenAI(base_url = "your_url", API_KEY = "your_api_key")

# Specify the model
model = "gpt-4o-mini"

# Create an instance of TheTool
# ⚠️ Note: Enabling `with_analysis=True` provides deeper insights but incurs additional LLM calls and token usage.
the_tool = TheTool(client = client, model = model, with_analysis = True)

# Example: Question Detection
print(the_tool.detect_question("Is this project open source?")["result"])
# Output: True

# Example: Translation
print(the_tool.translate("سلام، حالت چطوره؟")["result"])
# Output: "Hi! How are you?"

📚 Use Cases

Use TextTools when you need to:

  • 🔍 Classify large datasets quickly without model training
  • 🌍 Translate and process multilingual corpora with ease
  • 🧩 Integrate LLMs into production pipelines (structured outputs)
  • 📊 Analyze large text collections using embeddings and categorization
  • ⚙️ Automate common text-processing tasks without reinventing the wheel

🤝 Contributing

Contributions are welcome!
Feel free to open issues, suggest new features, or submit pull requests.


License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hamtaa_texttools-1.0.2.tar.gz (19.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hamtaa_texttools-1.0.2-py3-none-any.whl (26.2 kB view details)

Uploaded Python 3

File details

Details for the file hamtaa_texttools-1.0.2.tar.gz.

File metadata

  • Download URL: hamtaa_texttools-1.0.2.tar.gz
  • Upload date:
  • Size: 19.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for hamtaa_texttools-1.0.2.tar.gz
Algorithm Hash digest
SHA256 c243e895a5d5bad14eb291d528ca20e01ef2cc226255fb6433a66534d9dda1e4
MD5 bdb388dbd27f3a4108f50b83e6f322c7
BLAKE2b-256 d9b9ab0cbf99d8f32d9542f5647df9c47ac7d5fd050241f801cc3f31b7d8b22e

See more details on using hashes here.

File details

Details for the file hamtaa_texttools-1.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for hamtaa_texttools-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5fe8f1d0b25437c4d9068a210620ddceb45c10a91f0aab81e45bb075ae59ce75
MD5 26aa5934e94ac096cea106b7356f6c57
BLAKE2b-256 610c8b3b0370cd9c9fcc36a09368aed117f90283ce45580eae7940f73bbfa425

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page