Skip to main content

TextTools is a high-level NLP toolkit built on top of modern LLMs.

Project description

TextTools

📌 Overview

TextTools is a high-level NLP toolkit built on top of modern LLMs.
It provides ready-to-use utilities for translation, question detection, keyword extraction, categorization, NER extractor, and more — designed to help you integrate AI-powered text processing into your applications with minimal effort.


✨ Features

TextTools provides a rich collection of high-level NLP utilities built on top of LLMs.
Each tool is designed to work out-of-the-box with structured outputs (JSON / Pydantic).

  • Categorizer → Zero-finetuning text categorization for fast, scalable classification.
  • Keyword Extractor → Identify the most important keywords in a text.
  • Question Merger → Merge the provided questions, preserving all the main points
  • NER (Named Entity Recognition) Extractor → Extract people, places, organizations, and other entities.
  • Question Detector → Determine whether a text is a question or not.
  • Question Generator From Text → Generate high-quality, context-relevant questions from provided text.
  • Question Generator From Subject → Generate high-quality, context-relevant questions from a subject.
  • Rewriter → Rewrite text while preserving meaning or without it.
  • Summarizer → Condense long passages into clear, structured summaries.
  • Translator → Translate text across multiple languages, with support for custom rules.

🔍 with_analysis Mode

The with_analysis=True flag enhances the tool's output by providing a detailed reasoning chain behind its result. This is valuable for debugging, improving prompts, or understanding model behavior.

Please be aware: This feature works by making an additional LLM API call for each tool invocation, which will effectively double your token usage for that operation.


🚀 Installation

Install the latest release via PyPI:

pip install -U hamta-texttools

⚡ Quick Start

from openai import OpenAI

from texttools import TheTool

# Create your OpenAI client
client = OpenAI(base_url = "your_url", API_KEY = "your_api_key")

# Specify the model
model = "gpt-4o-mini"

# Create an instance of TheTool
# ⚠️ Note: Enabling `with_analysis=True` provides deeper insights but incurs additional LLM calls and token usage.
the_tool = TheTool(client = client, model = model, with_analysis = True)

# Example: Question Detection
print(the_tool.detect_question("Is this project open source?")["result"])
# Output: True

# Example: Translation
print(the_tool.translate("سلام، حالت چطوره؟")["result"])
# Output: "Hi! How are you?"

📚 Use Cases

Use TextTools when you need to:

  • 🔍 Classify large datasets quickly without model training
  • 🌍 Translate and process multilingual corpora with ease
  • 🧩 Integrate LLMs into production pipelines (structured outputs)
  • 📊 Analyze large text collections using embeddings and categorization
  • ⚙️ Automate common text-processing tasks without reinventing the wheel

🤝 Contributing

Contributions are welcome!
Feel free to open issues, suggest new features, or submit pull requests.


License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hamtaa_texttools-1.0.0.tar.gz (15.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hamtaa_texttools-1.0.0-py3-none-any.whl (19.0 kB view details)

Uploaded Python 3

File details

Details for the file hamtaa_texttools-1.0.0.tar.gz.

File metadata

  • Download URL: hamtaa_texttools-1.0.0.tar.gz
  • Upload date:
  • Size: 15.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for hamtaa_texttools-1.0.0.tar.gz
Algorithm Hash digest
SHA256 a9cf30291842c6d9261a83b65d6f08d5593039beb1678200f816dd1f356f4204
MD5 ce809eaf4e1dc3c37156bad97f7a38ae
BLAKE2b-256 779b2ad011bab73d17bc67e831bc38d5c4b442a72ec785097ff8ad820d56936f

See more details on using hashes here.

File details

Details for the file hamtaa_texttools-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for hamtaa_texttools-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 82e7e8867ee3ec545fb8dab69d060194c76e8fb40d21035959c865db1422c691
MD5 9397fa15243a76fe3df67a5ea65b2978
BLAKE2b-256 96b13c65d3b19ccb4b1563a3533e2288b17651f2a955355acd2eda86c4afdaa1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page