llmtext 2.0.0

A simple llm library.

llmtext

llmtext is a simple yet powerful library designed to interact with large language models (LLMs) as straightforward functions. It provides easy-to-use interfaces for both input-output text transformations and input-to-Pydantic class conversions, leveraging the power of open-source LLMs and OpenAI's schema.

Features

• Input Text, Output Text: Seamlessly generate text outputs from text inputs using large language models.
• Input Text, Output Pydantic Class: Convert text inputs directly into structured Pydantic classes for better data validation and manipulation.
• OpenAI Schema Support: Utilize OpenAI's schema for consistent and robust text processing.
• OpenSource LLMs through TogetherAI: Access a variety of open-source LLMs via TogetherAI for flexible and cost-effective solutions.
• Async by default: Asynchronous by default
• Robusts: configured with retry and self healing loop for structured extraction

Installation

You can install llmtext via pip:

pip install llmtext

Usage

Text to Text Transformation

To generate text outputs from text inputs:

from llmtext.llms.openai import OpenaiLLM

llm = OpenaiLLM()
res = await llm.arun(text="What is the capital of France?")

Text to Pydantic Class Transformation

To convert text inputs into a Pydantic class:

from llmtext.llms.openai import OpenaiLLM

llm = OpenaiLLM()

class ExtractedData(BaseModel):
    name: Annotated[str, Field(description="Name of the city")]
    description: Annotated[str, Field(description="Description of the city")]

res = await llm.astructured_extraction(text="The city of France is Paris. It's a beautiful city.", output_class=ExtractedData)
assert isinstance(res, ExtractedData)

Access open source models through togetherAI

from llmtext.llms.togetherai import TogetherAILLM

llm = TogetherAILLM()

class ExtractedData(BaseModel):
    name: Annotated[str, Field(description="Name of the city")]
    description: Annotated[str, Field(description="Description of the city")]

res = await llm.astructured_extraction(text="The city of France is Paris. It's a beautiful city.", output_class=ExtractedData)

assert isinstance(res, ExtractedData)

Configuration

To configure llmtext for using OpenAI's schema or TogetherAI's open-source LLMs, you can set the necessary API keys in your environment variables or configuration file.

Example Configuration

TOGETHERAI_API_KEY=
TOGETHER_API_BASE_URL=https://api.together.xyz/v1
OPENAI_API_KEY=

Contributing

We welcome contributions to llmtext. Please fork the repository and submit pull requests. For major changes, please open an issue first to discuss what you would like to change.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Acknowledgments

Special thanks to OpenAI for providing robust schema support and TogetherAI for enabling access to open-source LLMs.

---

For more information, please refer to the documentation.