LLMText

logo

Overview

This codebase provides a set of tools and workflows for interacting with language models (LLMs) in an asynchronous manner. It includes functionalities for generating text, streaming text, and structured extraction from messages and text inputs. The codebase is designed to be modular and extensible, allowing for easy integration of new tools and workflows.

Features

Asynchronous Text Generation: Generate text asynchronously from user messages.
Streaming Text Generation: Stream text responses asynchronously.
Structured Extraction: Extract structured data from text inputs using predefined classes.
Workflows: Define and execute complex workflows involving multiple tools and messages.

Installation

To install the necessary dependencies, you can use the following command:

pip install llmtext

Ensure you have the required environment variables set up by creating a .env file in the root directory with the necessary configurations.

Usage

Running Tests

To run the tests, use the following command:

pytest

Example Usage

Here is an example of how to use the asynchronous text generation functionality:

from llmtext.messages_fns import agenerate
from llmtext.data_types import Message

async def main():
    text = await agenerate(
        messages=[Message(role="user", content="what's the weather today ?")]
    )
    print(text)

import asyncio
asyncio.run(main())

Agentic Workflow

Here is an example of how to use the agentic workflow functionality:

from llmtext.data_types import Message
from llmtext.workflows_fns import astream_agentic_workflow
from llmtext.data_types import RunnableTool
from typing import Annotated
from pydantic import Field

class SearchInternetTool(RunnableTool):
    """Tool to search internet"""

    query: Annotated[str, Field(description="search query")]

    async def arun(self) -> str:
        return f"there's no result for: {self.query}"

async def main():
    stream = astream_agentic_workflow(
        messages=[
            Message(role="user", content="what's the weather today ?"),
            Message(
                role="assistant",
                content="there's no result for: what's the weather today ?",
            ),
        ],
        tools=[SearchInternetTool],
    )
    async for chunk in stream:
        print(chunk)

import asyncio
asyncio.run(main())

Available Tests

test_messages.py: Tests for message-related functionalities.
test_workflows.py: Tests for workflow-related functionalities.
test_text.py: Tests for text-related functionalities.
test_tool.py: Tests for tool-related functionalities.

Code Structure

tests/: Contains all the test files.
- test_workflow/: Tests for workflow functionalities.
- tools/: Tests for tool functionalities.
llmtext/: Contains the main codebase.
- utils_fns/: Utility functions for converting messages and tools.
- data_types/: Data types used throughout the codebase.
- messages_fns/: Message-related functions.
- texts_fns/: Text-related functions.
- workflows_fns/: Workflow-related functions.

Contributing

Contributions are welcome! Please follow the standard Git workflow:

Fork the repository.
Create a new branch for your feature or bug fix.
Commit your changes.
Push your branch to your fork.
Submit a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for more details.

Contact

For any questions or issues, please open an issue on GitHub.

Release files for llmtext 5.0.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llmtext 5.0.7
File	Size	Uploaded
llmtext-5.0.7.tar.gz	7.8 kB	Jul 30, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for llmtext 5.0.7
File	Interpreter	ABI	Platform	Reset
llmtext-5.0.7-py3-none-any.whl 8.5 kB Jul 30, 2024	Python 3	none	any	Details

Total release size: 16.3 kB

Release files / llmtext-5.0.7.tar.gz

Download URL	llmtext-5.0.7.tar.gz
Size	7.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`5ca023f96d33c33822f497298b39bcc3cc2662af98238e03d4b302336d110eef`
BLAKE2b-256 checksum How to use checksums	`a863c9b3b081e2e3d5b8cd7fbeb008431de17f6a05555213fd8399b6eb397b2a`
Upload date	Jul 30, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-39-generic`

Release files / llmtext-5.0.7-py3-none-any.whl

Download URL	llmtext-5.0.7-py3-none-any.whl
Size	8.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`2eb2adfb418419bd3a82085faf574a68d871972a3f307ea35a0181007c2930d3`
BLAKE2b-256 checksum How to use checksums	`f58c84399118bdbbfbba05c4c385943ade7a67ebb7a3a96ec09ca7e4584502bf`
Upload date	Jul 30, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-39-generic`