Skip to main content

A flexible framework for building AI assistants using various LLMs

Project description

LLM Assistant Framework

LLM Assistant Framework is a flexible and powerful Python library for building AI assistants using various Large Language Models (LLMs). Inspired by OpenAI's Assistants API, this framework allows you to create, manage, and interact with AI assistants using different LLM providers.

Features

  • 🚀 Easy-to-use API for creating and managing AI assistants
  • 🔌 Flexible integration with multiple LLM providers
  • 💬 Thread-based conversation management
  • 🏃‍♂️ Asynchronous execution of assistant runs
  • 🛠️ Customizable and extensible architecture

Installation

You can install the LLM Assistant Framework using pip:

pip install llm-assistant-framework

Usage

from llm_assistant_framework import AssistantManager, ThreadManager, RunManager

# Initialize managers
assistant_manager = AssistantManager()
thread_manager = ThreadManager()
run_manager = RunManager(assistant_manager, thread_manager)

# Create an assistant with the custom LLM function
assistant = await assistant_manager.create_assistant(
    name="Sky Expert",
    instructions="You are an expert on atmospheric phenomena.",
    model="llama3",
    custom_llm_function=custom_llm_function,
    temperature=0.7,  # Additional parameter for the LLM
)
print(assistant)

# Create a thread
thread = await thread_manager.create_thread()
print(thread)

Contributing

We welcome contributions to the LLM Assistant Framework! If you have any ideas, suggestions, or bug reports, please open an issue or submit a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm-assistant-framework-0.1.0.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

llm_assistant_framework-0.1.0-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file llm-assistant-framework-0.1.0.tar.gz.

File metadata

  • Download URL: llm-assistant-framework-0.1.0.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.9

File hashes

Hashes for llm-assistant-framework-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ee2d88e4a90a9790860f6b3654659948bcbd97da1a3fad562a13b74b47b45c65
MD5 e8ed9e5b2f22b3556537341fe45c2551
BLAKE2b-256 84f764894022370aa6bdc88f05b569bbfa7e96c2ee12e84f8cbcdb93f480dd0c

See more details on using hashes here.

File details

Details for the file llm_assistant_framework-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_assistant_framework-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 56b7be9b3ce3cf8a494358afe9f11f87dff7cabb4be8e90ed23633bc79f97eea
MD5 625e7a6394296155609fad8f05b99590
BLAKE2b-256 7fd534cb72007270ac4a969811d98e40337dcf293b91bcd256b24a89927a3920

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page