A flexible framework for building AI assistants using various LLMs
Project description
LLM Assistant Framework
LLM Assistant Framework is a flexible and powerful Python library for building AI assistants using various Large Language Models (LLMs). Inspired by OpenAI's Assistants API, this framework allows you to create, manage, and interact with AI assistants using different LLM providers.
Features
- 🚀 Easy-to-use API for creating and managing AI assistants
- 🔌 Flexible integration with multiple LLM providers
- 💬 Thread-based conversation management
- 🏃♂️ Asynchronous execution of assistant runs
- 🛠️ Customizable and extensible architecture
Installation
You can install the LLM Assistant Framework using pip:
pip install llm-assistant-framework
Usage
from llm_assistant_framework import AssistantManager, ThreadManager, RunManager
# Initialize managers
assistant_manager = AssistantManager()
thread_manager = ThreadManager()
run_manager = RunManager(assistant_manager, thread_manager)
# Create an assistant with the custom LLM function
assistant = await assistant_manager.create_assistant(
name="Sky Expert",
instructions="You are an expert on atmospheric phenomena.",
model="llama3",
custom_llm_function=custom_llm_function,
temperature=0.7, # Additional parameter for the LLM
)
print(assistant)
# Create a thread
thread = await thread_manager.create_thread()
print(thread)
Contributing
We welcome contributions to the LLM Assistant Framework! If you have any ideas, suggestions, or bug reports, please open an issue or submit a pull request.
License
This project is licensed under the MIT License. See the LICENSE file for more details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file llm-assistant-framework-0.1.0.tar.gz
.
File metadata
- Download URL: llm-assistant-framework-0.1.0.tar.gz
- Upload date:
- Size: 3.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
ee2d88e4a90a9790860f6b3654659948bcbd97da1a3fad562a13b74b47b45c65
|
|
MD5 |
e8ed9e5b2f22b3556537341fe45c2551
|
|
BLAKE2b-256 |
84f764894022370aa6bdc88f05b569bbfa7e96c2ee12e84f8cbcdb93f480dd0c
|
File details
Details for the file llm_assistant_framework-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: llm_assistant_framework-0.1.0-py3-none-any.whl
- Upload date:
- Size: 4.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
56b7be9b3ce3cf8a494358afe9f11f87dff7cabb4be8e90ed23633bc79f97eea
|
|
MD5 |
625e7a6394296155609fad8f05b99590
|
|
BLAKE2b-256 |
7fd534cb72007270ac4a969811d98e40337dcf293b91bcd256b24a89927a3920
|