A flexible framework for building AI assistants using various LLMs
Project description
LLM Assistant Framework
LLM Assistant Framework is a flexible and powerful Python library for building AI assistants using various Large Language Models (LLMs). Inspired by OpenAI's Assistants API, this framework allows you to create, manage, and interact with AI assistants using different LLM providers.
Features
- 🚀 Easy-to-use API for creating and managing AI assistants
- 🔌 Flexible integration with multiple LLM providers
- 💬 Thread-based conversation management
- 🏃♂️ Asynchronous execution of assistant runs
- 🛠️ Customizable and extensible architecture
Installation
You can install the LLM Assistant Framework using pip:
pip install llm-assistant-framework
Usage
from llm_assistant_framework import AssistantManager, ThreadManager, RunManager
# Initialize managers
assistant_manager = AssistantManager()
thread_manager = ThreadManager()
run_manager = RunManager(assistant_manager, thread_manager)
# Create an assistant with the custom LLM function
assistant = await assistant_manager.create_assistant(
name="Sky Expert",
instructions="You are an expert on atmospheric phenomena.",
model="llama3",
custom_llm_function=custom_llm_function,
temperature=0.7, # Additional parameter for the LLM
)
print(assistant)
# Create a thread
thread = await thread_manager.create_thread()
print(thread)
Contributing
We welcome contributions to the LLM Assistant Framework! If you have any ideas, suggestions, or bug reports, please open an issue or submit a pull request.
License
This project is licensed under the MIT License. See the LICENSE file for more details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm-assistant-framework-0.1.0.tar.gz.
File metadata
- Download URL: llm-assistant-framework-0.1.0.tar.gz
- Upload date:
- Size: 3.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ee2d88e4a90a9790860f6b3654659948bcbd97da1a3fad562a13b74b47b45c65
|
|
| MD5 |
e8ed9e5b2f22b3556537341fe45c2551
|
|
| BLAKE2b-256 |
84f764894022370aa6bdc88f05b569bbfa7e96c2ee12e84f8cbcdb93f480dd0c
|
File details
Details for the file llm_assistant_framework-0.1.0-py3-none-any.whl.
File metadata
- Download URL: llm_assistant_framework-0.1.0-py3-none-any.whl
- Upload date:
- Size: 4.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
56b7be9b3ce3cf8a494358afe9f11f87dff7cabb4be8e90ed23633bc79f97eea
|
|
| MD5 |
625e7a6394296155609fad8f05b99590
|
|
| BLAKE2b-256 |
7fd534cb72007270ac4a969811d98e40337dcf293b91bcd256b24a89927a3920
|