A light-weight Python library 🐍 for deploying DAG chains of customizable Large Language Model operations. Leveraging the asyncio framework, LLM-Director allows developers to create, manage, and orchestrate actions and processes in an efficient and scalable manner. With its unique structure and integration with FastAPI, LLM-Director offes a robust solution for building applications, API endpoints, and workflow automation systems.
Project description
LLM-Director
Introduction 📖
A light-weight Python library 🐍 for deploying DAG chains of customizable Large Language Model operations. Leveraging the asyncio framework, LLM-Director allows developers to create, manage, and orchestrate actions and processes in an efficient and scalable manner. With its unique structure and integration with FastAPI, LLM-Director offes a robust solution for building applications, API endpoints, and workflow automation systems.
Quick Install⚡
To get started with LLM-Director, you can install the package using pip:
pip install llm-director
Ensure you have Python 3.7 or higher installed, as LLM-Director relies on the latest features of asyncio and FastAPI.
What You Can Build With LLM-Director 🏗️
With LLM-Director, you can create a variety of applications and systems:
-
Asynchronous Workflow Systems: Design and execute complex workflows with asynchronous actions, enhancing the efficiency and responsiveness of your applications.
-
API Endpoints: Easily integrate with FastAPI to expose your workflows as RESTful API endpoints, allowing for seamless interaction with front-end applications or external systems.
-
Automated Data Processing Pipelines: Implement pipelines for data processing, where each step can be a distinct action, conditionally processed, and managed by the Director.
-
Event-Driven Architectures: Build systems that react to specific events, trigger actions, and handle a series of responses in an orderly and scalable manner.
Documentation 📚
The LLM-Director library consists of several key components:
- Director: The central orchestrator that manages actions and listeners.
- Action: The basic unit of functionality, representing a single task or process.
- Blocks: Specialized actions such as Split, Condition, Termination, Merge, and Save, each serving a unique purpose in the workflow.
- FastAPI Integration: Methods to expose actions and workflows as API endpoints.
For detailed documentation, visit LLM-Director Documentation (Coming Soon!).
Contributing 🤝
Please Contribute! I hope to grow this fast, as I think many people will benefit from this framework.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llm_director-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 65d66c4dbddd66829530aacf3240006ccec3ce662a31bbcb63fb87f3e4506c9b |
|
MD5 | a61427b55c3d9581c093b085a02c2403 |
|
BLAKE2b-256 | a5e5733d13e1e93043af70fccba84e6668e3fcc5a3c80bd49520c12675e12ad3 |