llmflows 0.0.6

LLMFlows - Simple, Explicit and Transparent LLM Apps

LLMFlows - Simple, Explicit, and Transparent LLM Apps

Documentation: https://readthedocs.org
PyPI: https://pypi.org/project/llmflows
Twitter: https://twitter.com/LLMFlows
Substack: https://llmflows.substack.com

About

LLMFlows is a framework for building simple, explicit, and transparent LLM applications.

Installation

pip install llmflows

Philosophy

Simple

Our goal is to build a simple, well-documented framework with minimal abstractions that allow users to build flexible LLM-powered apps without compromising on capabilities.

Explicit

We want to create an explicit API enabling users to write clean and readable code while easily creating complex flows of LLMs interacting with each other.

Transparent

We aim to help users have full transparency on their LLM-powered apps by providing traceable flows and complete information for each app component, making it easy to monitor, maintain, and debug.

Usage

You can quickly build a simple application with LLMFlows' LLM and PrompTemplate classes:

from llmflows.llms.openai import OpenAI
from llmflows.prompts.prompt_template import PromptTemplate

prompt_template = PromptTemplate(
   prompt="Generate a title for a 90s hip-hop song about {topic}."
)
llm_prompt = prompt_template.get_prompt(topic="friendship")

llm = OpenAI()
song_title = llm.generate(llm_prompt)

However, real-world applications are often more complex and have dependencies between prompts and LLM calls. For example:

You can build such flow using the Flow and Flowstep classes. LLMFlows will figure out the dependencies and make sure each flowstep runs only when all its dependencies are met:

from llmflows.flows import Flow, FlowStep
from llmflows.llms import OpenAI
from llmflows.prompts import PromptTemplate

# Create prompt templates
title_template = PromptTemplate("What is a good title of a movie about {topic}?")
song_template = PromptTemplate(
    "What is a good song title of a soundtrack for a movie called {movie_title}?"
)
characters_template = PromptTemplate(
    "What are two main characters for a movie called {movie_title}?"
)
lyrics_template = PromptTemplate(
    "Write lyrics of a movie song called {song_title}. The main characters are "
    "{main_characters}"
)

# Create flowsteps
flowstep1 = FlowStep(
    name="Flowstep 1",
    llm=OpenAI(),
    prompt_template=title_template,
    output_key="movie_title",
)

flowstep2 = FlowStep(
    name="Flowstep 2",
    llm=OpenAI(),
    prompt_template=song_template,
    output_key="song_title",
)

flowstep3 = FlowStep(
    name="Flowstep 3",
    llm=OpenAI(),
    prompt_template=characters_template,
    output_key="main_characters",
)

flowstep4 = FlowStep(
    name="Flowstep 4",
    llm=OpenAI(),
    prompt_template=lyrics_template,
    output_key="song_lyrics",
)

# Connect flowsteps
flowstep1.connect(flowstep2, flowstep3, flowstep4)
flowstep2.connect(flowstep4)
flowstep3.connect(flowstep4)

# Create and run Flow
soundtrack_flow = Flow(flowstep1)
results = soundtrack_flow.start(topic="friendship", verbose=True)

In addition, LLMFlows provides async classes to improve the runtime of any complex flow by running flow steps that already have all their required inputs in parallel. Check our documentation for more examples, such as creating question-answering apps and web applications with Flask and FastAPI.

FAQ

How is this different than langchain?

Langchain is a great library, and LLMFlows has undoubtedly been inspired by it. However, our philosophy is a bit different. Langchian has a "chain for everything" philosophy and provides many classes with multiple LLM calls, logic, and built-in default prompts. While this is great for beginners and default use cases, we feel this can be overwhelming if users want to do anything "out of the ordinary." In contrast, we are focusing on providing as few building blocks as possible and having an easy-to-understand API while matching (and in some cases exceeding) the capabilities of langchain.

You only have OpenAI wrappers, but I want to use AcmeLLM.

We decided to release the library initially supporting only OpenAI LLMs, but we have a roadmap and will slowly add new wrappers around the most popular models. If you are willing to spend some time, we are looking for contributors and maintainers.

You only support Pinecone. Do you have plans to extend the list?

Yes! Over time, we will also add Chroma, Weaviate, Redis, Elastic Search, and other popular solutions. If you want to help us out, check out our contribution section.

Why can't I find any info related to document loaders?

For the time being, we have decided not to implement document loaders for a few reasons:

1. plenty of capable libraries like Llama-index and langchain have tons of loaders.
2. We think mixing document loaders with LLM and prompt management libraries is awkward
3. since document loading usually happens in separate pipelines and is not part of the
4. LLM-powered app.
5. Real-life documents are messy. In our experience, no matter how many loaders are out
6. there, they will never cover all the specific use cases.

While we will not invest time into document loaders, we might change direction if we get significant interest and contributors.

License

LLMFlows is covered by the MIT license. For more information, check LICENCE.md.

Contributing

Thank you for spending the time to read our README! If you like what you saw and are considering contributing, please check CONTRIBUTING.md