Flowra

Flow infra for building stateful, persistent LLM agents with tool use, parallel execution, and crash recovery. Requires Python 3.12+.

Features

State machine agents — define agents as Agent[Spec, Result] classes with @step methods, a single entry point, and typed spec/result contracts
Persistent state — Scalar[T] and MutableList[T] with incremental dirty-tracking and pluggable storage (in-memory, file-based, or custom)
Tool integration — @tool decorator for local functions, MCP server support, DI into tool handlers, agents as tools for LLM-driven delegation
LLM abstraction — provider-agnostic LLMProvider interface with immutable message types and real-time streaming (ships AnthropicVertexProvider, GoogleVertexProvider, OpenAIProvider, OpenAIResponsesProvider)
Agents as tools — @agent_tool decorator exposes an agent as a tool the LLM can call autonomously; sub-agent runs its own system prompt and tool loop
Cooperative interrupts — InterruptToken for graceful cancellation across the entire execution tree
Pre-built agents — ChatAgent (multi-turn chat with session history) and TurnAgent (single-turn LLM tool loop with hooks and caching)

Installation

# Base package (no LLM providers)
pip install flowra

# With specific providers
pip install flowra[anthropic]
pip install flowra[openai]
pip install flowra[google]

# All providers
pip install flowra[providers]

Quick start

import asyncio

from flowra.agent import AgentRuntime, InMemorySessionStorage
from flowra.lib import LLMConfig
from flowra.lib.chat import ChatAgent, ChatConfig, ChatResult, ChatSpec
from flowra.llm import LLMProvider, SystemMessage, TextBlock
from flowra.llm.providers.anthropic_vertex import AnthropicVertexProvider


async def main() -> None:
    async with AnthropicVertexProvider() as provider:
        config = ChatConfig(
            llm_config=LLMConfig(provider=provider, model="claude-sonnet-4-5@20250929"),
            system=[SystemMessage(blocks=[TextBlock(text="You are a helpful assistant.")])],
        )

        runtime = AgentRuntime(
            agents={"chat": ChatAgent},
            storage=InMemorySessionStorage(),
            services={ChatConfig: config},
        )

        while True:
            user_input = input("You: ")
            if not user_input:
                break

            result = await runtime.run(agent=ChatAgent, spec=ChatSpec(user_message=user_input))

            if isinstance(result, ChatResult) and result.response:
                print(f"Assistant: {result.response}")


asyncio.run(main())

Package structure

flowra/
├── llm/        # LLM abstraction (messages, blocks, provider interface)
├── tools/      # Tool definition, registration, execution
├── agent/      # Agent framework + execution engine + persistence
└── lib/        # Pre-built agents (ChatAgent, TurnAgent, hooks, caching)

Documentation

Getting Started — from installation to a working chatbot with tools in 5 minutes
Working with LLMs — providers, streaming, structured output, caching, extended thinking
Tools — tool groups, MCP servers, service injection
Agents — custom agents, state machines, control flow, parallel execution
Patterns — multi-agent patterns: router, pipeline, race, fan-out
Observability — hooks, spans, MLflow and OTel integrations

Development

make deps      # install dependencies (uv sync)
make check     # lint + test
make chat      # run interactive console chat example

Metadata

Release files for flowra 0.0.73

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for flowra 0.0.73
File	Size	Uploaded
flowra-0.0.73.tar.gz	584.5 kB	Sep 9, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for flowra 0.0.73
File	Interpreter	ABI	Platform	Reset
flowra-0.0.73-py3-none-any.whl 151.2 kB Sep 9, 2026	Python 3	none	any	Details

Total release size: 735.8 kB

Release files / flowra-0.0.73.tar.gz

Download URL	flowra-0.0.73.tar.gz
Size	584.5 kB
Tags	Source
SHA-256 checksum How to use checksums	`c495aef3e8cdbe812ee141748574b8018559eaacf2c56e58b35550e740a2b92e`
BLAKE2b-256 checksum How to use checksums	`f8b0e0388c8c0ecad7f91b13e4feb22f8167eb97be7e3c5144c757cf59dfde0d`
Upload date	Sep 9, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.12 {"installer":{"name":"uv","version":"0.12.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Release files / flowra-0.0.73-py3-none-any.whl

Download URL	flowra-0.0.73-py3-none-any.whl
Size	151.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`481990e6602fbc02cccf8eb47517e80a7f917214005f02d6645009791a15e538`
BLAKE2b-256 checksum How to use checksums	`2d502e0ffcd55d2740b4e24515fb245ddfac903c2bb2f1c02395a7d2f07ab5e7`
Upload date	Sep 9, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`uv/0.12.12 {"installer":{"name":"uv","version":"0.12.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`