Skip to main content

Declarative LLM Orchestration at Scale

Project description

Flock Banner

PyPI Version Python Version CI Status License Built by white duck LinkedIn Bluesky


The Problem You Know Too Well

🤯 Prompt Hell: Brittle 500-line prompts that break with every model update.
💥 System Failures: One bad LLM response crashes your entire workflow
🧪 Testing Nightmares: "How do I unit test a prompt?" (You don't.)
🧪 Measuring Quality: "How do I know my prompts are close to optimal?" (You also don't.)
📄 Output Chaos: Parsing unstructured LLM responses into reliable data
⛓️ Orchestration Limits: Moving beyond simple chains and DAGs? Good luck
🚀 Production Gap: Jupyter notebooks don't scale to enterprise systems

After building dozens of AI systems for enterprise clients, we realized the tooling was fundamentally broken.

Build with agents, not against them.

The Flock Solution

What if you could just skip that 'prompt engineering' step?

Flock is an agent framework for declarative AI workflows. You define what goes in and what should come out, the how is handled by the agent.
No brittle prompts. No guesswork. Just reliable, testable AI agents.

Declarative Contracts: Define inputs/outputs with Pydantic models. Flock handles the LLM complexity.
Built-in Resilience: Automatic retries, state persistence, and workflow resumption via Temporal.io
🧪 Actually Testable: Clear contracts make agents unit-testable like any other code
🧪 Optimal Quality: Agents posses multiple self-optimization algorithms based on latest research
🚀 Dynamic Workflows: Self-correcting loops, conditional routing, and intelligent decision-making
🔧 Zero-Config Production: Deploy as REST APIs with one command. Scale without rewriting.

Ready to see it in action?

⚡ Quick Start

from flock.core import Flock, DefaultAgent

# 1. Create the main orchestrator
my_flock = Flock(model="openai/gpt-4.1")

# 2. Declaratively define an agent
brainstorm_agent = DefaultAgent(
    name="idea_generator",
    input="topic",
    output="catchy_title, key_points",
)

# 3. Add the agent to the Flock
my_flock.add_agent(brainstorm_agent)

# 4. Run the agent!
input_data = {"topic": "The future of AI agents"}
result = my_flock.run(start_agent="idea_generator", input=input_data)

# The result is a Box object (dot-accessible dict)
print(f"Generated Title: {result.catchy_title}")
print(f"Key Points: {result.key_points}")

No 20-line prompt fiddling. Just structured output, every time.

image

Explore more examples → Flock Showcase Repository

💾 Installation - Use Flock in your project

Get started with the core Flock library:

# Using uv (recommended)
uv pip install flock-core

# Using pip
pip install flock-core

Extras: Install optional dependencies for specific features:

# Flock tools and mcp server
uv pip install flock-mcp

🔑 Installation - Develop Flock

git clone https://github.com/whiteducksoftware/flock.git
cd flock

# One-liner dev setup after cloning
pip install poethepoet && poe install

Additional provided poe tasks and commands:

poe install # Install the project
poe build # Build the project
poe docs # Serve the docs
poe format # Format the code
poe lint # Lint the code

🔑 Environment Setup

Flock uses environment variables (typically in a .env file) for configuration, especially API keys. Create a .env file in your project root:

# .env - Example

# --- LLM Provider API Keys (Required by most examples) ---
# Add keys for providers you use (OpenAI, Anthropic, Gemini, Azure, etc.)
# Refer to litellm docs (https://docs.litellm.ai/docs/providers) for names
OPENAI_API_KEY="your-openai-api-key"
# ANTHROPIC_API_KEY="your-anthropic-api-key"

# --- Tool-Specific Keys (Optional) ---
# TAVILY_API_KEY="your-tavily-search-key"
# GITHUB_PAT="your-github-personal-access-token"

# --- Default Flock Settings (Optional) ---
DEFAULT_MODEL="openai/gpt-4o" # Default LLM if agent doesn't specify

# --- Flock CLI Settings (Managed by `flock settings`) ---
# SHOW_SECRETS="False"
# VARS_PER_PAGE="20"

Be sure that the .env file is added to your .gitignore!

🐤 New in Flock 0.5.0 Kea 🐤

Keas are one of the smartest birds in the world famous for figuring out multi-step puzzles, unlatching doors, and coordinating in small groups to get what it wants.

Self-optimizing agents

Everything you need to evaluate and optimize agents

Benchmarks

Smooth Jupyter experience

Multi-Threading and Thread Safety


📚 Examples & Tutorials

For a comprehensive set of examples, ranging from basic usage to complex projects and advanced features, please visit our dedicated showcase repository:

➡️ github.com/whiteducksoftware/flock-showcase ⬅️

The showcase includes:

  • Step-by-step guides for core concepts.
  • Examples of tool usage, routing, memory, and more.
  • Complete mini-projects demonstrating practical applications.

📖 Documentation

Full documentation, including API references and conceptual explanations, can be found at:

➡️ whiteducksoftware.github.io/flock/ ⬅️

🤝 Contributing

We welcome contributions! Please see the CONTRIBUTING.md file (if available) or open an issue/pull request on GitHub.

Ways to contribute:

  • Report bugs or suggest features.
  • Improve documentation.
  • Contribute new Modules, Evaluators, or Routers.
  • Add examples to the flock-showcase repository.

📜 License

Flock is licensed under the MIT License. See the LICENSE file for details.

🏢 About

Flock is developed and maintained by white duck GmbH, your partner for cloud-native solutions and AI integration.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flock_core-0.5.0b17.tar.gz (4.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flock_core-0.5.0b17-py3-none-any.whl (650.9 kB view details)

Uploaded Python 3

File details

Details for the file flock_core-0.5.0b17.tar.gz.

File metadata

  • Download URL: flock_core-0.5.0b17.tar.gz
  • Upload date:
  • Size: 4.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.22

File hashes

Hashes for flock_core-0.5.0b17.tar.gz
Algorithm Hash digest
SHA256 288a87cb997b5f6352fc6e76fa6566b631149f82444abbd4542f23c85fdc7295
MD5 16ee50c0b5020c95deb09459e48fa6ff
BLAKE2b-256 b7578c893b3233b32a396bd2e08781c8f52d36982d0b09e06d9e067bb4dea48e

See more details on using hashes here.

File details

Details for the file flock_core-0.5.0b17-py3-none-any.whl.

File metadata

File hashes

Hashes for flock_core-0.5.0b17-py3-none-any.whl
Algorithm Hash digest
SHA256 a61f131eb455d73426c4b03191680ef5332e96d1d116d38ec31f690f3854c6bc
MD5 498c681f882423fb93e1fed984859f0d
BLAKE2b-256 7962488d6ce68fcb433b69ea02583ea7e52332f393ae69a1622fbd2c9fabd2ff

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page