Skip to main content

Modular agent orchestrator for reasoning pipelines

Project description

OrKa

OrKa Logo

Tests

WEB

Orchestrator Kit for Agentic Reasoning - OrKa is a modular AI orchestration system that transforms Large Language Models (LLMs) into composable agents capable of reasoning, fact-checking, and constructing answers with transparent traceability.

🚀 Features

  • Modular Agent Orchestration: Define and manage agents using intuitive YAML configurations.
  • Configurable Reasoning Paths: Utilize Redis streams to set up dynamic reasoning workflows.
  • Comprehensive Logging: Record and trace every step of the reasoning process for transparency.
  • Built-in Integrations: Support for OpenAI agents, web search functionalities, routers, and validation mechanisms.
  • Command-Line Interface (CLI): Execute YAML-defined workflows with ease.

🎥 OrKa Video Overview

Watch the video

Click the thumbnail above to watch a quick video demo of OrKa in action — how it uses YAML to orchestrate agents, log reasoning, and build transparent LLM workflows.


🛠️ Installation

PIP Installation

  1. Install the Package:

    pip install orka-reasoning
    
  2. Install Additional Dependencies:

    pip install fastapi uvicorn
    
  3. Start the Services:

    python -m orka.orka_start
    

Local Development Installation

  1. Clone the Repository:

    git clone https://github.com/marcosomma/orka.git
    cd orka
    
  2. Install Dependencies:

    pip install -e .
    pip install fastapi uvicorn
    
  3. Start the Services:

    python -m orka.orka_start
    

📝 Usage

Building Your Orchestrator

Create a YAML configuration file (e.g., example.yml):

orchestrator:
  id: fact-checker
  strategy: decision-tree
  queue: orka:fact-core
  agents:
    - domain_classifier
    - is_fact
    - validate_fact

agents:
  - id: domain_classifier
    type: openai-classification
    prompt: >
      Classify this question into one of the following domains:
      - science, geography, history, technology, date check, general
    options: [science, geography, history, technology, date check, general]
    queue: orka:domain

  - id: is_fact
    type: openai-binary
    prompt: >
      Is this a {{ input }} factual assertion that can be verified externally? Answer TRUE or FALSE.
    queue: orka:is_fact

  - id: validate_fact
    type: openai-binary
    prompt: |
      Given the fact "{{ input }}", and the search results "{{ previous_outputs.duck_search }}"?
    queue: validation_queue

Running Your Orchestrator

import orka.orka_cli

if __name__ == "__main__":
    # Path to your YAML orchestration config
    config_path = "example.yml"

    # Input to be passed to the orchestrator
    input_text = "What is the capital of France?"

    # Run the orchestrator with logging
    orka.orka_cli.run_cli_entrypoint(
        config_path=config_path,
        input_text=input_text,
        log_to_file=True
    )

🔧 Requirements

  • Python 3.8 or higher
  • Redis server
  • Docker (for containerized deployment)
  • Required Python packages:
    • fastapi
    • uvicorn
    • redis
    • pyyaml
    • litellm
    • jinja2
    • google-api-python-client
    • duckduckgo-search
    • python-dotenv
    • openai
    • async-timeout
    • pydantic
    • httpx

📄 Usage

📄 OrKa Nodes and Agents Documentation

📊 Agents

BinaryAgent
  • Purpose: Classify an input into TRUE/FALSE.
  • Input: A dict containing a string under "input" key.
  • Output: A boolean value.
  • Typical Use: "Is this sentence a factual statement?"
ClassificationAgent
  • Purpose: Classify input text into predefined categories.
  • Input: A dict with "input".
  • Output: A string label from predefined options.
  • Typical Use: "Classify a sentence as science, history, or nonsense."
OpenAIBinaryAgent
  • Purpose: Use an LLM to binary classify a prompt into TRUE/FALSE.
  • Input: A dict with "input".
  • Output: A boolean.
  • Typical Use: "Is this a question?"
OpenAIClassificationAgent
  • Purpose: Use an LLM to classify input into multiple labels.
  • Input: Dict with "input".
  • Output: A string label.
  • Typical Use: "What domain does this question belong to?"
OpenAIAnswerBuilder
  • Purpose: Build a detailed answer from a prompt, usually enriched by previous outputs.
  • Input: Dict with "input" and "previous_outputs".
  • Output: A full textual answer.
  • Typical Use: "Answer a question combining search results and classifications."
DuckDuckGoAgent
  • Purpose: Perform a real-time web search using DuckDuckGo.
  • Input: Dict with "input" (the query string).
  • Output: A list of search result strings.
  • Typical Use: "Search for latest information about OrKa project."

🧵 Nodes

RouterNode
  • Purpose: Dynamically route execution based on a prior decision output.
  • Input: Dict with "previous_outputs".
  • Routing Logic: Matches a decision_key's value to a list of next agent ids.
  • Typical Use: "Route to search agents if external lookup needed; otherwise validate directly."
FailoverNode
  • Purpose: Execute multiple child agents in sequence until one succeeds.
  • Input: Dict with "input".
  • Behavior: Tries each child agent. If one crashes/fails, moves to next.
  • Typical Use: "Try web search with service A; if unavailable, fallback to service B."
FailingNode
  • Purpose: Intentionally fail. Used to simulate errors during execution.
  • Input: Dict with "input".
  • Output: Always throws an Exception.
  • Typical Use: "Test failover scenarios or resilience paths."
ForkNode
  • Purpose: Split execution into multiple parallel agent branches.
  • Input: Dict with "input" and "previous_outputs".
  • Behavior: Launches multiple child agents simultaneously. Supports sequential (default) or full parallel execution.
  • Options:
  • targets: List of agents to fork.
  • mode: "sequential" or "parallel".
  • Typical Use: "Validate topic and check if a summary is needed simultaneously.
JoinNode
  • Purpose: Wait for multiple forked agents to complete, then merge their outputs.
  • Input: Dict including fork_group_id (forked group name).
  • Behavior: Suspends execution until all required forked agents have completed. Then aggregates their outputs.
  • Typical Use: "Wait for parallel validations to finish before deciding next step.""

📊 Summary Table

Name Type Core Purpose
BinaryAgent Agent True/False classification
ClassificationAgent Agent Category classification
OpenAIBinaryAgent Agent LLM-backed binary decision
OpenAIClassificationAgent Agent LLM-backed category decision
OpenAIAnswerBuilder Agent Compose detailed answer
DuckDuckGoAgent Agent Perform web search
RouterNode Node Dynamically route next steps
FailoverNode Node Resilient sequential fallback
FailingNode Node Simulate failure
WaitForNode Node Wait for multiple dependencies
ForkNode Node Parallel execution split
JoinNode Node Parallel execution merge

🚀 Quick Usage Tip

Each agent and node in OrKa follows a simple run pattern:

output = agent_or_node.run(input_data)

Where input_data includes "input" (the original query) and "previous_outputs" (completed agent results).

This consistent interface is what makes OrKa composable and powerful.

OrKa operates based on YAML configuration files that define the orchestration of agents.

  1. Prepare a YAML Configuration: Create a YAML file (e.g., example.yml) that outlines your agentic workflow.
  2. Run OrKa with the Configuration:
    python -m orka.orka_cli ./example.yml "Your input question" --log-to-file
    

This command processes the input question through the defined workflow and logs the reasoning steps.

📝 YAML Configuration Structure

The YAML file specifies the agents and their interactions. Below is an example configuration:

orchestrator:
  id: fact-checker
  strategy: decision-tree
  queue: orka:fact-core
  agents:
    - domain_classifier
    - is_fact
    - validate_fact

agents:
  - id: domain_classifier
    type: openai-classification
    prompt: >
      Classify this question into one of the following domains:
      - science, geography, history, technology, date check, general
    options: [science, geography, history, technology, date check, general]
    queue: orka:domain

  - id: is_fact
    type: openai-binary
    prompt: >
      Is this a {{ input }} factual assertion that can be verified externally? Answer TRUE or FALSE.
    queue: orka:is_fact

  - id: validate_fact
    type: openai-binary
    prompt: |
      Given the fact "{{ input }}", and the search results "{{ previous_outputs.duck_search }}"?
    queue: validation_queue

Key Sections

  • agents: Defines the individual agents involved in the workflow. Each agent has:

    • name: Unique identifier for the agent.
    • type: Specifies the agent's function (e.g., search, llm).
  • workflow: Outlines the sequence of interactions between agents:

    • from: Source agent or input.
    • to: Destination agent or output.

Settings such as the model and API keys are loaded from the .env file, keeping your configuration secure and flexible.

🧪 Example

To see OrKa in action, use the provided example.yml configuration:

python -m orka.orka_cli ./example.yml "What is the capital of France?" --log-to-file

This will execute the workflow defined in example.yml with the input question, logging each reasoning step.

📚 Documentation

📘 View the Documentation

🤝 Contributing

We welcome contributions! Please see our CONTRIBUTING.md for guidelines.

📜 License & Attribution

This project is licensed under the CC BY-NC 4.0 License. For more details, refer to the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

orka_reasoning-0.3.7.tar.gz (35.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

orka_reasoning-0.3.7-py3-none-any.whl (34.0 kB view details)

Uploaded Python 3

File details

Details for the file orka_reasoning-0.3.7.tar.gz.

File metadata

  • Download URL: orka_reasoning-0.3.7.tar.gz
  • Upload date:
  • Size: 35.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.12

File hashes

Hashes for orka_reasoning-0.3.7.tar.gz
Algorithm Hash digest
SHA256 a3b5b0e9584004f2b5cba5955c5374daabb55a9e74f6fa27f0b4fc030a1bf5ec
MD5 b3182ca2d810ea58fa29589cb614001c
BLAKE2b-256 e6f48dcc8073a981ba626449f2b1381cdd239e9ea2f3881ffb35969abe08b4da

See more details on using hashes here.

File details

Details for the file orka_reasoning-0.3.7-py3-none-any.whl.

File metadata

  • Download URL: orka_reasoning-0.3.7-py3-none-any.whl
  • Upload date:
  • Size: 34.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.12

File hashes

Hashes for orka_reasoning-0.3.7-py3-none-any.whl
Algorithm Hash digest
SHA256 527163487e065882132a55f66a39f7d5765f5f80dea1406c4f1ab5ede5a13ab1
MD5 9b4e7dfe5932ea16bc6f16168f3c0784
BLAKE2b-256 f756e744bb03205ad6c8e9ff74425ca3727a8370a64bac9cff807b98a75603ba

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page