covalve 0.2.3

A code-based AI pipeline runtime built on Finite State Machine principles

covalve

A code-based AI pipeline runtime built on Finite State Machine principles. Gives you full control over your AI pipeline — routing, error handling, and decision making are defined in code, not in prompts.

---

Philosophy

Most AI frameworks delegate routing and decision making to LLMs automatically. covalve takes the opposite approach:

• Deterministic skeleton — flow, routing, and error handling are explicit and predictable
• Probabilistic flesh — LLMs are only used where reasoning is genuinely needed
• Schema-driven — pipeline behavior is defined in a JSON schema, not hardcoded
• Bring your own infrastructure — covalve defines the contracts, you bring the implementation

---

Installation

pip install covalve

Requirements

• Python 3.10+
• pydantic

Infrastructure dependencies (LLM, cache, database, MCP) are entirely up to your implementation. covalve only defines the interfaces.

---

Quickstart

1. Implement the infrastructure contracts

covalve requires at minimum an LLM client. Implement the abstract base classes for whatever your pipeline needs:

from covalve import LLMBase, CacheBase, MemoryStoreBase
from covalve import RuntimeMetadata, MainLLMResponse, GenerateCondition

class MyLLM(LLMBase):
    async def analyze(self, context_payload: str) -> RuntimeMetadata:
        # call any LLM — Gemini, OpenAI, Ollama, etc.
        # must return RuntimeMetadata
        ...

    async def generate(self, context_payload: str, condition: GenerateCondition) -> MainLLMResponse:
        # context_payload contains assembled conversation context
        # condition tells you if this is a clarification or guardrail rejection
        system_prompt = "You are a helpful assistant."
        full_prompt = f"{system_prompt}\n\n{context_payload}"
        ...

2. Register your implementations

from covalve import InfrastructureRegistry

deps = InfrastructureRegistry(
    llm=MyLLM(),
    cache=MyCache(),
    memory=MyStorage(),
    tools=MyToolClient(),
    log=MyLogger(),
    guardrail=MyGuardrail()
)

3. Create and run the pipeline

from covalve import pipeline, base_schema, PipelineConfig

config = PipelineConfig(dependencies=deps)
engine = pipeline(base_schema, config)

result = await engine(query="your question here", session_id="optional-session-id")

print(result.response.text)
print(result.response.status)

If session_id is not provided, one will be generated automatically.

---

Built-in Pipeline

covalve ships with a complete conversational AI pipeline for query understanding and tool-based response generation.

stateDiagram-v2
[INPUT] --> RETRIEVE_PREVIOUS_CONVERSATION
RETRIEVE_PREVIOUS_CONVERSATION --> ANALYZE : NEXT
ANALYZE --> FALLBACK : LOW_CONFIDENCE
ANALYZE --> TOOLS_MAPPER : NEXT
ANALYZE --> ERROR_COUNTER : INTERNAL_ERROR
ERROR_COUNTER --> ANALYZE : RETRY_ANALYZE
ERROR_COUNTER --> EXECUTE_TOOLS : RETRY_TOOLS
ERROR_COUNTER --> INTERNAL_SERVER_ERROR : RETRY_TIMES_OUT
TOOLS_MAPPER --> EXECUTE_TOOLS : NEXT
EXECUTE_TOOLS --> MAIN_LLM : NEXT
EXECUTE_TOOLS --> ERROR_COUNTER : INTERNAL_ERROR
FALLBACK --> MAIN_LLM : NEXT
INTERNAL_SERVER_ERROR --> SAVE_DATA_TO_PERSISTENCE : NEXT
MAIN_LLM --> SAVE_DATA_TO_PERSISTENCE : NEXT
SAVE_DATA_TO_PERSISTENCE --> [OUTPUT] : NEXT

State descriptions

State	Description
RETRIEVE_PREVIOUS_CONVERSATION	Loads conversation history from storage
ANALYZE	Classifies user query into structured intents
FALLBACK	Prepares clarification context when confidence is low
TOOLS_MAPPER	Maps intents to tools based on tools_schema
EXECUTE_TOOLS	Executes tools in priority order, parallel within same priority
MAIN_LLM	Synthesizes tool results into a final response
ERROR_COUNTER	Tracks retry attempts, routes to retry or timeout
INTERNAL_SERVER_ERROR	Prepares error response when retries are exhausted
SAVE_DATA_TO_PERSISTENCE	Saves conversation data, cleans up cache keys

Intent types

Intent	Description
explain	Conceptual questions, definitions, policy explanations
lookup	Fetch specific data records
operate	Calculations, aggregations, counts, sums, averages
validate	Check if something is valid, allowed, or compliant
compare	Compare two or more entities
source	Ingest or retrieve data from external sources

---

Tools Schema

tools_schema maps intents to tools and controls execution behavior. Required when your pipeline includes TOOLS_MAPPER or EXECUTE_TOOLS nodes.

{
    "my_tool": {
        "priority": 1,
        "skippable": true,
        "intent": ["lookup", "operate"]
    },
    "another_tool": {
        "priority": 2,
        "skippable": false,
        "intent": ["explain"]
    }
}

Field	Type	Description
priority	int	Execution order — lower runs first, same priority runs in parallel
skippable	bool	If true and tool fails, pipeline continues. If false and tool fails, triggers INTERNAL_ERROR
intent	list[str]	Intents that map to this tool — must contain at least one item

Pass it via PipelineConfig:

import json

with open("tools_schema.json") as f:
    tools_schema = json.load(f)

config = PipelineConfig(
    dependencies=deps,
    tools_schema=tools_schema
)

---

Custom Nodes

Custom nodes let you extend the pipeline with your own logic without touching covalve internals. The @node.handler decorator wraps your function and handles all PipelineContext read/write mechanics — you only work with typed, scoped context objects.

Declaring a custom node

from covalve import node, NodeContext, ReturnContext, ResponseFields, ReadsList

@node.handler(name="MY_CUSTOM_NODE", reads=[ReadsList.CONV, ReadsList.TOOLS])
async def my_custom_node(ctx: NodeContext) -> ReturnContext:
    query = ctx.readonly.query          # always available
    background = ctx.conversation.background  # available because reads=[..CONV..]
    tools_data = ctx.tools.tools_data   # available because reads=[..TOOLS..]

    # your logic here

    return ReturnContext(
        event="NEXT",
        response=ResponseFields(summarize="custom summary")
    )

reads declares which context categories your node needs access to. readonly is always injected — it does not need to be declared.

Category	Fields exposed
ReadsList.CONV	background, metadata
ReadsList.TOOLS	tools_data, executed_tools, tool_list
ReadsList.RESPONSE	response, summarize, is_clarification, fallback_content, guardrail_rejection
ReadsList.ERROR	error, last_error_emitted

Returning from a custom node

ReturnContext carries the event and any context updates. Only non-None fields are merged back — existing context values for fields you did not set are preserved.

return ReturnContext(
    event="NEXT",
    response=ResponseFields(
        summarize="updated summary"
        # response, is_clarification, etc. left None — not touched
    ),
    local={"my_key": "my_value"}   # custom-to-custom communication
)

local is the designated space for custom node communication. Native executors never read or write this field.

Registering the node in your schema

Declare the node in your schema.json and include it in the pipeline graph:

{
  "INITIAL": "RETRIEVE_PREVIOUS_CONVERSATION",
  "FINAL": "OUTPUT_TO_USER",
  "states": {
    "RETRIEVE_PREVIOUS_CONVERSATION": {
      "transitions": { "NEXT": { "to": "MY_CUSTOM_NODE" } }
    },
    "MY_CUSTOM_NODE": {
      "transitions": { "NEXT": { "to": "ANALYZE" } }
    }
  }
}

covalve resolves MY_CUSTOM_NODE from the decorator registry automatically at startup — no additional registration in PipelineConfig is needed.

Validation at startup

• Functions decorated with @node.handler that do not return ReturnContext raise TypeError at decoration time — before the pipeline starts
• Custom node names that conflict with native handlers raise ValueError at pipeline initialization

---

Hook System

Hooks let you attach cross-cutting behavior to any node without modifying executor logic.

Observer — fire and forget

from covalve import hooks, HookOn, ReadOnlyContext

@hooks.observer(nodes=["ANALYZE", "MAIN_LLM"], on=HookOn.EXIT)
async def log_state(ctx: ReadOnlyContext) -> None:
    print(f"state exited, query: {ctx.query}")

Interceptor — blocking, single node

@hooks.interceptor(node="GUARDRAIL", on=HookOn.ENTER, on_false="OUT_OF_SCOPE")
async def check_domain(ctx: ReadOnlyContext) -> bool:
    # return False to redirect to on_false event
    return is_in_scope(ctx.query)

on_false is required on every interceptor — if you do not need to redirect, use an observer instead. on_false must be a valid transition event defined in your schema, validated at startup.

---

Infrastructure Contracts

Implement these abstract base classes to wire covalve to your infrastructure:

Base class	Responsibility
LLMBase	Query analysis and response generation
MemoryStoreBase	Save and retrieve conversation history
CacheBase	Store retry counters and transient state
ToolClientBase	Execute tool calls
LogBase	Receive and store state transition logs
GuardrailBase	Domain boundary enforcement (optional)

---

Output

class OutputSchema(BaseModel):
    text: str
    attachment: Optional[list[AttachmentUnit]]
    status: OutputStatus          # success | error | clarification
    traceId: str

---

License

MIT