A Dual-State Agent Framework for reliable LLM code generation with guard-validated loops
Project description
AtomicGuard
A Dual-State Agent Framework for reliable LLM code generation.
Why AtomicGuard?
AI agents hallucinate. Worse, those hallucinations compound — each generation builds on the last, and errors propagate through the workflow.
AtomicGuard solves this by combining to aspects - decompose goals into small measurable tasks and through Bounded Indeterminacy: the LLM generates content, but a deterministic state machine controls the logic. Every generation is validated before the workflow advances.
| Challenge | Solution |
|---|---|
| 🛡️ Safety | Dual-State Architecture & Atomic Action Pairs |
| 💾 State | Versioned Repository Items & Configuration Snapshots |
| 🌐 Scale | Multi-Agent Coordination via Shared DAG |
| 📈 Improvement | Continuous Learning from Guard Verdicts |
→ Learn more about the architecture
New to AtomicGuard? Start with the Getting Started Guide.
Paper: Managing the Stochastic: Foundations of Learning in Neuro-Symbolic Systems for Software Engineering (Thompson, 2025)
Overview
AtomicGuard implements guard-validated generation loops that dramatically improve LLM reliability. The core abstraction is the Atomic Action Pair ⟨agen, G⟩ — coupling each generation action with a validation guard.
Key results (Yi-Coder 9B, n=50):
| Task | Baseline | Guarded | Improvement |
|---|---|---|---|
| Template | 35% | 90% | +55pp |
| Password | 82% | 98% | +16pp |
| LRU Cache | 94% | 100% | +6pp |
Installation
# From PyPI
pip install atomicguard
# From source
git clone https://github.com/thompsonson/atomicguard.git
cd atomicguard
uv venv && source .venv/bin/activate
uv pip install -e ".[dev,test]"
Quick Start
from atomicguard import (
OllamaGenerator, SyntaxGuard, TestGuard,
CompositeGuard, ActionPair, DualStateAgent,
InMemoryArtifactDAG
)
# Setup
generator = OllamaGenerator(model="qwen2.5-coder:7b")
guard = CompositeGuard([SyntaxGuard(), TestGuard("assert add(2, 3) == 5")])
action_pair = ActionPair(generator=generator, guard=guard)
agent = DualStateAgent(action_pair, InMemoryArtifactDAG(), rmax=3)
# Execute
artifact = agent.execute("Write a function that adds two numbers")
print(artifact.content)
See examples/ for more detailed usage, including a mock example that works without an LLM.
LLM Backends
AtomicGuard supports multiple LLM backends. Each generator implements GeneratorInterface and can be swapped in with no other code changes.
Ollama (local or cloud)
Uses the OpenAI-compatible API. Works with any Ollama-served model:
from atomicguard.infrastructure.llm import OllamaGenerator
# Local instance (default: http://localhost:11434/v1)
generator = OllamaGenerator(model="qwen2.5-coder:7b")
HuggingFace Inference API
Connects to HuggingFace Inference Providers via huggingface_hub. Supports any model available through the HF Inference API, including third-party providers like Together AI.
# Install the optional dependency
pip install huggingface_hub
# Set your API token
export HF_TOKEN="hf_your_token_here"
from atomicguard.infrastructure.llm import HuggingFaceGenerator
from atomicguard.infrastructure.llm.huggingface import HuggingFaceGeneratorConfig
# Default: Qwen/Qwen2.5-Coder-32B-Instruct
generator = HuggingFaceGenerator()
# Custom model and provider
generator = HuggingFaceGenerator(HuggingFaceGeneratorConfig(
model="Qwen/Qwen2.5-Coder-32B-Instruct",
provider="together", # or "auto", "hf-inference"
temperature=0.7,
max_tokens=4096,
))
Drop-in replacement in any workflow:
from atomicguard import (
SyntaxGuard, TestGuard, CompositeGuard,
ActionPair, DualStateAgent, InMemoryArtifactDAG
)
from atomicguard.infrastructure.llm import HuggingFaceGenerator
generator = HuggingFaceGenerator()
guard = CompositeGuard([SyntaxGuard(), TestGuard("assert add(2, 3) == 5")])
action_pair = ActionPair(generator=generator, guard=guard)
agent = DualStateAgent(action_pair, InMemoryArtifactDAG(), rmax=3)
artifact = agent.execute("Write a function that adds two numbers")
print(artifact.content)
Benchmarks
Run the simulation from the paper:
python -m benchmarks.simulation --model yi-coder:9b --trials 50 --task all --output results/results.db --format sqlite
# Generate report
python -m benchmarks.simulation --visualize --output results/results.db --format sqlite
Project Structure
atomicguard/
├── src/atomicguard/ # Core library
├── benchmarks/ # Simulation code
├── docs/
│ ├── guide/ # User-facing documentation
│ ├── reference/ # Reference material (glossary, AP catalog, flow diagrams)
│ ├── design/ # Architecture, plans, extensions, decisions
│ ├── theory/ # Formal agent theory and domain definitions
│ └── blog/ # Blog posts
├── examples/ # Usage examples
└── results/ # Generated reports & charts
Web Dashboard
The web dashboard lets you browse experiment results, manage workflow configurations, and inspect per-instance artifact DAGs.
Starting the dashboard
# Auto-detect ./output directory
uv run python -m atomicguard.web --output-dir output/
# Or point to a specific experiment's artifact_dags
uv run python -m atomicguard.web --artifact-dir output/my_experiment/model/artifact_dags/
# Custom host/port
uv run python -m atomicguard.web --output-dir output/ --host 127.0.0.1 --port 3000
Opens at http://localhost:8000 by default. The DAG viewer shows per-instance artifact graphs to review workflow progress, guard feedback, and retries.
Workflow management via database
Import workflow JSON configs and AP context into a SQLite database for editing in the UI:
# Import all workflows and AP context
uv run python -m atomicguard.web import-all \
--workflows-dir examples/swe_bench_common/workflows/ \
--ap-context examples/swe_bench_common/ap_context.json
# Export a workflow back to JSON
uv run python -m atomicguard.web export-workflow s1-tdd
# Export all AP context
uv run python -m atomicguard.web export-context
The database defaults to ~/.atomicguard/web.db. Override with --db path/to/db.
For running the dashboard as a persistent background service (systemd, launchd, nginx reverse proxy), see docs/guide/web-dashboard-service.md.
Legacy compatibility
The dashboard is also available via the old entry point:
uv run python -m examples.dashboard --output-dir output/
Development
# Install dependencies
uv sync
# Run unit tests
just test
# Run all tests (unit + architecture)
just test-all
# Lint and format
just lint
just fmt
# Type check
just typecheck
# Full CI pipeline
just ci
See the justfile for all available commands.
Citation
If you use this framework in your research, please cite the paper:
Thompson, M. (2025). Managing the Stochastic: Foundations of Learning in Neuro-Symbolic Systems for Software Engineering. arXiv preprint arXiv:2512.20660.
@misc{thompson2025managing,
title={Managing the Stochastic: Foundations of Learning in Neuro-Symbolic Systems for Software Engineering},
author={Thompson, Matthew},
year={2025},
eprint={2512.20660},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2512.20660}
}
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file atomicguard-2.24.4.tar.gz.
File metadata
- Download URL: atomicguard-2.24.4.tar.gz
- Upload date:
- Size: 244.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d74a4d16e2675d063ef2b992ea8c498377e23625d5938488ebedaaa655687dc9
|
|
| MD5 |
a7e5cd9e8ac82aac358ea87cda4b9104
|
|
| BLAKE2b-256 |
bd1a8eef1a23922aa89390b2e48e8146930330b87045330a09774ee82e463db2
|
Provenance
The following attestation bundles were made for atomicguard-2.24.4.tar.gz:
Publisher:
release.yml on thompsonson/atomicguard
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
atomicguard-2.24.4.tar.gz -
Subject digest:
d74a4d16e2675d063ef2b992ea8c498377e23625d5938488ebedaaa655687dc9 - Sigstore transparency entry: 1437222116
- Sigstore integration time:
-
Permalink:
thompsonson/atomicguard@0184cf0a1aa7fae390068daa8ffcf02f4d79f3eb -
Branch / Tag:
refs/heads/main - Owner: https://github.com/thompsonson
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@0184cf0a1aa7fae390068daa8ffcf02f4d79f3eb -
Trigger Event:
push
-
Statement type:
File details
Details for the file atomicguard-2.24.4-py3-none-any.whl.
File metadata
- Download URL: atomicguard-2.24.4-py3-none-any.whl
- Upload date:
- Size: 300.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
110c995ad2006aa1a7bfb74c8fb2d2aaf64efe8e2d74a974ab0235656f2dac1e
|
|
| MD5 |
5ac98d2cf56325e31bfacb71fc3238ef
|
|
| BLAKE2b-256 |
402f0ac20b6beb80876c3142b4445faac057e4cdcfd2cb1e52b7ecdd22adabd2
|
Provenance
The following attestation bundles were made for atomicguard-2.24.4-py3-none-any.whl:
Publisher:
release.yml on thompsonson/atomicguard
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
atomicguard-2.24.4-py3-none-any.whl -
Subject digest:
110c995ad2006aa1a7bfb74c8fb2d2aaf64efe8e2d74a974ab0235656f2dac1e - Sigstore transparency entry: 1437222133
- Sigstore integration time:
-
Permalink:
thompsonson/atomicguard@0184cf0a1aa7fae390068daa8ffcf02f4d79f3eb -
Branch / Tag:
refs/heads/main - Owner: https://github.com/thompsonson
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@0184cf0a1aa7fae390068daa8ffcf02f4d79f3eb -
Trigger Event:
push
-
Statement type: