robotframework-harness
An agent harness for Robot Framework. It gives coding agents — Claude Code, OpenAI Codex, GitHub Copilot (CLI and VS Code) and OpenCode — what they need to write, debug and repair Robot Framework tests reliably:
- Live execution while the agent edits. Every write or edit of a
.robotfile runs the new lines in a local Robot Framework session (built on robotcode). The agent gets a short answer: passed, or the failing line with a verdict and the next step. - Failures the agent can act on. Covered elements, missing elements, iframes, timing and wrong values are told apart from evidence. The agent also gets concrete selectors and the page state as files it can grep.
- Guard rails, not handcuffs. Only certainly-wrong edits are refused (broken syntax, deleted tests, hidden
failures). Everything else becomes a one-line warning, and a green plain
robotrun is required before the agent finishes.
Everything runs on your machine; no MCP server is needed.
Quick start
cd your-robot-project
uvx robotframework-harness install # pick your agents; installs the skill, hooks and the runtime
uvx robotframework-harness doctor # proves the hooks fire and the live session works
Then ask your agent for a test. Per-agent guides are in docs/.
Plugin marketplace (Claude Code, Copilot CLI, VS Code, Codex):
claude plugin marketplace add manykarim/robotframework-harness
claude plugin install rf-harness@robotframework-harness
Why: evidence
In same-window A/B runs on live end-to-end journeys (insurance quote, shop checkout, car configurator), the harness passed 83% of sessions versus 69% for rf-mcp across six agent/model combinations (206 sessions). It also cut wall time and cost for most agents. Weaker, cheaper models gained the most (Qwen 3.8 Flash: 0.38 → 0.88). All data, graders and reports are in evidence/.
Repository
| path | what |
|---|---|
plugins/rf-harness/ |
the plugin: Agent Skill, hook definitions, launcher, per-agent variants |
.claude-plugin/marketplace.json |
plugin marketplace for Claude Code, Copilot CLI, VS Code and Codex |
src/rf_harness/installer/ |
the rf-harness installer (no dependencies) |
src/rf_harness/runtime/ |
hook dispatcher and live session (installed into your project environment) |
docs/ |
documentation |
evidence/ |
all experiment data behind the claims |
eval/ |
the A/B evaluation harness used as release gate |
License
Apache-2.0
1 maintainer
Metadata
1 maintainer
Release files for robotframework-harness 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| robotframework_harness-1.0.0.tar.gz | 307.6 kB | With provenance | Details for robotframework_harness-1.0.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| robotframework_harness-1.0.0-py3-none-any.whl | Python 3 | none | any | Details for robotframework_harness-1.0.0-py3-none-any.whl |
Total release size: 641.2 kB
Release files / robotframework_harness-1.0.0.tar.gz
| Download URL | robotframework_harness-1.0.0.tar.gz |
|---|---|
| Size | 307.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bea633c7777d867cc720b03ca3792d710b8f1f664a934063d4026fc3eabe244c
|
|
BLAKE2b-256 checksum How to use checksums |
eba7e8de3c792dbb066c1b6986800ab8dc9a2ffce01d542d0ecdbbdf12acfa0d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 13, 2026.
Transparency logRelease files / robotframework_harness-1.0.0-py3-none-any.whl
| Download URL | robotframework_harness-1.0.0-py3-none-any.whl |
|---|---|
| Size | 333.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
0081bbff5c3a2035509b101f3eac3e6570f57e764a204243d8b489702a7cfd0a
|
|
BLAKE2b-256 checksum How to use checksums |
8a1d05d59a135d95a21267f595aa042b41f51bf34d3508c048041f63233b36a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 13, 2026.
Transparency logSecurity for robotframework-harness 1.0.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for robotframework_harness-1.0.0.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 13, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
