Skip to main content

robotframework-aiagent-verify

LLM-as-judge verification keywords for robotframework-aiagent.

Provides the AIAgent.Verify Robot Framework library: ask a model to judge whether some subject satisfies a set of criteria and turn the answer into a stable, typed test assertion.

*** Settings ***
Library    AIAgent.Verify    openai:gpt-5-mini

*** Test Cases ***
Invoice Has Total
    ${response}=    Some Keyword That Produces Text
    # Fail-fast assertion: raises (and logs rationale + violations) if not satisfied
    Verify That    ${response}    nennt einen Gesamtpreis in EUR

    # Inspect without failing: returns a Verdict object you can assert on yourself
    ${verdict}=    Get Verdict    ${response}    ist höflich formuliert
    Should Be True    ${verdict.confidence} > 0.8

A Verdict carries passed, confidence, rationale and violations.

For more stable verdicts with a model that accepts sampling settings, pass them when importing the library, e.g. model_settings={'temperature': 0}. Reasoning models such as gpt-5 do not accept them.

This is an optional plugin built on top of robotframework-aiagent-slim; install the slim package with the provider extras you need (e.g. [openai]).

Metadata

Release files for robotframework-aiagent-verify 0.4.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for robotframework-aiagent-verify 0.4.1
File Size Uploaded Provenance Actions
robotframework_aiagent_verify-0.4.1.tar.gz 3.7 kB Without provenance Details for robotframework_aiagent_verify-0.4.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for robotframework-aiagent-verify 0.4.1
File Interpreter ABI Platform Actions
robotframework_aiagent_verify-0.4.1-py3-none-any.whl Python 3 none any Details for robotframework_aiagent_verify-0.4.1-py3-none-any.whl

Total release size: 8.1 kB

Release files / robotframework_aiagent_verify-0.4.1.tar.gz

Download URL robotframework_aiagent_verify-0.4.1.tar.gz
Size 3.7 kB
Tags Source
SHA-256 checksum
How to use checksums
779fb991819f74e8c0040cb9bad9cb3f20ea57d8f9fdfa3dbdcf536a9aa807e7
BLAKE2b-256 checksum
How to use checksums
2806ef6fff43a51ee6076e88e7db22ca12ba4177dccfcd77fa9d8797e15b7053
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.8 {"installer":{"name":"uv","version":"0.13.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"CachyOS Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / robotframework_aiagent_verify-0.4.1-py3-none-any.whl

Download URL robotframework_aiagent_verify-0.4.1-py3-none-any.whl
Size 4.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8962489688ba35d985951a9c26d35342c21d36fc69b9d25e3b64bf0c3c3e7ec7
BLAKE2b-256 checksum
How to use checksums
40f487f90e2c09ef42b2dff0184f223f969fe77df588862ba5e15b85d3ad7431
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.8 {"installer":{"name":"uv","version":"0.13.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"CachyOS Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for robotframework-aiagent-verify 0.4.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.4.1 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page