Skip to main content

Lightweight reporting SDK for evo experiments. Zero dependencies.

Project description

evo-hq-agent (Python SDK)

Lightweight reporting SDK for evo experiments. Zero dependencies, Python 3.10+.

Mirrors the @evo-hq/evo-agent Node SDK surface: Run for per-task logging + scoring, Gate for safety checks with exit codes.

Install

pip install evo-hq-agent

Install name and import name differ (same pattern as python-dateutil / dateutil):

from evo_agent import Run, Gate

Usage

Benchmark (Run)

from evo_agent import Run

with Run() as run:
    for task in tasks:
        run.log(task["id"], "starting task")
        result = evaluate(task)
        run.log(task["id"], {"output": result.output})
        run.report(
            task["id"],
            score=result.score,
            summary=f"reward={result.score:.2f}",
            failure_reason=None if result.passed else "task_failed",
        )
# finish() called automatically on __exit__:
#  - prints score JSON to stdout (the contract evo reads)
#  - per-task trace files were written to $EVO_TRACES_DIR as each report() ran

Gate

from evo_agent import Gate

with Gate() as gate:
    for task in critical_tasks:
        result = evaluate(task)
        gate.check(task["id"], score=result.score, detail=f"reward={result.score:.2f}")
# exits 0 if all passed, 1 otherwise

Environment

  • EVO_TRACES_DIR directory where task_<id>.json files are written (set by evo run)
  • EVO_EXPERIMENT_ID experiment label embedded in each trace

Both are set automatically when the evo CLI spawns your benchmark. Missing vars are tolerated -- traces are just skipped.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

evo_hq_agent-0.4.4a4.tar.gz (13.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

evo_hq_agent-0.4.4a4-py3-none-any.whl (12.5 kB view details)

Uploaded Python 3

File details

Details for the file evo_hq_agent-0.4.4a4.tar.gz.

File metadata

  • Download URL: evo_hq_agent-0.4.4a4.tar.gz
  • Upload date:
  • Size: 13.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for evo_hq_agent-0.4.4a4.tar.gz
Algorithm Hash digest
SHA256 06ded349b364c0a083bb57559ec8b26e0e4c20ba3d8981ad5714c4e73aaf0b4d
MD5 3db2d833a0012f8031aa744cd6db1c2a
BLAKE2b-256 d9e426cf512b12b7eecd86a8c38d1d52931698620001dbe21cc30d36872dfa86

See more details on using hashes here.

File details

Details for the file evo_hq_agent-0.4.4a4-py3-none-any.whl.

File metadata

  • Download URL: evo_hq_agent-0.4.4a4-py3-none-any.whl
  • Upload date:
  • Size: 12.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for evo_hq_agent-0.4.4a4-py3-none-any.whl
Algorithm Hash digest
SHA256 4e83e58555e869bacfbbf186318e2ddd82c75145bf87a93803de1a5148136c52
MD5 c3a5417682c5ca0fa0f6fbf13d9d6dc3
BLAKE2b-256 8383f02ece0baf4287c09da1925e59de0f117c7f0198d65fbc6a5a77c77be6aa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page