Skip to main content

Drop-in execution trace harness for non-deterministic workflows.

Project description

Observe Harness Quickstart

HiveOS includes a lightweight observe harness so users can add route visibility to existing workflows without adopting a new execution surface.

Install

Target package name:

pipx install hiveos-trace

Alternative:

pip install hiveos-trace

Until published, install from source:

pip install -e .

If hive is not recognized in your shell, use module form:

python -m hiveos.hive quickstart --no-open
python -m hiveos.hive trace ls

Release Validation

Before public release:

  1. Run .github/workflows/hive-trace-publish-testpypi.yml (manual dispatch).
  2. Verify clean install from TestPyPI:
pipx install --pip-args="--index-url https://test.pypi.org/simple --extra-index-url https://pypi.org/simple" hiveos-trace
hive doctor
hive quickstart --no-open

Production release:

  • Push tag format hiveos-trace-v<version> (example: hiveos-trace-v0.1.0) to trigger .github/workflows/hive-trace-publish-pypi.yml.

Zero-to-One (Under a Minute)

hive quickstart --no-open

Preflight checks:

hive doctor

What It Provides

  • Run-level trace events (observe_run_started, observe_run_finished)
  • Step-level trace events (observe_step)
  • Checkpoint markers (observe_checkpoint)
  • Rerun intent markers (observe_rerun_requested)
  • CLI wrapper for existing commands (hive trace run -- ...)
  • CLI run listing (hive trace ls)
  • CLI run detail dump (hive trace show <run_id>)
  • CLI run comparison (hive trace diff <run_id_a> <run_id_b>)
  • CLI run replay (hive trace replay <run_id>)
  • CLI run diagnosis (hive trace diagnose <run_id>)
  • CLI run opening (hive trace open <run_id>)
  • Lifecycle controls (hive trace archive, hive trace unarchive, hive trace prune)

All events use the existing HiveOS trace sink (~/.hiveos-trace/logs/trace_events.log by default + /trace_events).

SDK Integration (Python)

from hiveos.observe import observe_run, observe_step

def my_pipeline():
    with observe_run("daily-sync", metadata={"team": "platform"}) as run_id:
        observe_step(run_id, "extract.start", payload={"source": "s3"})
        # ... your existing logic ...
        observe_step(run_id, "extract.finish", payload={"rows": 1203})

Checkpoint + rerun intent in SDK:

from hiveos.observe import observe_checkpoint, observe_rerun_request

observe_checkpoint(run_id, "ckpt-42", step_name="extract.finish", state_ref="state://pipeline/extract/42")
observe_rerun_request(run_id, from_checkpoint_id="ckpt-42", reason="retry with override")

CLI Wrapper Integration

Wrap any existing command:

hive trace run --name nightly-tests -- python -m unittest -q

Or:

hive trace run -- npm run test

This emits run start/finish + command step events and still returns the wrapped command exit code.

Inspect Captured Runs

List recent runs:

hive trace ls

Filter by lifecycle status:

hive trace ls --status active
hive trace ls --status archived

Open a run in local UI:

hive trace open observe-run:abc123

run will print the generated run_id, so open can be called immediately after execution.

Show detailed events for one run:

hive trace show observe-run:abc123

JSON output:

hive trace show observe-run:abc123 --json

Compare two runs quickly:

hive trace diff observe-run:abc123 observe-run:def456

Machine-readable diff:

hive trace diff observe-run:abc123 observe-run:def456 --json

Replay a run with lineage metadata:

hive trace replay observe-run:abc123 --no-open

Diagnose a run and get next-action hints:

hive trace diagnose observe-run:abc123
hive trace diagnose observe-run:abc123 --json

Archive / restore a run:

hive trace archive observe-run:abc123 --reason "completed review"
hive trace unarchive observe-run:abc123

Prune old runs (archived-only by default):

hive trace prune --older-than 30d

Optionally drop matching events from associated trace log files:

hive trace prune --older-than 30d --drop-events

Optional Proxy Capture Mode

Capture OpenAI-compatible request/response traffic without SDK rewrites:

hive trace run --proxy -- python agent.py

Optional explicit upstream:

hive trace run --proxy --proxy-upstream https://api.openai.com/v1 -- python agent.py

Environment Notes

  • Harness writes through the same trace emitter used by HiveOS internals.
  • Set HIVE_TRACE_LOG_PATH if you want traces written to a custom file path.
  • To visualize harness output in Studio/Build trace views, point the UI/backend at the same trace store.

Intended Adoption Path

  1. Add observe events only (no workflow behavior changes).
  2. Add replay/diff analysis over captured runs.
  3. Add operator interventions at selected step boundaries.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hiveos_trace-0.1.3.tar.gz (129.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hiveos_trace-0.1.3-py3-none-any.whl (147.8 kB view details)

Uploaded Python 3

File details

Details for the file hiveos_trace-0.1.3.tar.gz.

File metadata

  • Download URL: hiveos_trace-0.1.3.tar.gz
  • Upload date:
  • Size: 129.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for hiveos_trace-0.1.3.tar.gz
Algorithm Hash digest
SHA256 cfdc8e5e8d205ce112b4a79fc6d5c9cab9e52f52917d96f32885f47fdddc1a6c
MD5 9d8cdac515d10d3d6b840185f5d8e89a
BLAKE2b-256 14167381da7efcff6a096c186332eae88dbdeec027edc78b38d1570f6f0a3c4e

See more details on using hashes here.

File details

Details for the file hiveos_trace-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: hiveos_trace-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 147.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for hiveos_trace-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 78186356fe8b27ac46d9e5eebe254ab3ce1aa1acd63d066820f5a28326e59dad
MD5 00e2b946baab67b70e29726282990c7c
BLAKE2b-256 f422222abcc8878a366f7f6f83e108cbc044837e986b811e1fcde0bebc8a0223

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page