Skip to main content

HumanHarness

Understand and debug agent harnesses from the model's perspective.

HumanHarness is a quick and easy tool to let you view an agent's harness yourself.

Simply start the app and set your OpenAI-compatible API to http://localhost:8080/v1 or whatever port you've set.

The twist: instead of using an AI model, there is a web UI which you (probably a human) can visit, and from there, any incoming requests are shown. The full text, system prompt, and chat history. Also, any available tools are shown in the UI as buttons, with parameters you can edit. Finally, when you've finished "thinking" about it, you can type a response back.

The goal here is to be able to look at things like OpenClaw, Pi, Hermes, Claude Code, OpenAI Codex, or any other agentic framework and getting a deeper level of understanding how it works + seeing it from the AI's perspective + being able to have a bit of fun. You can also use it to help you debug model performance in your own agentic harnesses! You can see what the LLM is seeing and optimize parts of the harness (e.g. visible toolset) to help maximise model performance.

Installation

Quick installation:

$ pip install humanharness

Or from source:

$ gh repo clone uukelele/HumanHarness
$ cd HumanHarness/humanharness/frontend
$ npm i && npm run build
$ cd ../..
$ pip install -e .

Starting the server

$ humanharness

Starts the web server at port 8080 by default.

To auto-open in browser:

$ humanharness --open

To set another port / host:

$ humanharness --host 0.0.0.0 --port 8081

Use with an agent

Simply set your base URL to the one that appears in the web dashboard.

For example, if using the default settings:

http://localhost:8080/v1

The chat completion URL would be http://localhost:8080/v1/chat/completions

Features

  • /v1/chat/completions
    • Text responses
    • Viewing images
    • JSON-based tool calling
    • XML-based tool calling
    • Other forms of multimodal content
  • `/v1/responses

Release files for humanharness 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for humanharness 0.1.0
File Size Uploaded
humanharness-0.1.0.tar.gz 59.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for humanharness 0.1.0
File Interpreter ABI Platform
humanharness-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 121.7 kB

Release files / humanharness-0.1.0.tar.gz

Download URL humanharness-0.1.0.tar.gz
Size 59.7 kB
Tags Source
SHA-256 checksum
How to use checksums
713891a0aa3523bde428038963ba4b042aa868662cfc0c3d64f70745a06147c3
BLAKE2b-256 checksum
How to use checksums
2cfb25f995fc32277b83c2ed5dc0d35b7ae4f1ea142fcdb1394748285e267ef4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.20

Release files / humanharness-0.1.0-py3-none-any.whl

Download URL humanharness-0.1.0-py3-none-any.whl
Size 62.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9a718d81bc325b434f2ad72114eb7e4867898d4dc5082c0310d607d391fa9859
BLAKE2b-256 checksum
How to use checksums
11df5352b2385e446a41e7731e4a03699069670f7cd414808c40172733c13fc7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.20

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page