Skip to main content

Goodeye CLI: make your agent meet the standard you set, even on work too subjective for a test, from the terminal.

Project description

goodeye

PyPI version Python versions License

Goodeye makes an AI agent meet your standard before you ever see the output, even on work too subjective for a test.

goodeye is the command-line surface for Goodeye. The same capability reaches your agent over an MCP server and a REST API too, so it works wherever your agent runs. This CLI talks to the public /v1 REST API.

How it works

You capture the work that moves an outcome as a markdown runbook, called a workflow, and pair it with checks, called verifiers, that score an agent's output against the standard you set. The agent runs the workflow, the verifiers judge the result, and the agent revises until the output clears your bar. Workflows stay private to you until you choose to share one publicly as a template.

A verifier can be deterministic (format, schema, tests, numeric bounds) or an LLM judge for the calls no test can make, like tone or image quality. The full picture is at https://goodeye.dev/docs/overview.

Your AI agent is the primary caller

The CLI is built to be driven by an AI coding agent on your behalf, though every command also works when you run it yourself. The intended loop: you ask your agent to run a Goodeye workflow, it fetches the body with goodeye workflows get <name> (or goodeye templates get @handle/slug), and it executes those instructions as your runbook instead of printing or summarizing them. The get commands wrap the body in agent-facing markers so the calling agent knows to run it. Pass --output PATH or --json when you want the raw content instead.

Install

Requires Python 3.12 or later.

uv tool install goodeye
# or: pipx install goodeye
# or: pip install goodeye

The goodeye command is then on your PATH. Run goodeye update to upgrade to the latest release, or goodeye update --check to see whether one is available.

Quickstart

Run a public template, no account needed

Browsing, fetching, and running public templates need no sign-in.

goodeye templates list
goodeye templates get @randalolson/high-signal-chart-workflow

templates get prints the workflow body, and your agent follows it: it finds a dataset, renders a chart, and runs the template's pinned verifier, revising until the chart passes. That verifier run is the step your agent makes, drawing on a small per-network credit grant:

# what your agent runs against the finished chart:
goodeye verifiers run 89dcc843-d056-44d9-ae34-ebcff4903885 \
  --version 1 --media-url '<public-https-chart-url>' --anonymous

Author your own workflow

goodeye login                          # or: goodeye register --email you@example.com
goodeye me claim-handle your-handle    # one time, required before you publish a template

goodeye design                         # prints the designer prompt; pipe it to your agent to draft a workflow and its verifiers

# save the draft from your agent's output (stdin keeps a stray file out of the working directory):
goodeye workflows publish - \
  --name my-workflow \
  --description "One sentence on what this does and when to use it." \
  --outcome "The result this workflow moves" <<'EOF'
# Body

The workflow body your agent will execute.
EOF

goodeye workflows get my-workflow      # fetch it back for an agent to run
goodeye templates publish my-workflow  # share it publicly as a template

What the CLI can do

These command areas cover the whole surface. Run goodeye --help or goodeye <area> --help for the exact commands and flags, and see the full reference at https://goodeye.dev/docs/cli.

Area What it does Docs
workflows Find, save, version, run, share, and improve your private workflows, including teach, optimize, audit, and local file sync https://goodeye.dev/docs/workflows
templates Browse the public catalog, publish a workflow as a template, and fork one to customize https://goodeye.dev/docs/templates
verifiers Deploy and run the LLM-judge checks a workflow calls to grade agent output https://goodeye.dev/docs/verifiers
image-generators Deploy reusable image generators and generate images a workflow can call https://goodeye.dev/docs/image-generators
images Upload and manage hosted images with stable URLs https://goodeye.dev/docs/images
teams Create teams and manage membership so a workflow can be shared with a group https://goodeye.dev/docs/teams
referrals View your referral code and redeem someone else's https://goodeye.dev/docs/referrals
invitations Accept, decline, or cancel team and ownership-transfer invitations https://goodeye.dev/docs/cli
auth, me, usage Manage API keys, claim your handle, and check credit usage https://goodeye.dev/docs/cli
design Print the workflow-designer prompt for your agent https://goodeye.dev/docs/cli

Session commands sit at the top level: login, register, logout, whoami, and update.

Authentication and configuration

Sign in interactively with goodeye login or goodeye register. Both open a browser device-code flow and save your credentials on success. For agents and automation without a browser, use the email-code flow:

goodeye register --email you@example.com
goodeye register-verify --email you@example.com --code 123456
# existing account: goodeye login, then goodeye login-verify

goodeye whoami shows who you are, and goodeye logout removes the local credentials. Agents and scripts can authenticate with an API key instead: create one with goodeye auth create-key --name my-agent and pass it as the GOODEYE_API_KEY environment variable.

The CLI reads credentials from GOODEYE_API_KEY first, then from ~/.config/goodeye/credentials.json (written with 0600 permissions). It targets https://api.goodeye.dev by default; override that with GOODEYE_SERVER. Full authentication details are at https://goodeye.dev/docs/cli.

CLI, MCP, or REST

The CLI is a convenience layer over the public /v1 REST API. For a stable programmatic contract, call that REST API directly (https://goodeye.dev/docs/rest-api). To drive Goodeye from an MCP client, connect to mcp.goodeye.dev/mcp (https://goodeye.dev/docs/mcp). Your workflows and their verifiers reach your agent on every surface.

Documentation

Contributing

See CONTRIBUTING.md for local dev setup and the pull-request process. Issues and pull requests are welcome.

License

MIT. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

goodeye-0.21.2.tar.gz (247.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

goodeye-0.21.2-py3-none-any.whl (133.9 kB view details)

Uploaded Python 3

File details

Details for the file goodeye-0.21.2.tar.gz.

File metadata

  • Download URL: goodeye-0.21.2.tar.gz
  • Upload date:
  • Size: 247.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for goodeye-0.21.2.tar.gz
Algorithm Hash digest
SHA256 6945bd93dbe4fce5aa60d46e5d48093d6da26890032ae73f013cbffd363f5aec
MD5 ee746aaf702d789b58b749d122af2fc9
BLAKE2b-256 4ada6d5658422d7311481e529685ba016d826431ab6bfb53db33f0c74e91b90b

See more details on using hashes here.

Provenance

The following attestation bundles were made for goodeye-0.21.2.tar.gz:

Publisher: publish.yml on Goodeye-Labs/goodeye-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file goodeye-0.21.2-py3-none-any.whl.

File metadata

  • Download URL: goodeye-0.21.2-py3-none-any.whl
  • Upload date:
  • Size: 133.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for goodeye-0.21.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d4372d81664009c297998863d9518e1dd10721dc7df05dd6bf67c6b36f0981de
MD5 6704aaf72bb2c5e74053e8cdd43124e4
BLAKE2b-256 83bd6fdf6250f7c2467c7e71ffafb001113c0ebb94601233f061dc0afba15319

See more details on using hashes here.

Provenance

The following attestation bundles were made for goodeye-0.21.2-py3-none-any.whl:

Publisher: publish.yml on Goodeye-Labs/goodeye-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page