Skip to main content

Goodeye CLI: make your agent meet the standard you set, even on work too subjective for a test, from the terminal.

Project description

goodeye

PyPI version Python versions License

Goodeye makes an AI agent meet your standard before you ever see the output, even on work too subjective for a test.

goodeye is the command-line surface for Goodeye. The same capability reaches your agent over an MCP server and a REST API too, so it works wherever your agent runs. This CLI talks to the public /v1 REST API.

How it works

You capture the work that moves an outcome as a markdown runbook, called a skill, and pair it with checks, called verifiers, that score an agent's output against the standard you set. The agent runs the skill, the verifiers judge the result, and the agent revises until the output clears your bar. Skills stay private to you until you choose to share one publicly as a template.

A verifier can be deterministic (format, schema, tests, numeric bounds) or an LLM judge for the calls no test can make, like tone or image quality. The full picture is at https://goodeye.dev/docs/overview.

Your AI agent is the primary caller

The CLI is built to be driven by an AI coding agent on your behalf, though every command also works when you run it yourself. The intended loop: you ask your agent to run a Goodeye skill, it fetches the body with goodeye skills get <name> (or goodeye templates get @handle/slug), and it executes those instructions as your runbook instead of printing or summarizing them. The get commands wrap the body in agent-facing markers so the calling agent knows to run it. Pass --output PATH or --json when you want the raw content instead.

Install

Requires Python 3.12 or later.

uv tool install goodeye
# or: pipx install goodeye
# or: pip install goodeye

The goodeye command is then on your PATH. Run goodeye update to upgrade to the latest release, or goodeye update --check to see whether one is available.

Quickstart

Run a public template, no account needed

Browsing, fetching, and running public templates need no sign-in.

goodeye templates list
goodeye templates get @randalolson/high-signal-chart-workflow

templates get prints the template body (the skill), and your agent follows it: it finds a dataset, renders a chart, and runs the template's pinned verifier, revising until the chart passes. That verifier run is the step your agent makes, drawing on a small per-network credit grant:

# what your agent runs against the finished chart:
goodeye verifiers run 89dcc843-d056-44d9-ae34-ebcff4903885 \
  --version 1 --media-url '<public-https-chart-url>' --anonymous

Author your own skill

goodeye login                          # or: goodeye register --email you@example.com
goodeye me claim-handle your-handle    # one time, required before you publish a template

goodeye design                         # prints the designer prompt; pipe it to your agent to draft a skill and its verifiers

# save the draft from your agent's output (stdin keeps a stray file out of the working directory):
goodeye skills publish - \
  --name my-skill \
  --description "One sentence on what this does and when to use it." \
  --outcome "The result this skill moves" <<'EOF'
# Body

The skill body your agent will execute.
EOF

goodeye skills get my-skill            # fetch it back for an agent to run
goodeye templates publish my-skill     # share it publicly as a template

What the CLI can do

These command areas cover the whole surface. Run goodeye --help or goodeye <area> --help for the exact commands and flags, and see the full reference at https://goodeye.dev/docs/cli.

Area What it does Docs
skills Find, save, version, run, share, and improve your private skills, including teach, optimize, audit, and local file sync https://goodeye.dev/docs/skills
templates Browse the public catalog, publish a skill as a template, and fork one to customize https://goodeye.dev/docs/templates
verifiers Deploy and run the LLM-judge checks a skill calls to grade agent output https://goodeye.dev/docs/verifiers
image-generators Deploy reusable image generators and generate images a skill can call https://goodeye.dev/docs/image-generators
images Upload and manage hosted images with stable URLs https://goodeye.dev/docs/images
teams Create teams and manage membership so a skill can be shared with a group https://goodeye.dev/docs/teams
referrals View your referral code and redeem someone else's https://goodeye.dev/docs/referrals
invitations Accept, decline, or cancel team and ownership-transfer invitations https://goodeye.dev/docs/cli
billing Upgrade to or cancel Pro (plan upgrade / plan cancel), open the billing portal, buy a one-time credit top-up, or manage automatic top-ups (auto-topup show / set / off) https://goodeye.dev/docs/cli
auth, me, usage Manage API keys, claim your handle, and check credit usage https://goodeye.dev/docs/cli
design Print the skill-designer prompt for your agent https://goodeye.dev/docs/cli

Session commands sit at the top level: login, register, logout, whoami, and update.

Authentication and configuration

Sign in interactively with goodeye login or goodeye register. Both open a browser device-code flow and save your credentials on success. For agents and automation without a browser, use the email-code flow:

goodeye register --email you@example.com
goodeye register-verify --email you@example.com --code 123456
# existing account: goodeye login, then goodeye login-verify

goodeye whoami shows who you are, and goodeye logout removes the local credentials. Agents and scripts can authenticate with an API key instead: create one with goodeye auth create-key --name my-agent and pass it as the GOODEYE_API_KEY environment variable.

The CLI reads credentials from GOODEYE_API_KEY first, then from ~/.config/goodeye/credentials.json (written with 0600 permissions). It targets https://api.goodeye.dev by default; override that with GOODEYE_SERVER. Full authentication details are at https://goodeye.dev/docs/cli.

CLI, MCP, or REST

The CLI is a convenience layer over the public /v1 REST API. For a stable programmatic contract, call that REST API directly (https://goodeye.dev/docs/rest-api). To drive Goodeye from an MCP client, connect to mcp.goodeye.dev/mcp (https://goodeye.dev/docs/mcp). Your skills and their verifiers reach your agent on every surface.

Documentation

Contributing

See CONTRIBUTING.md for local dev setup and the pull-request process. Issues and pull requests are welcome.

License

MIT. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

goodeye-0.24.0.tar.gz (265.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

goodeye-0.24.0-py3-none-any.whl (143.0 kB view details)

Uploaded Python 3

File details

Details for the file goodeye-0.24.0.tar.gz.

File metadata

  • Download URL: goodeye-0.24.0.tar.gz
  • Upload date:
  • Size: 265.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for goodeye-0.24.0.tar.gz
Algorithm Hash digest
SHA256 126fe7b396f28a77779c408496a65be1a33da60ee68755e1c2f93aac57d7cde1
MD5 2c6413c5fd7f5abd53156c67712afc47
BLAKE2b-256 20edaa0f0540d21d398d8206343345355e8056094a33e02d4c83540641369969

See more details on using hashes here.

Provenance

The following attestation bundles were made for goodeye-0.24.0.tar.gz:

Publisher: publish.yml on Goodeye-Labs/goodeye-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file goodeye-0.24.0-py3-none-any.whl.

File metadata

  • Download URL: goodeye-0.24.0-py3-none-any.whl
  • Upload date:
  • Size: 143.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for goodeye-0.24.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1fa7522a0e844f3dc4f148f05b4be3907228fed170e51901caa16399a8ac08c9
MD5 24bc0e33c0447479d2c173eb58e760a3
BLAKE2b-256 56550b8b409f8937dae1b4deeb6667d2508d58a5e493b0521318e2bf9b922614

See more details on using hashes here.

Provenance

The following attestation bundles were made for goodeye-0.24.0-py3-none-any.whl:

Publisher: publish.yml on Goodeye-Labs/goodeye-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page