Skip to main content

Command-line interface for Validibot - your automated data validation assistant.

Project description

Validibot CLI

CI PyPI version Python versions License: MIT

A command-line interface for Validibot - your automated data validation assistant.

What's Validibot CLI? Validibot CLI is a small library that provides a command line access to Validibot. What's Validibot? So happy you asked! Read more here >> https://validibot.com

Features

  • Run validations from the command line or CI/CD pipelines
  • Workflow support - reference workflows by ID or human-readable slug
  • Organization filtering - disambiguate workflows across orgs and projects
  • Secure credential storage - uses system keyring (macOS Keychain, Windows Credential Manager, Linux Secret Service)
  • CI/CD friendly - meaningful exit codes and JSON output for scripting

Installation

# Using pip
pip install validibot-cli

# Using uv (recommended)
uv tool install validibot-cli

# Using pipx
pipx install validibot-cli

Requirements

  • Python 3.10 or later

Quick Start

1. Authenticate

Get your API key from the Validibot web app, then:

validibot login
# Enter your API key when prompted (input is hidden)

Your API key is stored securely in your system keyring.

2. List Available Workflows

validibot workflows list

This displays a table of workflows you have access to, including their IDs, names, and status.

3. Run a Validation

# By workflow ID
validibot validate model.idf --workflow 123

# By workflow slug
validibot validate model.idf --workflow energyplus-schema-check

The CLI uploads your file, runs the validation workflow, and displays results when complete.

Commands

Authentication

validibot login              # Authenticate with your API key
validibot logout             # Remove stored credentials
validibot whoami             # Show current user info (verifies API key)
validibot auth status        # Check if authenticated (no API call)

Login flow:

  1. Prompts for your API key (input is hidden for security)
  2. Validates the key against the Validibot API
  3. Stores the key securely in your system keyring
  4. Displays your account info to confirm success

Credential storage:

The CLI uses your system's secure credential storage:

  • macOS: Keychain
  • Windows: Credential Manager
  • Linux: Secret Service (GNOME Keyring, KWallet, etc.)

If the system keyring is unavailable, credentials fall back to ~/.config/validibot/credentials.json with restrictive file permissions (owner read/write only). Tokens are stored per API host (based on VALIDIBOT_API_URL).

Workflows

validibot workflows list          # List all available workflows
validibot workflows list --json   # Output as JSON
validibot workflows show <workflow-id-or-slug>  # Show details of a specific workflow

Runs

validibot runs show <run-id>        # Show run status and results
validibot runs show <run-id> --json # Output as JSON

Validation

Basic Usage

# Run a validation (waits for completion by default)
validibot validate model.idf -w <workflow-id-or-slug>

# Run without waiting (returns immediately with run ID)
validibot validate model.idf -w <workflow-id-or-slug> --no-wait

# Check status of a validation run
validibot runs show <run-id>

Workflow Selection

Workflows can be specified by ID (numeric) or slug (human-readable string).

# By numeric ID
validibot validate model.idf -w 123

# By slug
validibot validate model.idf -w energyplus-schema-check

When using slugs, if multiple workflows share the same slug across different organizations or versions, you'll need to disambiguate:

# Specify organization
validibot validate model.idf -w my-workflow --org acme-corp

# Specify organization and project
validibot validate model.idf -w my-workflow --org acme-corp --project building-a

# Specify a particular version
validibot validate model.idf -w my-workflow --org acme-corp --version 2

If the workflow slug is ambiguous, the CLI will display the matching workflows and prompt you to use filtering options.

Output Options

# Verbose output (shows individual step results)
validibot validate model.idf -w <workflow-id-or-slug> --verbose

# JSON output (for scripting/CI)
validibot validate model.idf -w <workflow-id-or-slug> --json

# Custom timeout (default: 600 seconds)
validibot validate model.idf -w <workflow-id-or-slug> --timeout 300

# Name your validation run
validibot validate model.idf -w <workflow-id-or-slug> --name "nightly-build-check"

Full Option Reference

Option Short Description
--workflow -w Workflow ID or slug (required)
--org -o Organization slug for disambiguation
--project -p Project slug for filtering
--version Workflow version for disambiguation
--name -n Name for this validation run
--wait/--no-wait Wait for completion (default: wait)
--timeout -t Max wait time in seconds (default: 600)
--verbose -v Show detailed step-by-step output
--json -j Output results as JSON

Configuration

Environment Variables

Variable Description Default
VALIDIBOT_API_URL API base URL https://validibot.com
VALIDIBOT_TOKEN API key (alternative to validibot login) -
VALIDIBOT_TIMEOUT Request timeout in seconds 300
VALIDIBOT_POLL_INTERVAL Status polling interval in seconds 5
VALIDIBOT_NO_KEYRING Disable keyring, use file storage false
VALIDIBOT_ALLOW_INSECURE_API_URL Allow non-HTTPS API base URL (dangerous) false

Using Environment Variables for CI/CD

Instead of running validibot login, you can set VALIDIBOT_TOKEN directly:

export VALIDIBOT_TOKEN="your-api-key"
validibot validate model.idf -w my-workflow

Exit Codes

The validate command returns meaningful exit codes for CI/CD integration:

Code Meaning
0 Validation passed
1 Validation failed (FAIL) or CLI/API error
2 Validation error (ERROR/TIMED_OUT/CANCELED/UNKNOWN)
3 Timed out waiting for completion (run still in progress)
130 Interrupted (Ctrl+C)

CI/CD Integration

GitHub Actions

name: Validate Building Model

on: [push, pull_request]

jobs:
  validate:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4

      - name: Set up Python
        uses: actions/setup-python@v5
        with:
          python-version: "3.12"

      - name: Install Validibot CLI
        run: pip install validibot-cli

      - name: Validate model
        env:
          VALIDIBOT_TOKEN: ${{ secrets.VALIDIBOT_TOKEN }}
        run: validibot validate model.idf -w ${{ vars.WORKFLOW_ID }}

GitLab CI

validate:
  image: python:3.12
  script:
    - pip install validibot-cli
    - validibot validate model.idf -w $WORKFLOW_ID
  variables:
    VALIDIBOT_TOKEN: $VALIDIBOT_TOKEN

Azure Pipelines

- task: UsePythonVersion@0
  inputs:
    versionSpec: "3.12"

- script: |
    pip install validibot-cli
    validibot validate model.idf -w $(WORKFLOW_ID)
  env:
    VALIDIBOT_TOKEN: $(VALIDIBOT_TOKEN)

Development

# Clone the repository
git clone https://github.com/validibot/validibot-cli.git
cd validibot-cli

# Install with dev dependencies
uv sync --extra dev

# Run the CLI locally
uv run validibot --help

# Run tests
uv run pytest

# Run tests with coverage
uv run pytest --cov=validibot_cli

# Lint and format
uv run ruff check .
uv run ruff format .

# Type checking
uv run mypy src/

License

This CLI is open source under the MIT License - see LICENSE for details.

Note: This is an open-source client for the Validibot service. The Validibot platform itself is a commercial product with separate terms of service.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

validibot_cli-0.1.2.tar.gz (25.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

validibot_cli-0.1.2-py3-none-any.whl (24.9 kB view details)

Uploaded Python 3

File details

Details for the file validibot_cli-0.1.2.tar.gz.

File metadata

  • Download URL: validibot_cli-0.1.2.tar.gz
  • Upload date:
  • Size: 25.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for validibot_cli-0.1.2.tar.gz
Algorithm Hash digest
SHA256 a2ac0b062860233a1cfab0ab193fc6e28c13a3bd79e7d035ee4ce8b572be5a94
MD5 f6b8f806692486b2bd07e97256c8d5e9
BLAKE2b-256 1300b31593c97549290974e1446129ce388de4d162edf096ab74d07d64e15434

See more details on using hashes here.

Provenance

The following attestation bundles were made for validibot_cli-0.1.2.tar.gz:

Publisher: publish.yml on danielmcquillen/validibot-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file validibot_cli-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: validibot_cli-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 24.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for validibot_cli-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d09774be5028d19e9f904c8ca22b46d77fe08c177d06a8e6831876d8abb005b8
MD5 41e736024b8bcc36ab3c1be54b53d99e
BLAKE2b-256 20daa280ea0c41d7f83e715729d67cfeed983f16d33ea8a6d6cf875236d81570

See more details on using hashes here.

Provenance

The following attestation bundles were made for validibot_cli-0.1.2-py3-none-any.whl:

Publisher: publish.yml on danielmcquillen/validibot-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page