Skip to main content

Quality metrics for AI-assisted development — measure and improve your Claude Code sessions

Project description

Qualito

Quality metrics for AI-assisted development. Know if your Claude Code sessions are worth the cost.

PyPI Python License

What it does

Qualito analyzes your Claude Code sessions and gives you a DQI score (Delegation Quality Index) — a composite metric that measures how effectively you're using AI assistance. It tracks cost, duration, success rate, and quality across every session.

  • Import existing Claude Code sessions — no behavior change needed
  • Score each session with a DQI composite (0-100)
  • Track costs, detect incidents, monitor quality trends
  • Set SLOs and get alerts when quality drops
  • Run experiments to compare different approaches

Quick Start

# Install and set up (imports your existing Claude Code sessions)
uvx qualito setup

# Or install permanently
uv tool install qualito
qualito setup

Every Claude Code user already has session data at ~/.claude/projects/. Qualito reads it — you'll see your first scores in under 2 minutes.

Cloud Dashboard

# Authenticate with qualito.ai
qualito login

# Push data to cloud
qualito sync

# Open dashboard
# → https://app.qualito.ai

Free tier: 3 workspaces. Pro ($29/mo): unlimited workspaces + quality scoring.

CLI Commands

Command What it does
qualito setup First-time setup: import sessions, configure MCP, optional cloud sync
qualito status See your local and cloud sync state
qualito import Import Claude Code sessions for measurement (--force to re-process)
qualito costs Analyze spending by workspace, model, and time
qualito privacy View or change per-workspace sync privacy settings
qualito audit list List flagged runs needing review
qualito sync Push local sessions to the cloud dashboard
qualito login Authenticate with the Qualito cloud
qualito logout Remove cloud credentials

View your data

Qualito is CLI-first. Your data lives locally and is accessed through commands:

qualito status       # local + cloud breakdown with per-workspace tokens + cost
qualito costs        # detailed spend analysis
qualito privacy      # per-workspace sync privacy settings
qualito audit list   # flagged runs needing review

For a web UI with charts and history, sync to the cloud and view at https://app.qualito.ai.

Privacy

Qualito is local-first. Your session data lives on your machine, and you control what syncs to the cloud on a per-workspace basis.

  • Default: metadata only (counts, durations, types, scores)
  • Opt in per workspace to sync full content for a richer dashboard
  • Every sync scanned for secrets (AWS keys, API tokens, passwords, etc.)
  • Server enforces your stated settings — defense in depth

See docs/privacy.md for the full field-by-field breakdown.

MCP Server

Use Qualito inline in your editor via MCP:

{
  "mcpServers": {
    "qualito": {
      "command": "uvx",
      "args": ["qualito-mcp"]
    }
  }
}

Tools available: qualito_setup, dqi_cost, dqi_patterns, dqi_warnings, dqi_templates.

Local Development

git clone https://github.com/mp-web3/qualito.git
cd qualito
uv sync --extra dev --extra server

# Run tests
uv run pytest

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

qualito-0.1.9.tar.gz (345.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

qualito-0.1.9-py3-none-any.whl (155.6 kB view details)

Uploaded Python 3

File details

Details for the file qualito-0.1.9.tar.gz.

File metadata

  • Download URL: qualito-0.1.9.tar.gz
  • Upload date:
  • Size: 345.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.5 {"installer":{"name":"uv","version":"0.10.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for qualito-0.1.9.tar.gz
Algorithm Hash digest
SHA256 d0565394b0e36724fe1c9e2043dc801a3aa23bb714eb7907b0f745adf9e496ee
MD5 4cdba3eb663e876db7e5e7f13368295e
BLAKE2b-256 1320e37fd27008e524e726b96e41f7f185a421c12f5105b2d46b3e0eff7415d9

See more details on using hashes here.

File details

Details for the file qualito-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: qualito-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 155.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.5 {"installer":{"name":"uv","version":"0.10.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for qualito-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 ab93de813424e47318fbe84d6d93fafdee54cd66e950e3968cdacd0d6ec3de1a
MD5 3dcea0c5c45c218d9bbb7ad14df24cb4
BLAKE2b-256 a9e694238067cf9602530f7296aaf6c2d991cd69e4df4ae3c10fef8d4865e0bc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page