Skip to main content

WUP (What's Up) - Intelligent file watcher for regression testing in large projects

Project description

WUP (What's Up)

AI Cost Tracking

PyPI Version Python License AI Cost Human Time Model

  • ๐Ÿค– LLM usage: $4.6500 (31 commits)
  • ๐Ÿ‘ค Human dev: ~$732 (7.3h @ $100/h, 30min dedup)

Generated on 2026-04-29 using openrouter/qwen/qwen3-coder-next


PyPI Version Python License

WUP (What's Up) - Intelligent file watcher for regression testing in large projects.

WUP monitors file changes and runs intelligent regression tests using a 3-layer approach:

  1. Detection Layer: File watching with heuristics
  2. Priority Layer: Quick tests of related services (3 endpoints max)
  3. Detail Layer: Full tests with blame reports (only on failure)

Features

  • ๐ŸŽฏ Intelligent Testing: Only tests related services when files change
  • โšก CPU Throttling: Respects system resources with configurable CPU limits
  • ๐Ÿ”„ 3-Layer Architecture: Quick smoke tests first, detailed tests only on failure
  • ๐Ÿ“Š Live Dashboard: Real-time status monitoring with Rich CLI
  • ๐Ÿ” Dependency Mapping: Automatic detection of files โ†’ endpoints โ†’ services
  • ๐Ÿš€ Framework Support: FastAPI, Flask, Django, Express.js, and more
  • ๐Ÿ“ Blame Reports: Detailed regression reports with file/line/commit info
  • โš™๏ธ Configuration System: Declarative configuration via wup.yaml file
  • ๐ŸŽ›๏ธ Per-Service Settings: Custom test strategies per service
  • ๐Ÿงช TestQL Integration: Native support for TestQL scenarios

Installation

# Install from source
pip install -e .

# Install with development dependencies
pip install -e ".[dev]"

Quick Start

# 1. Interactive configuration (recommended)
wup assistant

# 2. Or quick auto-setup
wup assistant --quick --template fastapi

# 3. Build dependency map (one-time setup)
wup map-deps ./my-project

# 4. Start watching for changes
wup watch ./my-project

# 5. Start with live dashboard
wup watch ./my-project --dashboard

Usage

Build Dependency Map

# Auto-detect framework
wup map-deps ./my-project

# Specify framework
wup map-deps ./my-project --framework fastapi

# Custom output file
wup map-deps ./my-project --output my-deps.json

Watch Project

# Basic watching (uses wup.yaml if present)
wup watch ./my-project

# With custom settings
wup watch ./my-project \
  --cpu-throttle 0.5 \
  --debounce 3 \
  --cooldown 600

# With live dashboard
wup watch ./my-project --dashboard

# Use specific config file
wup watch ./my-project --config custom-config.yaml

# TestQL mode
wup watch ./my-project --mode testql

# Discover endpoints from TestQL scenarios
wup testql-endpoints /path/to/scenarios --output testql-deps.json

Initialize Configuration

# Generate default wup.yaml configuration
wup init

# Generate with custom output path
wup init --output .wup.yaml

Check Status

# View dependency map status
wup status

# Custom deps file
wup status --deps my-deps.json

Architecture

3-Layer Testing Approach

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚                    DETECTION LAYER                          โ”‚
โ”‚  File watching with watchdog + heuristics                   โ”‚
โ”‚  Skips: .git, __pycache__, node_modules, .venv              โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                       โ”‚ File change
                       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚                   PRIORITY LAYER                            โ”‚
โ”‚  Quick test: 3 endpoints max per service                    โ”‚
โ”‚  Duration: ~1-2 seconds                                     โ”‚
โ”‚  Result: Pass โ†’ Done, Fail โ†’ Escalate                       โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                       โ”‚ Failure
                       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚                    DETAIL LAYER                             โ”‚
โ”‚  Full test: All endpoints with blame report                 โ”‚
โ”‚  Duration: ~3-5 seconds                                     โ”‚
โ”‚  Result: Regression report with file/line/commit            โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Performance Characteristics

Idle:           0.1% CPU, 10MB RAM
File change:    5s test โ†’ 2% CPU spike
Full regression: 15s test โ†’ 15% CPU spike
200+ files/min: 100 req/s โ†’ OK (throttled)

Configuration

Service Types

WUP supports three service types for coincidence detection and intelligent testing:

  • web - HTTP/API services (FastAPI, Flask, Django, Express.js, etc.)
  • shell - CLI tools, scripts, and command-line services
  • auto - Automatic detection (default)

Coincidence detection allows WUP to identify related services. For example, if you have users-web and users-shell, WUP will detect they share the same domain and test both when relevant files change.

wup.yaml Configuration File

WUP supports declarative configuration via wup.yaml (or .wup.yaml) in your project root. This allows you to define watch paths, service-specific settings, and test strategies.

Generate a default configuration:

wup init

The generated wup.yaml includes:

  • Metadata header: Version, generation date, documentation links
  • Dependencies info: WUP version and optional wupbro dashboard
  • Quick start guide: Common commands to get started

Example wup.yaml:

project:
  name: "my-project"
  description: "My awesome project"

watch:
  # Folders to watch (supports glob patterns)
  paths:
    - "app/**"
    - "src/**"
    - "routes/**"
    - "!tests/**"         # exclusion
    - "!node_modules/**"

  # Global exclude patterns
  exclude_patterns:
    - "*.md"
    - "*.txt"
    - "migrations/**"

  # File types to watch (empty = watch all files)
  # Only changes to these file extensions will trigger tests
  file_types:
    - ".py"
    - ".ts"
    - ".jsx"

services:
  # Service configurations - simplified with auto-detection
  # If paths are empty, WUP auto-detects files by service name
  
  - name: "users-shell"
    type: "shell"
    # Auto-detects files containing "users-shell"
  
  - name: "users-web"
    type: "web"
    # Auto-detects files containing "users-web"
    # Will detect coincidence with users-shell
  
  # Or use explicit paths (old style still works)
  - name: "payments"
    paths:
      - "app/payments/**"
    type: "auto"

test_strategy:
  quick:
    debounce_s: 2
    max_queue: 5
    timeout_s: 10
  detail:
    debounce_s: 10
    max_queue: 1
    timeout_s: 30

testql:
  # TestQL-specific configuration
  scenario_dir: "scenarios/tests"
  smoke_scenario: "smoke.testql.toon.yaml"
  output_format: "json"
  extra_args:
    - "--timeout 10s"

CLI Options

Option Default Description
--config auto Path to wup.yaml config file
--cpu-throttle 0.8 CPU usage threshold (0.0-1.0)
--debounce 2 Debounce time in seconds
--cooldown 300 Test cooldown in seconds
--dashboard false Enable live dashboard
--deps deps.json Dependency map file path
--mode default Watcher mode: default or testql

Environment Variables

# Set default CPU throttle
export WUP_CPU_THROTTLE=0.5

# Set default debounce time
export WUP_DEBOUNCE=3

Visual DOM Diff

WUP optionally scans configured pages with Playwright after each successful quick test, compares the DOM structure to the previous snapshot, and reports significant changes.

Setup

pip install playwright
playwright install chromium

Configuration

visual_diff:
  enabled: true
  base_url: "http://localhost:8100"   # or leave empty and set WUP_BASE_URL env var
  base_url_env: "WUP_BASE_URL"
  delay_seconds: 5.0      # wait after file change before scanning
  max_depth: 10            # DOM snapshot depth
  pages:
    - "/health"
    - "/dashboard"
  pages_from_endpoints: true   # also scan endpoints from testql config
  threshold_added: 3           # min node additions to report as "changed"
  threshold_removed: 3
  threshold_changed: 5
  headless: true

Or set the base URL in .wup.env in the project root (not committed to git):

# .wup.env
WUP_BASE_URL=http://localhost:8100

Output

  • Snapshots โ€” .wup/visual-snapshots/<service>/<page>.json
  • Diff events โ€” .wup/visual-diffs/<service>/<page>.jsonl (appended on each change)

Visible in wup status as a "Visual DOM diffs" section.

Graceful degradation

If Playwright is not installed, the visual diff module logs a warning and skips scanning โ€” it does not break the watcher.

Web Dashboard (wupbro)

Optional FastAPI backend that receives events from WUP agents and renders a live dashboard.

Run

pip install -e wupbro/
wupbro --reload --port 8000

Open http://localhost:8000/ to see regressions, passes, anomalies, visual diffs, and health transitions in real time.

Configure agent โ†’ backend

# wup.yaml
web:
  enabled: true
  endpoint: "http://localhost:8000"
  timeout_s: 2.0

Or via env:

export WUPBRO_ENDPOINT=http://localhost:8000

The agent fire-and-forgets REGRESSION, PASS, ANOMALY, VISUAL_DIFF, and HEALTH_TRANSITION events. Network errors never break the watcher (soft-fail).

See wupbro/README.md for full API reference and driver endpoints (DOM diff, browserless, anomaly).

Project Structure

wup/
โ”œโ”€โ”€ wup/
โ”‚   โ”œโ”€โ”€ __init__.py            # Package exports
โ”‚   โ”œโ”€โ”€ cli.py                 # CLI: watch, map-deps, status, init, testql-endpoints
โ”‚   โ”œโ”€โ”€ config.py              # Config loading/saving + .wup.env support
โ”‚   โ”œโ”€โ”€ core.py                # WupWatcher: detection, inference, scheduling
โ”‚   โ”œโ”€โ”€ dependency_mapper.py   # DependencyMapper: codebase โ†’ deps.json
โ”‚   โ”œโ”€โ”€ testql_discovery.py    # TestQLEndpointDiscovery: scenario parsing
โ”‚   โ”œโ”€โ”€ testql_watcher.py      # TestQLWatcher: scenario runner + health tracking
โ”‚   โ”œโ”€โ”€ visual_diff.py         # VisualDiffer: Playwright DOM snapshot + diff engine
โ”‚   โ”œโ”€โ”€ web_client.py          # WebClient: async HTTP event sink โ†’ wupbro
โ”‚   โ””โ”€โ”€ models/
โ”‚       โ”œโ”€โ”€ __init__.py
โ”‚       โ””โ”€โ”€ config.py          # Dataclasses: WupConfig, VisualDiffConfig, WebConfig...
โ”œโ”€โ”€ wupbro/                   # Optional FastAPI dashboard (separate package)
โ”‚   โ”œโ”€โ”€ wupbro/
โ”‚   โ”‚   โ”œโ”€โ”€ main.py            # FastAPI app
โ”‚   โ”‚   โ”œโ”€โ”€ routers/           # events, drivers, dashboard
โ”‚   โ”‚   โ”œโ”€โ”€ storage.py         # EventStore (in-memory + JSONL)
โ”‚   โ”‚   โ””โ”€โ”€ templates/         # index.html dashboard
โ”‚   โ””โ”€โ”€ tests/                 # FastAPI endpoint tests (pytest + TestClient)
โ”œโ”€โ”€ tests/
โ”‚   โ”œโ”€โ”€ test_wup.py            # unit/integration tests (incl. VisualDiffer, config)
โ”‚   โ”œโ”€โ”€ test_testql_watcher.py # TestQLWatcher + VisualDiffer integration tests
โ”‚   โ”œโ”€โ”€ test_web_client.py     # WebClient + WebConfig tests
โ”‚   โ””โ”€โ”€ test_e2e.py            # end-to-end CLI tests
โ”œโ”€โ”€ examples/
โ”‚   โ”œโ”€โ”€ fastapi-app/           # FastAPI example project
โ”‚   โ”œโ”€โ”€ flask-app/             # Flask example project
โ”‚   โ”œโ”€โ”€ multi-service/         # Multi-service example
โ”‚   โ”œโ”€โ”€ testql_demo.py         # TestQL simulation demo
โ”‚   โ”œโ”€โ”€ testql_integration.py  # Custom TestQLWatcher + visual diff example
โ”‚   โ””โ”€โ”€ visual_diff_demo.py    # Visual DOM diff demo (no Playwright required)
โ”œโ”€โ”€ docs/
โ”‚   โ””โ”€โ”€ TESTQL_INTEGRATION.md  # TestQL integration guide
โ”œโ”€โ”€ testql-scenarios/          # Auto-generated TestQL scenarios
โ”œโ”€โ”€ pyproject.toml             # Package config (setuptools)
โ””โ”€โ”€ README.md

Development

Running Tests

# Run all tests
python3 -m pytest tests/ -v

# Run specific suite
python3 -m pytest tests/test_wup.py -v
python3 -m pytest tests/test_testql_watcher.py -v

# Run with coverage
python3 -m pytest tests/ --cov=wup

Examples

# Visual diff demo (no Playwright required)
python3 examples/visual_diff_demo.py

# With live page scan (requires playwright)
python3 examples/visual_diff_demo.py http://localhost:8100/health

# TestQL + visual diff integration
python3 examples/testql_integration.py /path/to/project

# Monorepo analysis (c2004-style large projects)
python3 examples/c2004_monorepo_demo.py /path/to/monorepo

# CI/CD integration patterns
python3 examples/ci_cd_integration.py

# Generate GitHub Actions workflow
python3 examples/ci_cd_integration.py --generate-github-actions

# Webhook notifications (Slack, Teams, Discord)
python3 examples/webhook_notifications.py

Building & Publishing

python -m build

Real-World Testing

WUP has been tested on production-scale projects:

  • c2004 Project (maskservice/c2004): Large IoT platform with 21+ connect-* modules
    • 29 services auto-detected by assistant
    • 100+ YAML configuration files monitored
    • Anomaly detection: 0.06s for 5 config files (~1ms/file)
    • Framework: Custom Python/FastAPI hybrid

Documentation

Comprehensive documentation is available in the docs/ directory:

  • Configuration Assistant - Interactive setup guide for wup.yaml

    • wup assistant - Interactive configuration wizard
    • Auto-detects framework and services
    • Intelligent suggestions and validation
  • Anomaly Detection - Fast alternatives to Playwright

    • Hash-based change detection (~1ms per file)
    • YAML structure analysis
    • Python AST diff for API changes
    • Configure with anomaly_detection: in wup.yaml
  • Browser Notifications - Real-time alerts in wupbro

    • 7 notification types (regressions, status changes, recoveries)
    • Configurable per-type with cooldown
    • Server-Sent Events for instant delivery
    • Browser Notifications API integration
  • TestQL Integration - TestQL scenario support

License

Licensed under Apache-2.0.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wup-0.2.20.tar.gz (70.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wup-0.2.20-py3-none-any.whl (57.0 kB view details)

Uploaded Python 3

File details

Details for the file wup-0.2.20.tar.gz.

File metadata

  • Download URL: wup-0.2.20.tar.gz
  • Upload date:
  • Size: 70.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for wup-0.2.20.tar.gz
Algorithm Hash digest
SHA256 364f21e415f20334fcb4418a1c44a321b83d9779a12341cc586bcfa43754fff2
MD5 fae2bbd2a577a3e11fd67c16949890d8
BLAKE2b-256 126cee6088f217a08f69963b3a462704b3cde59562748e9f99028c67ac1ca045

See more details on using hashes here.

File details

Details for the file wup-0.2.20-py3-none-any.whl.

File metadata

  • Download URL: wup-0.2.20-py3-none-any.whl
  • Upload date:
  • Size: 57.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for wup-0.2.20-py3-none-any.whl
Algorithm Hash digest
SHA256 2ef8b91f553503d484e62c1d2d726ec78fb3e17fdfb012c131ed17cfe066d54d
MD5 365ae667b129dfb57365e099d1af99d2
BLAKE2b-256 362c7494c8a93aaa951abca0dd3afb169572821debc20022363f1fbcd384f04c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page