Skip to main content

MVP implementation of architectural translucency for Docker/Kubernetes replication layer analysis

Project description

presidio-hardened-arch-translucency

PyPI version Python GitHub release License: MIT

v0.24.1 — Family-vector conformance patch for the Architectural Translucency Analyzer. The nominal Kepler energy vector and energy-bearing training vector are now pinned to the authoritative presidio-evidence records while PAT retains its fail-closed refusal to emit Kepler measurements.

Architectural translucency (Stantchev, ~2005) is the ability to monitor and control non-functional properties — especially performance — architecture-wide in a cross-layered way. The core insight: the same measure (replication) has different implications on throughput ω(δ) and response time when applied at different layers.

This CLI tool (pat) helps you choose the replication layer that gives the highest performance gain with the lowest overhead for your workload.


Agent Skill — use pat from Claude Code, Cursor, etc.

pat ships with an Agent Skill for AI coding assistants. When an assistant edits a Kubernetes manifest, an HPA, Terraform for EKS/GKE/AKS/ECS/Fargate, or reasons about replica counts and cost-per-request, the skill triggers the assistant to invoke pat and ground its recommendation in the architectural translucency model instead of guessing.

Project-local (auto-discovered in this repo)

Assistant Path
Claude Code .claude/skills/pat/SKILL.md
Cursor .cursor/skills/pat/SKILL.md

An assistant working in this repo discovers them automatically.

Personal install (works across all your projects)

# Claude Code
cp -r .claude/skills/pat ~/.claude/skills/pat

# Cursor
cp -r .cursor/skills/pat ~/.cursor/skills/pat

What the skill does

  • Triggers on Kubernetes manifests (Deployment, HPA, StatefulSet, ReplicaSet), Docker Compose deploy.replicas, and Terraform for ECS/Fargate/EKS/GKE/AKS/ACI
  • Runs pat analyze, pat cost, pat slo, or pat what-if with inputs gathered from code and context
  • Injects the recommendation into the assistant's plan or PR description, citing the architectural translucency model so reviewers can reproduce it
  • Refuses to fabricate rps or avg_latency_ms — asks the user instead

The skill is MIT-licensed (same as pat itself) and adds no runtime dependencies; it's plain Markdown that instructs the assistant to shell out to the pat CLI you already installed.


Replication Layers (Docker/Kubernetes)

Layer Description Fixed Overhead Coordination Cost
container New Docker container (process-level isolation) 2% Low
pod Kubernetes Pod (shared network namespace) 5% Moderate
deployment Kubernetes Deployment/ReplicaSet 10% High
node Cluster node (full VM/bare-metal) 18% Highest

Installation

Requires Python ≥ 3.10.

pip install presidio-hardened-arch-translucency

Or with uv:

uv pip install presidio-hardened-arch-translucency

Quick Start

# Analyze a 500 req/s workload with 80ms avg latency, currently at container level
pat analyze --requests-per-second 500 --avg-latency-ms 80 --current-layer container

Output:

╭──────────── Presidio Architectural Translucency — Recommendation ────────────╮
│ Recommended layer:  container                                                 │
│ Optimal replicas:   4                                                         │
│ Throughput gain:    +45.2%                                                    │
│ Response-time Δ:    -38.1%                                                    │
│ Est. throughput:    500 req/s                                                  │
│ Est. response time: 49.4 ms                                                   │
│                                                                               │
│ New Docker container (process-level isolation, shared kernel)                 │
╰───────────────────────────────────────────────────────────────────────────────╯

Baseline: 714 req/s @ 80.0 ms  (current layer: container)

Show all layers

pat analyze --requests-per-second 500 --avg-latency-ms 80 \
    --current-layer container --show-all
Layer Replicas Throughput Δ Throughput Response Time Δ RT Recommended
container 4 500 +45.2% 49.4 ms -38.1%
pod 3 500 +42.0% 55.2 ms -31.0%
deployment 2 500 +38.1% 68.3 ms -14.6%
node 1 357 0.0% 80.0 ms 0.0%

Dynamic Scaling Analysis (v0.3.0)

pat what-if — HPA Lag Model

Projects the performance trough that occurs between a load spike and the moment new Kubernetes pods become Ready. Shows throughput, latency, p99, and missed requests during the HPA scale-out window.

pat what-if \
  --current-rps 50 --spike-rps 200 \
  --avg-latency-ms 80 --current-layer container \
  --output hpa-event.png

Three stacked panels are saved to hpa-event.png:

  • Throughput (req/s) — actual served vs demand, with trough annotation
  • Avg latency (ms) — how response time degrades during the trough
  • p99 latency (ms) — tail behaviour before and after pods are Ready

Optional overrides: --hpa-poll-s (default 15 s), --pod-startup-s (default 30 s), --cold-start-s (default 0 s), --replicas-before, --replicas-after.


pat slo — SLO Compliance Check

Checks whether a p99 latency SLO is met in steady-state and during an HPA trough across all four replication layers.

pat slo \
  --requests-per-second 50 \
  --avg-latency-ms 80 \
  --p99-target-ms 500 \
  --spike-multiplier 3.0

Output table shows steady p99, trough p99, and SLO verdict per layer. The recommendation panel advises the minimum HPA minReplicas needed to eliminate the trough breach.


Cost-Aware Analysis (v0.4.0 / v0.5.0)

pat cost — Performance-Per-Dollar Ranking

Cross-layer cost analysis showing hourly cost, cost-per-request, and ROI score for every replication layer.

pat cost \
  --requests-per-second 500 \
  --avg-latency-ms 80 \
  --current-layer container \
  --cost-per-container-hour 0.02 \
  --cost-per-pod-hour 0.05 \
  --cost-per-deployment-hour 0.10 \
  --cost-per-node-hour 0.50
Layer Replicas Δ Throughput Δ RT Cost/hr Cost/req ROI score Best ROI
container 4 +45.2% -38.1% $0.0800 $0.000044 1 027
pod 3 +42.0% -31.0% $0.1500 $0.000083 504
deployment 2 +38.1% -15% $0.2000 $0.000111 343
node 1 0.0% 0.0% $0.5000 $0.000278 0

ROI score = throughput-gain-% / cost-per-request (higher = better performance-per-dollar).

pat analyze — Cost columns

Add --cost-per-replica-hour to include cost columns in --show-all output:

pat analyze --requests-per-second 500 --avg-latency-ms 80 \
    --current-layer container --show-all --cost-per-replica-hour 0.02

pat what-if — Trough revenue impact

Add --cost-per-request to see the estimated revenue cost of the HPA trough:

pat what-if --current-rps 50 --spike-rps 200 --avg-latency-ms 80 \
    --current-layer container --cost-per-request 0.001

Output includes:

  Missed reqs   ~1 350
  Trough cost   ~$1.35 revenue impact

pat slo — Min-cost layer that meets SLO

pat slo now shows a Cost/hr column and identifies the cheapest layer that satisfies your p99 target.


Cloud Billing Integration (v0.5.0 / v0.6.0)

Replaces manual --cost-per-*-hour flags with live cloud prices fetched from public APIs (no credentials required for on-demand/reserved). Results are cached locally at ~/.pat/pricing-cache.json.

pat cost --cloud aws — EC2 on-demand pricing (v0.5.0)

pat cost \
  --requests-per-second 500 \
  --avg-latency-ms 80 \
  --current-layer container \
  --cloud aws \
  --region us-east-1 \
  --instance-type m5.large

Per-layer costs use packing ratios: 16 containers/node, 8 pods/node.

pat cost --cloud aws --show-reserved — Reserved pricing (v0.6.0)

Add --show-reserved to render 1-year and 3-year No Upfront reserved pricing alongside on-demand in separate tables:

pat cost -r 500 -l 80 -c container \
  --cloud aws --region us-east-1 --instance-type m5.large \
  --show-reserved

pat cost --cloud aws --spot — Spot pricing (v0.6.0)

Requires boto3 and AWS credentials (AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY):

pip install "presidio-hardened-arch-translucency[spot]"

pat cost -r 500 -l 80 -c container \
  --cloud aws --region us-east-1 --instance-type m5.large \
  --spot

Spot prices use a 5-minute cache TTL and are annotated with an interruption-risk warning.

pat cost --cloud aws --fargate — Fargate task pricing (v0.5.0)

pat cost -r 500 -l 80 -c container \
  --cloud aws --region us-east-1 --fargate --vcpu 0.5 --memory-gb 1

pat cost --cloud gcp — GCP Compute Engine pricing (v0.6.0)

Fetches from the public GCP Pricing Calculator JSON (no credentials required):

pat cost -r 500 -l 80 -c container \
  --cloud gcp --region us-central1 --machine-type n2-standard-4

# Add --spot for preemptible pricing with interruption-risk annotation
pat cost -r 500 -l 80 -c container \
  --cloud gcp --region us-central1 --machine-type n2-standard-4 --spot

pat cost --cloud azure — Azure VM pricing (v0.6.0)

Fetches from the official Azure Retail Prices API (no credentials required):

pat cost -r 500 -l 80 -c container \
  --cloud azure --region eastus --sku-name "D2s v3"

# Add --spot for Azure Spot VM pricing
pat cost -r 500 -l 80 -c container \
  --cloud azure --region eastus --sku-name "D2s v3" --spot

Cache control

Flag Effect
(default) On-demand/reserved: 24 h cache; spot: 5 min cache
--no-cache Force a fresh API fetch (use in CI cost-gate pipelines)

Autoresearch: calibrate → observe → optimize (v0.7.0 / v0.8.0)

The static commands above (analyze, cost, slo, what-if) reason from the analytical model. The autoresearch commands close the loop with measured data: calibrate the model to your workload, record a rolling history of live measurements, and project demand forward into a proactive scaling recommendation — optionally emitted as an apply-able HPA manifest.

All three share ~/.pat/: the fitted model lives at ~/.pat/model.json (or a project-local .pat-model.json, which takes precedence), and the rolling observation history lives in a SQLite store at ~/.pat/observations.db.

pat calibrate — fit the model to measured points (v0.7.0)

Fits the per-replica capacity model (concurrency κ and coordination overhead β) to two or more measured rps:latency_ms:replicas points from your APM, load tests, or prior pat demo runs. Writes ~/.pat/model.json; afterwards the static commands use your fitted parameters and stop emitting the envelope warning. No Docker required.

pat calibrate --observation 100:50:2 --observation 300:80:5

Prints a per-observation prediction/residual table plus overall R² and RMSE.

Calibration commitment. Every fit written by pat calibrate embeds a calibration_commitment — a SHA-256 over the calibration inputs (the observation set) and outputs (fitted κ/β, R²/RMSE). pat analyze, pat what-if and pat slo re-hash the stored parameters and fail closed if they no longer match the commitment: a model file hand-edited after calibration is rejected rather than silently driving a recommendation. The recommendation output carries the commitment digest so a recommendation is traceable to the exact parameters that produced it. A model file written before commitments existed has none; it is reported as a legacy (unbound) throughput fit and used, never rejected — recalibrate to bind it. Energy fields are never accepted from a legacy record because energy calibration was introduced together with commitments in v0.20.0. See ADR-0010.

pat calibrate --benchmark — measure the points with Docker (v0.9.0)

Don't have measured points to hand? Let pat measure them. Benchmark mode sweeps a set of replica counts on the local Docker daemon — starting that many copies of the same Monte Carlo workload pat demo uses, load-testing each — then fits the model to the measured throughput/latency at every count. Requires a running Docker daemon; the workload containers are published to 127.0.0.1 only.

# Sweep 1, 2, 4 replicas, measure each, and fit (defaults to 1 2 4)
pat calibrate --benchmark --layer container \
  --replicas 1 --replicas 2 --replicas 4

# Tune the load applied at each replica count
pat calibrate --benchmark --requests 80 --concurrency 16 --iterations 200000

At least two distinct replica counts are required (one point cannot constrain both parameters). Pass --layer to write per-layer parameters, exactly as in analytical mode. --observation and --benchmark are mutually exclusive.

pat observe — record a rolling measurement history (v0.8.0)

Records a single workload observation into the SQLite store, or lists recent rows. Single-shot by design — it takes one measurement and exits; schedule recurring collection externally (cron, launchd, a Kubernetes CronJob).

# Record one measurement (all fields required when recording)
pat observe --layer container \
  --rps 480 --avg-latency-ms 78 --p99-latency-ms 190 \
  --throughput 470 --replicas 4

# List the most recent observations
pat observe --list --limit 20

The store is source-agnostic — supply numbers from any source. Tag the origin with --source (defaults to manual), and override the store path with --db.

pat observe --prometheus — scrape one sample from Prometheus (v0.8.0)

Scrapes a single sample (rps, p99, replica count) from the Prometheus HTTP API and records it with source='prometheus'. Still single-shot — schedule repeats externally. Prometheus does not know the replication layer, so --layer is required.

export PAT_PROMETHEUS_TOKEN=...   # optional bearer token; env only, never a flag
pat observe --prometheus http://prometheus.monitoring.svc:9090 --layer deployment

The bearer token is read from PAT_PROMETHEUS_TOKEN only — never passed as a CLI argument and never logged.

pat observe verify — tamper-evident observation history

Each new observation is linked into a per-store SHA-256 hash chain: every record's hash binds its own contents, its chain position, and the previous record's hash. pat observe verify walks the chain and reports the first break, detecting any post-hoc edit, deletion, insertion, or reorder of the local history relative to the chain head.

pat observe verify                 # verify ~/.pat/observations.db
pat observe verify --db ./obs.db   # verify a specific store
pat observe verify --allow-legacy  # allow only an intact legacy-prefix report

The chain is a parallel table — the observations measurement schema is untouched, and pat observe records nothing new. Rows recorded before chaining existed carry no link and are reported as an UNVERIFIABLE legacy prefix, never counted as verified coverage. Existing databases keep working unchanged. Exit codes are machine-distinct: 0 means chain intact with full coverage, 1 means a chain break was found, and 2 means the chain suffix is intact but coverage is incomplete because legacy rows remain. --allow-legacy downgrades only exit 2 to 0; a broken chain still exits 1.

What the chain proves — and what it does not. A clean chain proves the local history was not rewritten after the fact relative to the chain head. It does not prove the readings were honest at capture time — a source can still record a false measurement; the chain only makes silent rewriting of what was recorded detectable. (Numeric readings are hashed as shortest round-trip decimal strings, following the evidence family's float discipline — see ADR-0010.) This realizes the "evidence by cryptography, not by mutable logs" creed of the Computational Jurisprudence program (Stantchev, arXiv 2026).

pat optimize — proactive scaling recommendation (v0.8.0)

Reads the observation store, projects demand a few minutes ahead, and recommends the replica count to serve it.

# Simple moving average over the most-recent samples (default)
pat optimize --model sma --window 10 --horizon-minutes 10

# ARIMA forecast with a 95% confidence interval + replica range
pat optimize --model arima --horizon-minutes 15

--model arima fits a statsmodels ARIMA with a 95% confidence interval and emits a replica range; it auto-falls back to SMA when fewer than 30 samples are available. Restrict to one layer with --layer, or override the store with --db.

pat optimize --emit-hpa-patch — emit an apply-able HPA (v0.8.0)

Instead of the summary panel, emit a sanitised HorizontalPodAutoscaler manifest to stdout for a target Deployment. minReplicas is the point recommendation; maxReplicas is the ARIMA upper-CI bound when available.

pat optimize --model arima --emit-hpa-patch \
  --target my-api --namespace production > hpa-patch.yaml
kubectl apply -f hpa-patch.yaml

The target and namespace are validated as RFC 1123 names; no user input is echoed raw into the manifest.

Workflow example — the observe → optimize loop

# 1. (Once) calibrate the model to a couple of measured operating points
pat calibrate --observation 100:50:2 --observation 300:80:5

# 2. (Recurring, e.g. a */1 * * * * cron entry) record a live sample each minute
pat observe --prometheus http://prometheus:9090 --layer deployment

# 3. After ~30+ samples accumulate, project demand and recommend replicas
pat optimize --model arima --horizon-minutes 15

# 4. When you're ready to act, emit the HPA and apply it
pat optimize --model arima --emit-hpa-patch \
  --target my-api --namespace production | kubectl apply -f -

Until ~30 samples exist, step 3 transparently falls back to SMA, so the loop is useful from the very first observations.


Monitoring integration: Prometheus exporter (v0.10.0)

The first step of the monitoring-integration arc ("The Translucency Control Plane"). pat export publishes the model's per-layer recommendations as Prometheus metrics on a read-only /metrics endpoint, so they can be scraped into Grafana alongside the metrics you already run — pat never mutates infrastructure, it only exposes.

# Serve metrics on http://127.0.0.1:9847/metrics (Ctrl-C to stop)
pat export --requests-per-second 500 --avg-latency-ms 80 --current-layer container

# Print the exposition once and exit (no server) — handy for CI / a quick look
pat export -r 500 -l 80 -c container --once

Exposed gauges (per layer where applicable): pat_recommended_replicas, pat_estimated_throughput_rps, pat_response_time_ms, pat_throughput_gain_ratio, pat_layer_recommended, plus pat_workload_* inputs and pat_build_info.

Forecast metrics from the observation store (--predict)

With --predict, the exporter also runs an optimize pass over your observation store (pat observe) on every scrape and exposes the live forecast — turning the exporter from a static view into the moving front of the observe → predict → visualize loop:

# Expose forecast metrics alongside the analysis (SMA by default)
pat export -r 500 -l 80 -c container --predict

# Use ARIMA (refits each scrape — prefer SMA for frequent intervals)
pat export -r 500 -l 80 -c container --predict --model arima --horizon-minutes 15

Adds pat_predicted_rps{model}, pat_predicted_recommended_replicas{layer}, pat_observed_rps/pat_observed_latency_ms, pat_optimize_trend_ratio, pat_optimize_horizon_minutes, and pat_optimize_samples (reads 0 on an empty store). With --model arima it also exposes 95% CI bounds (pat_predicted_rps_lower/_upper and the matching replica bounds). --window, --predict-layer, and --db tune the SMA window, the observation layer, and the store path.

Scrape it from Prometheus:

scrape_configs:
  - job_name: pat
    static_configs:
      - targets: ["127.0.0.1:9847"]

Security. The server is read-only (only GET is implemented — any other method returns 501) and binds 127.0.0.1 by default. Binding a routable interface requires an explicit opt-in:

pat export -r 500 -l 80 -c container --host 0.0.0.0 --listen-public

Metric names are fixed (never user input) and label values are escaped. Use --layer to expose a per-layer calibrated fit (see pat calibrate --layer).

Cost metrics (--cost-per-replica-hour)

Pass a uniform replica cost to add per-layer cost gauges (pat_cost_per_request, pat_hourly_cost_usd):

pat export -r 500 -l 80 -c container --cost-per-replica-hour 0.02

(For live cloud pricing across AWS/GCP/Azure, use pat cost — the exporter keeps a single uniform rate to stay scrape-cheap and network-free.)

Vendor-neutral push over OTLP (--otlp, v0.13.0)

Instead of being scraped, the exporter can push its metrics once over OTLP/HTTP+JSON to an OpenTelemetry Collector, which fans out to Datadog, New Relic, Honeycomb, Grafana Cloud, etc. — so you get pat metrics without Prometheus:

# One-shot push to a collector (schedule via cron for recurring push)
pat export --otlp http://collector:4318 -r 500 -l 80 -c container --predict

Per ADR-0006 this is hand-rolled OTLP/HTTP+JSON (no opentelemetry SDK, no gRPC) — point it at an OTel Collector (or any OTLP/HTTP endpoint that accepts JSON). An optional bearer token is read from PAT_OTLP_TOKEN only (HTTPS required unless --insecure-http); --service-name sets the OTLP service.name.

Ephemeral contexts: Pushgateway (--pushgateway, v0.14.0)

Cron jobs, CI, and Kubernetes Job/CronJobs have no scrape endpoint. Push the metrics once to a Prometheus Pushgateway instead, then exit — Prometheus scrapes the gateway:

pat export --pushgateway http://pushgateway:9091 --job pat \
  --grouping instance=ci-7 -r 500 -l 80 -c container

This reuses the exporter's Prometheus text output verbatim (zero new dependencies). --job sets the job (default pat); repeat --grouping key=value for grouping labels (validated + percent-encoded). An optional token is read from PAT_PUSHGATEWAY_TOKEN only (HTTPS required unless --insecure-http). --otlp and --pushgateway are mutually exclusive.

Official Grafana dashboard

A ready-to-import dashboard lives at grafana/pat-dashboard.json. It visualises observed-vs-predicted demand (with the ARIMA CI band), recommended replicas per layer, response time, throughput gain, and cost-per-request.

Import it via Grafana → Dashboards → New → Import, upload the JSON, and pick your Prometheus data source when prompted. Pair it with pat export --predict (and --cost-per-replica-hour for the cost panel) for the full picture.

Alerting rules (pat rules, v0.11.0)

pat rules emits a Prometheus rule file (recording + alerting rules) built from the exporter's metrics, so the model's signals fire through your existing Alertmanager — pat only emits the YAML, it never loads or applies it.

# Emit recording + alerting rules
pat rules --current-layer container --cost-budget 0.000001 > pat-rules.yml

Then reference it from prometheus.yml and reload Prometheus:

rule_files:
  - pat-rules.yml

Alerts: PatDemandSurgeForecast (forecast demand outruns observed), PatDemandTrendRising (demand trending up), PatLayerTranslucencyMismatch (running on a layer the model no longer recommends — needs --current-layer), PatCostPerRequestOverBudget (needs --cost-budget), and PatExporterAbsent (scrape health). Tune with --demand-surge-ratio, --trend-threshold, and --for. Every emitted scalar is validated/escaped — the rule file can't smuggle arbitrary content.

Provisioning & annotations (v0.12.0)

grafana/provisioning/ holds Grafana file-provisioning configs (datasource + dashboard provider) so the dashboard loads automatically — mount it instead of importing by hand (see grafana/README.md).

pat annotate posts the current recommendation to Grafana's annotation API so it shows up as a marker on your dashboards — pat's one outbound write, and only ever an informational annotation, never an infrastructure change:

export PAT_GRAFANA_TOKEN=...   # editor token; env only, never a flag
pat annotate -r 500 -l 80 -c container --grafana https://grafana.example.com
pat annotate -r 500 -l 80 -c container --grafana https://g --dry-run   # preview only

The token is read from PAT_GRAFANA_TOKEN only (never a flag, never logged), HTTPS is required (use --insecure-http for localhost dev), and tags are sanitised. --dry-run prints the payload without posting; --dashboard-uid scopes the annotation to one dashboard; --tag adds extra tags.

Close the loop: autoscaling (pat scaler, v0.15.0)

The conceptual payoff of the monitoring arc — translucency-aware autoscaling. The exporter publishes pat_predicted_recommended_replicas (run pat export --predict, scraped into Prometheus); pat scaler emits the declarative glue so an autoscaler scales a Deployment to track that forecast:

# KEDA ScaledObject (default) — threshold 1, so replicas == pat's prediction
pat scaler -t web --prometheus-url http://prom:9090 -c container > scaledobject.yaml
kubectl apply -f scaledobject.yaml

# Or an HPA on an External metric (Prometheus Adapter path)
pat scaler -t web --prometheus-url http://prom:9090 --format prometheus-adapter

pat only emits the YAML — it never applies or scales anything (apply via kubectl/GitOps). --min-replicas/--max-replicas bound the range, --layer filters the default query, --query overrides it, and target/namespace names are RFC 1123-validated.

Cluster-native packaging: Helm chart (charts/pat-exporter, v0.16.0)

The arc's final step — "Package & operate": the exporter and its declarative monitoring artifacts ship as one installable Helm chart.

v0.17.0 is an evidence/library release, not a chart release. The chart and default image tag remain 0.16.0; set image.tag only when you have built and published a matching newer pat-exporter image.

# Minimal install — Deployment + Service + ServiceAccount (works on any cluster)
helm install pat ./charts/pat-exporter -n monitoring --create-namespace \
  --set workload.requestsPerSecond=500 \
  --set workload.avgLatencyMs=80 \
  --set workload.currentLayer=container

# Full stack — add the Prometheus-Operator ServiceMonitor + PrometheusRule and
# the Grafana dashboard (loaded via the Grafana sidecar)
helm install pat ./charts/pat-exporter -n monitoring \
  --set serviceMonitor.enabled=true \
  --set prometheusRule.enabled=true \
  --set dashboard.enabled=true

The pod is hardened by default (non-root UID 10001, read-only root filesystem, all capabilities dropped, seccompProfile: RuntimeDefault) and the ServiceAccount mounts no token — the read-only exporter needs no Kubernetes API access. Operator/sidecar objects (ServiceMonitor, PrometheusRule, dashboard ConfigMap) and the NetworkPolicy are off by default; enable the ones your stack supports. The chart applies nothing to the cluster — it only deploys the read-only exporter and emits declarative artifacts (arc invariant A1). The container image builds from the repo Dockerfile. See charts/pat-exporter/README.md for all values.


Live Demonstrator

pat demo spins up real Docker containers and measures throughput, latency, and CPU across three replication variants, then outputs:

  1. A results table and PNG comparison chart
  2. An HPA Lag Projection — what happens if load spikes 3× (v0.3.0)
  3. A Cost Analysis panel — cost/req per variant and best-ROI layer (v0.5.0)

Requirements: Docker daemon running locally.

# Install with demo extras
pip install "presidio-hardened-arch-translucency[demo]"

# Run the demo (defaults: 4 replicas, 40 requests, 8 concurrent threads)
pat demo

# Custom run with cost override
pat demo --replicas 6 --requests 80 --concurrency 12 \
    --cost-per-container-hour 0.05 --output results.png

Variants compared:

Variant Description
1 — Single container Baseline: one container handles all traffic
2 — N containers (round-robin) Manual container-level replication, client-side LB
3 — N workers + nginx Simulated Kubernetes Deployment with nginx reverse proxy

Example output:

╭───── Architectural Translucency — Measured Results ──────╮
│ Variant                    Workers  Throughput  Avg Lat   │
│ 1 — Single container            1        8.2    612 ms    │
│ 2 — 4 containers (round-robin)  4       28.7    167 ms ✓  │
│ 3 — nginx LB (4 workers)        5       22.4    213 ms    │
╰──────────────────────────────────────────────────────────╯

Architectural Translucency Insight:
  Manual container replication minimises coordination overhead…

╭──────────── HPA Lag Projection (if load spikes 3×) ─────────────╮
│ TROUGH  (0 s – 45 s)                                             │
│   Throughput    8.2 req/s  (9 % of spike demand)                 │
│   p99 latency   4,896 ms                                         │
│   Missed reqs   ~3,321                                           │
│ STEADY STATE  (after 45 s — 3 replicas)                          │
│   Throughput    24.6 req/s                                        │
│   p99 latency   1,102 ms                                         │
│ → Set HPA minReplicas = 3 to eliminate the trough.               │
╰──────────────────────────────────────────────────────────────────╯

╭────────────────── v0.5.0 Cost Analysis ──────────────────────────╮
│ Best measured variant:  2 — 4 containers (round-robin)           │
│   Cost/req  $0.000077  ·  Cost/hr  $0.0800                       │
│ Analytical best-ROI layer:  container                            │
│   Replicas  4  ·  Throughput gain  +45.2%                        │
│   Cost/req  $0.000044  ·  Cost/hr  $0.0800  ·  ROI score  1027   │
╰──────────────────────────────────────────────────────────────────╯

Two PNG files are saved: demo-results.png (bar chart) and demo-results-hpa.png (3-panel HPA time-series).


Security — Presidio Hardening

This toolkit ships with mandatory Presidio security extensions:

Feature Description
Input sanitization All workload parameters are bounds-checked and type-validated
Secure logging Recommendations logged without sensitive data
CVE/dependency audit pip-audit check on normal command execution (--skip-audit to disable; help/version exits skip network audit)
Security event logging "Presidio architectural-translucency recommendation applied" emitted
Output sanitization User-supplied values are never echoed raw into output
Dependabot Automated dependency updates via .github/dependabot.yml
CodeQL Static analysis via .github/workflows/codeql.yml

CLI Reference

Usage: pat [OPTIONS] COMMAND [ARGS]...

Options:
  -V, --version         Show version and exit.
  -v, --verbose         Enable debug logging.
  --skip-audit          Skip the on-run CVE dependency audit.
  --help                Show this message and exit.

Commands:
  analyze     Analyze workload and recommend the optimal replication layer.
  what-if     Project the HPA scale-out trough for a load spike.
  slo         Check p99 SLO compliance in steady state and during a trough.
  cost        Rank layers by cost-per-request and performance-per-dollar.
  calibrate   Fit the model to measured rps:latency:replicas points.
  observe     Record one workload observation (or --list recent ones).
  optimize    Proactive scaling recommendation from observed history.
  demo        Run the live Docker demonstrator.

pat analyze Options:
  -r, --requests-per-second FLOAT   Observed workload in req/s  [required]
  -l, --avg-latency-ms FLOAT        Current average latency in ms  [required]
  -c, --current-layer TEXT          Current layer (container|pod|deployment|node)  [required]
  --show-all                        Show all layers in a comparison table

Run pat <command> --help for the full option list of any command.


Theory: Architectural Translucency Model

The model is based on the replication performance equations from Stantchev's work:

Intensity after replication:

ι(δ) = rps/δ  +  α·rps  +  β·rps·ln(δ)

Throughput:

ω(δ) = min(base_capacity · δ · efficiency(δ), rps)
efficiency(δ) = 1 - α - β·ln(δ)

Response time (M/M/δ approximation):

RT(δ) = avg_latency / (1 - ρ)  +  coordination_overhead
ρ = ι(δ) / base_capacity

Where α (fixed overhead) and β (coordination cost) are layer-specific parameters calibrated for Docker/Kubernetes realities.

The cross-layer recommendation maximises ω(δ) gain while penalising response-time degradation — the central principle of architectural translucency.


Development

uv venv .venv && source .venv/bin/activate
uv pip install -e ".[dev]"

# Format + lint
ruff format . && ruff check . --fix

# Tests with coverage
pytest

Signed degradation evidence (v0.17.0, library)

evidence_producer turns a degradation reading / Observation into a signed presidio-hardened/evidence-ref@1 envelope that downstream family consumers verify fail-closed before acting on it.

Key-less by design. pat itself holds no signing key. It emits an unsigned Layer-0 reading; a separate signing-bridge sidecar holds the Ed25519 key and signs it — preserving the read-only "no secrets to steal" posture (mirrors treasury in evidence ADR-0001). Consumers hold only the public key.

# Emit a key-less Layer-0 reading (only when p99 breaches the target), pipe to the sidecar:
pat evidence-emit --p99-target-ms 200 --p99-latency-ms 420 | evidence-bridge-sign
# Library API (the sidecar uses observation_to_evidence with its key):
from presidio_arch_translucency.evidence_producer import observation_to_layer0
reading = observation_to_layer0(obs, slo_target_ms=200)   # unsigned, key-less
# sidecar signs → downstream consumers verify the signature before acting.

Ed25519 needs the optional [evidence] extra and uses a raw 32-byte private seed encoded as exactly 64 lowercase hex characters; HMAC + the canonical/hash layer are stdlib. See PRESIDIO-REQ.md "Evidence Arc (v0.17.0)".

Family golden vectors. The producer's wire formats are pinned in the normative presidio-evidence vector tree (Python + Rust conformance): the degradation chain by vectors/slo-reading/ (byte-identical — content hash and deterministic Ed25519 signature — to build_slo_evidence output; item_id SLO-DEGRADED, ledger_ref arch-translucency:obs) and the training record by vectors/training-run/ (pinned in tests/test_training.py). If this producer ever drifts from the family canonical profile, a vector suite breaks before a consumer does.


ML training parallelism (v0.18.0, Training Arc)

The same translucency question — at which layer does replication yield the highest throughput gain with the lowest overhead? — answered for distributed training. Strategies are the training analog of replication layers: data (DDP), fsdp (FSDP/ZeRO-3), tensor, pipeline (ADR-0009 — a separate domain profile; the serving model is untouched).

Two deliberate departures from the serving domain: per-device memory is a hard feasibility constraint (an oversized DDP replica is impossible, not suboptimal — infeasible points are excluded, never scored), and throughput is compute-bound (no demand cap). pipeline uses the exact bubble formula (1 − α)·m/(m+δ−1); the α/β strategies are calibratable via a training section of .pat-model.json.

# Cross-strategy recommendation (40 GB model on 24 GB devices → DDP excluded):
pat train-analyze --samples-per-second 120 --model-memory-gb 40 \
  --device-memory-gb 24 --devices 8 --show-all

# One specific configuration, JSON for automation:
pat train-what-if --strategy pipeline --degree 4 -s 100 -m 40 -d 24 --json

Training-run evidence (training-run@1) + provenance parents

pat train-evidence-emit emits a key-less, unsigned Layer-0 training-run record (run id, strategy, degree, samples/s, duration, devices, optional model/dataset hashes) for the same signing-bridge sidecar as evidence-emit. The payload may carry parents — content hashes of the upstream evidence that authorized the run (classification, gate decision) — attested inside the signed content, so evidence forms a verifiable provenance DAG that can support broader operator documentation:

pat train-evidence-emit --run-id run-2026-07-02-001 --strategy fsdp --degree 8 \
  -s 712 --duration-s 3600 -n 8 \
  --parent <classification content_hash> --parent <gate-decision content_hash> \
  | evidence-bridge-sign

All inputs are validated fail-closed (finite numbers only, printable bounded run ids, lowercase-hex parent hashes); the library enforces the same contract independently of the CLI so a sidecar can never sign malformed content.

Training energy (v0.23.0) — "Train the watt"

Rather than hand-editing the training section, calibrate the α/β overhead from measured runs. pat train-calibrate fits tp(δ) = baseline · δ · eff(δ) from one JSON-Lines step log per run and writes a committed training.<strategy> record (a post-calibration edit is detected and fails closed, exactly like pat calibrate for serving).

A step log is JSON Lines — one optimizer step per line, carrying exactly these keys (unknown keys are rejected so a typo'd "power" cannot silently vanish; power_w is optional but must be present on every line of a run or none):

{"step": 0, "duration_s": 2.01, "samples": 512, "power_w": 430.0}
{"step": 1, "duration_s": 1.98, "samples": 512, "power_w": 428.5}

The run aggregate a fit consumes is samples_per_second = total_samples / total_duration_s; the energy aggregate is the duration-weighted mean of power_w. Step ids must be strictly increasing. Files are descriptor-bound, non-symlink regular files (≤10 MB, ≤100 000 lines, strict UTF-8); numeric fields are bounded and every malformed line fails closed naming its 1-based number.

# Fit the DDP overhead from three step logs at δ = 1, 2, 4
# (α/β strategies need ≥3 distinct degrees for the full fit; pipeline needs ≥2):
pat train-calibrate --strategy data \
  --run 1:logs/ddp1.jsonl --run 2:logs/ddp2.jsonl --run 4:logs/ddp4.jsonl

Every fit requires a δ=1 run, which uniquely anchors the single-device baseline. When every run's log carried power_w, the fit also records fitted watts per device. train-analyze / train-what-if then add a Samples/s/W column and, only when every feasible strategy has comparable power data, mark the energy-best strategy (⚡ best) — a marker distinct from the throughput recommendation. Energy is informational only: it never changes the recommendation and never excludes a strategy (memory stays the only hard constraint), and without any fitted power or an explicit --device-power-watts N (1–2000) the table is byte-identical to before.

# Rank strategies by throughput AND samples/s/W (fitted power, or a placeholder):
pat train-analyze -s 120 -m 40 -d 24 -n 8 --device-power-watts 400 --show-all

A training-run@1 evidence record can also carry the run's energy as producer-attributed figures (a measured claim or modelled estimate, never an observation-chain reading — Energy Arc invariant E1a). Pass them as an int or a decimal string (bare floats are rejected as non-portable on the wire); both forms canonicalize to the same string-decimal hash. If both fields are supplied, mean total run power must agree with energy and duration within 2% or 0.01 Wh. The fields join the attested content only when given, so a power-free record hashes byte-identically to a pre-v0.23 one:

pat train-evidence-emit --run-id run-2026-07-16-001 --strategy fsdp --degree 8 \
  -s 712 --duration-s 3600 -n 8 --energy-wh "420.0" --mean-power-w "420.0" \
  | evidence-bridge-sign

A signed training-run@1 can contribute one provenance record to a provider's technical documentation. It does not by itself establish compliance: EU AI Act Article 53 and Annex XI require broader GPAI technical documentation, while Germany's EnEfG §12 requires qualifying data-centre operators to continuously measure electrical power and energy demand for essential components within an energy or environmental management system. The energy here remains attributed to the producer under the v0.18 trust boundary (E1a), not asserted as a measurement by this suite.


Energy model (v0.20.0)

The same translucency question — the same measure (replication) has different implications at different layers — answered for energy. pat models the power a layer draws serving δ replicas at throughput ω(δ):

E(δ):  W(δ) = idle_w·δ  +  dyn_j_per_req·ω(δ)·(1 + β_E·ln δ)
       idle_w        = α_E · replica_power_watts            (standing floor)
       dyn_j_per_req = (1 − α_E) · replica_power_watts / base_capacity_rps

Each layer carries an idle-power fraction α_E and a ln-δ coordination overhead β_E (a parallel table to the throughput params — the serving model is untouched, per ADR-0010). The insight is the idle-power asymmetry: a container adds almost no standing draw, while a node buys the whole server idle floor whether or not it does useful work.

Layer α_E (idle fraction) β_E (coordination) Rationale
container 0.02 0.005 ~constant ≈2 W standing draw on a shared kernel
pod 0.03 0.010 container + kubelet/pause bookkeeping
deployment 0.05 0.020 + scheduler/etcd share
node 0.36 0.030 full server idle floor (fleet idle ≈36 % of peak, 2023 servers)

These are MVP placeholders encoding published idle-power ratios (Tadesse/Chiasserini/Malandrino 2018; SPECpower_ssj2008), not a measurement of your fleet. Calibrate them from real watt readings before trusting the absolute joules; the relative container-vs-node story holds regardless.

# Analyze with the energy columns (Watts, J/req, EEI). --replica-power-watts is
# the per-replica peak power (MVP placeholder ≈15 W):
pat analyze --requests-per-second 500 --avg-latency-ms 80 \
  --current-layer container --show-all --replica-power-watts 15

--show-all adds Watts (W(δ) at the recommended δ), J/req (energy per request) and EEI (Energy-Efficiency Index). EEI > 1 means replicating at that layer buys more throughput than it costs in energy intensity. pat what-if reports estimated power / J-per-req for the evaluated point; pat slo adds a J/req column (the frontier's third axis: p99 × $/req × J/req).

# Fit real energy: rps:latency_ms:replicas:watts (total system watts). Two or
# three unique points hold β_E at its default; four or more identifiable points
# fit β_E too. Use at least two replica counts. The energy fit is written into
# the same model record and bound by the calibration commitment:
pat calibrate --observation 300:80:5 --observation 500:80:6 \
  --energy-observation 300:80:2:180 --energy-observation 500:80:5:300 \
  --energy-observation 700:80:8:420 --energy-observation 400:80:3:240

Invariant E1: pat measures, models, and evidences energy — it never actuates power. No DVFS, no power caps, no writes to any infrastructure; the watt is a number to reason with, not a knob to turn.


Measured energy (v0.21.0)

The energy model above is the honest modelled answer. v0.21.0 adds measured watts: readings from a real power meter, stored in a parallel hash-chained table (energy_observations) alongside the serving observation chain. The governing rule (ADR-0011 §2 amendment, corollary E1a) is blunt: pat never signs a watt it did not measure — the chain only ever receives measured watts; the analytic model never enters it, and there is no analytic meter.

# Scrape one gated watt reading from a real meter and record it (chained).
# --energy-meter is required (no default — an explicit meter is a claim):
pat observe --prometheus https://prometheus.monitoring.svc:9090 \
  --energy --energy-meter rapl --layer node --energy-window-s 60

Measured mode is platform-gated and fail-closed. Before any watt is recorded, pat runs the meter's gate query and refuses when no real power interface is present — on a host without one, nothing is written:

Measured-energy collection failed: no real power source detected: rapl gate
query 'sum by (path) (increase(node_rapl_package_joules_total[60s]))' returned no
series. This platform exposes no real power interface (readable RAPL zone / DCGM
device); pat refuses to sign an unmeasured watt (ADR-0011 E1a). Nothing was
recorded.

The gate proves a real power interface for every supported meter: it refuses unless at least one gate series carries a non-empty identity label for that interface (rapl→path, dcgm→gpu). Estimator value tells are refused at the door, not detected after the fact: any series carrying components_power_source="estimator" or cpu_architecture="unknown" (matched after strip()+casefold(), so casing/whitespace variants cannot slip through) is dropped. Kepler is refused regardless of labels: current Kepler can use a synthetic CPU meter and proportionally attributes node energy to workloads, so its metric/zone shape is not proof that a workload watt was directly measured.

Meter Pinned metric (supported floor) Gate label
rapl node_rapl_package_joules_total — node-exporter RAPL package domain path
dcgm DCGM_FI_DEV_TOTAL_ENERGY_CONSUMPTION — DCGM exporter, millijoules (÷1000 → W) gpu

The preset uses increase(counter[window]) / window, where window is the same whole-second --energy-window-s stored in the record. This binds the PromQL measurement interval to the reported joules window.

The gate and watts queries are overridable (--energy-watts-query, --energy-gate-query). Overriding either away from the meter's pinned preset forfeits the pinned-metric attestation: the reading is recorded with source=prometheus-override (not prometheus) and the CLI warns accordingly. Because source is hash-chained, an overridden reading is permanently distinguishable from a preset-attested one. Note the honesty bound either way: the gate and the watts value come from separate instant queries (different scrape instants, and with overrides potentially different metrics), so the gate proves a real power interface exists at gate time but does not bind the watts sample to the gated series — the same capture-time bound ADR-0010 concedes for the chain.

The supported record API accepts only process-local observations sealed by this collector. That capability prevents ordinary library callers from minting a clean source=prometheus chain from arbitrary values; it is an API boundary, not cryptographic remote attestation. Calibration and exporter consumers open the store read-only, verify the complete energy chain in the same database snapshot, validate every decoded row, and refuse tampered or incomplete data.

pat observe verify now walks both chains and reports each:

── Serving observation chain ──
   Observation chain — verified
── Measured energy chain ──
   Energy observation chain — verified

Exit 0 when both are intact and covered, 1 when either is broken, 2 on incomplete coverage. Fit the energy parameters straight from the chained store with pat calibrate --energy-from-store (mutually exclusive with --energy-observation), and export the latest measured watt per (layer, meter) as the pat_measured_power_watts gauge — labelled measured, distinct from the modelled pat_power_watts. E1a in one sentence: an unmeasured watt cannot enter the store.


Energy & carbon budgeting (v0.22.0)

The arc's conceptual payoff: the SEANERGYS objective function — compute the most you can within an energy budget, and spend the least energy for a given output — plus carbon awareness. Everything here is a modelled estimate (the analytic energy model × a documented grid-intensity figure); per invariants A1/E1/E1a it is emit-only, never enters the observation/energy chains, and is never signed.

pat budget — both directions

Direction 2 (default) — the minimum modelled energy that still meets demand ("less energy, same output"). Reuses the analyze sweep and honours the calibration commitment exactly:

pat budget -r 500 -l 80
Minimum energy meeting demand  (window 1 h)
Direction 2 — least watt-hours that saturate the workload
┏━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━┓
┃ Layer      ┃ Replicas ┃ Energy (Wh) ┃ J/req ┃  EEI ┃
┃ container  ┃        6 ┃          76 ┃ 0.152 ┃ 5.04 ┃  ✓ recommended
┃ node       ┃        7 ┃        88.6 ┃ 0.177 ┃ 5.57 ┃
┗━━━━━━━━━━━━┻━━━━━━━━━━┻━━━━━━━━━━━━━┻━━━━━━━┻━━━━━━┛

Direction 1 — maximise throughput while modelled E(δ) = W(δ)·H stays within a watt-hour (or carbon) budget over a window. A layer whose single replica already exceeds the budget is reported infeasible and excluded from the recommendation:

pat budget -r 500 -l 80 --energy-budget-wh 40 --window-h 1
pat budget -r 500 -l 80 --carbon-budget-g 3300 --region eu-central-1   # grams → Wh

Add --region for gCO₂/req and gCO₂/window columns to either direction, and --json for an additive machine-readable result (with the intensity source).

Grid carbon intensity

Region → gCO₂eq/kWh, resolved as location-based annual average — the right basis for cross-region placement ranking (market-based accounting obscures grid physics; marginal intensity answers a different, intra-day question). The embedded table is a documented MVP-placeholder snapshot (2023), coherent with Ember yearly country averages (CC-BY-4.0) and Google's region-carbon-info 2023 dataset — Nordic regions ≈ 46, Germany ≈ 345, Virginia ≈ 322, Singapore ≈ 369 gCO₂eq/kWh. Set PAT_CARBON_TOKEN (env only, never a flag, never logged) to prefer a live Electricity Maps reading, cached atomically and owner-only in ~/.pat/carbon-cache.json (TTL 1 h); redirects are refused so the token cannot be forwarded to another host, response bodies are bounded, and a live failure never fails the command — it warns and falls back to the static snapshot. Every untrusted intensity (a live response or a cache entry) is bounds-validated — finite and 0 < v ≤ 2000 gCO₂eq/kWh — so a malformed or poisoned value is refused and resolution falls back to the cited static snapshot. Unknown regions fail closed.

pat what-if --energy-aware — the idle-energy flip

Weighs the standing energy of warm minReplicas over the simulated window against the trough's missed-request revenue loss, with a verdict that flips:

pat what-if -r 300 -s 900 -l 80 -c node --energy-aware \
  --cost-per-request 0.001 --electricity-cost-per-kwh 0.12 --region eu-central-1
Idle energy vs trough
STANDING ENERGY  (warm minReplicas over the simulated window)
  Standing E    0.47 Wh  (~$0.0001)
  Standing CO₂  0.17 gCO₂eq @ 345 gCO₂eq/kWh (static 2023 average)
TROUGH
  Trough cost   ~$9.0900 revenue impact
The trough loses more in revenue ($9.0900) than warm replicas cost in
standing energy ($0.0001). Keeping minReplicas warm is justified.

Without --energy-aware, the output is byte-identical to before.

pat cost --carbon — greenest + cheapest

Adds gCO₂/req and gCO₂/hour columns (modelled watts × resolved intensity) and a combined cheapest-greenest rank: cost/req and gCO₂/req are each min-max normalised to [0,1] across layers, and the layer with the lowest mean wins. Requires an explicit --region; works on the spot/reserved tiered paths too.

pat cost -r 500 -l 80 -c container --carbon --region eu-central-1

pat scaler --signal energy

Emit-only KEDA / Prometheus-Adapter config that scales OUT when the modelled pat_energy_per_request_joules gauge exceeds a J/req budget:

pat scaler -t web --prometheus-url http://prom:9090 \
  --signal energy --energy-budget-j-per-req 0.5 -c container
# ...
#   query: max(pat_energy_per_request_joules{layer="container"})
#   threshold: "0.5"
# Caveat: adding replicas amortises standing power only when the layer's EEI > 1.
# Emit-only (A1/E1): pat models and emits, it never actuates power.

J/req (not EEI) is the trigger because it has a natural absolute budget threshold. The default --signal replicas is unchanged.


Sign the watt (v0.24.0)

The measured-energy chain proves the local history was not rewritten relative to its own head — but nothing outside pat had ever seen that head. v0.24.0 closes the loop: it emits the measured energy as a key-less presidio-hardened/energy-reading@1 record that carries the energy-chain head hash. Once a signing-bridge sidecar signs it and it is published, any later silent rewrite of the local store no longer reproduces the anchored head — the rewrite becomes externally detectable. This discharges the anchoring deferral recorded in ADR-0010.

# Derive one reading from the measured-energy observations of the last hour
# and print the unsigned record. arch-translucency holds NO signing key.
pat energy-evidence-emit --window-minutes 60
{"schema":"presidio-hardened/energy-reading@1","attested_content":{"window_start":"2026-07-18T10:00:00+00:00","window_end":"2026-07-18T10:06:00+00:00","energy_wh":"14.25","mean_power_w":"142.5","meter":"rapl","energy_chain_head":"9f2c…","layer":"node"},"content_hash":"…","source":"presidio-hardened-arch-translucency","source_version":"0.24.0","generated_at":"2026-07-18T10:06:01+00:00"}

The figures come exclusively from the preset-attested store (corollary E1a: pat never signs a watt it did not measure). There is deliberately no override flag for the energy numbers; a window containing any prometheus-override row is refused, one reading carries one meter and one layer, and emission is gated on a clean energy-chain verify — a broken chain is never anchored. Selection is the span-overlap closure of the requested window — every measurement whose span [timestamp − window_s, timestamp] reaches into the emitted interval is pulled in and checked — so the signed window covers exactly the rows that were scanned and no prometheus-override sliver can escape the E1a check. Multiple rows must form one exactly consecutive window: overlap would double-count energy and a gap would claim unmeasured coverage, so either condition fails closed. energy_wh and mean_power_w are also checked against the elapsed window before hashing. As always, the record is unsigned: pipe it to the signing bridge, which adds the Ed25519 signature that downstream family consumers verify fail-closed.

For periodic anchoring, pat observe verify gains --emit-head: it sends the normal two-chain report to stderr and, on a clean energy walk with at least one continuous row span, emits only an energy-reading@1 for the full store window. Both emit paths derive their report, rows, and anchoring head from one explicit transaction on a read-only snapshot, so the anchored energy_chain_head is the last verified link and a row appended after the snapshot is outside both the figures and the head by construction.

pat observe verify --emit-head | evidence-bridge-sign

The honest bound is unchanged and worth restating plainly: a clean chain plus an external anchor proves the recorded history was not rewritten after the fact — it does not attest that the meter was honest at capture time. Capture-time honesty remains outside pat's trust boundary by design.

This completes the Energy Arc: model the watt (v0.20) → measure it (v0.21) → budget it (v0.22) → train on it (v0.23) → sign it (v0.24).


Roadmap

Version Theme
v0.1.0 MVP — layer analysis & recommendation
v0.2.0 Multi-Python CI hardening
v0.3.0 HPA lag model (pat what-if, pat slo)
v0.4.0 Cost-aware replication analysis (pat cost)
v0.5.0 Cloud billing integration — AWS on-demand pricing
v0.6.0 Cloud billing — AWS reserved/spot + GCP + Azure
v0.7.0 Autoresearch — pat calibrate + observation store + SMA predictions
v0.8.0 Autoresearch — pat observe/pat optimize, Prometheus source, ARIMA + HPA patch emitter
v0.9.0 Per-layer + Docker-benchmark pat calibrate, ARIMA order bounds, observe daemon, security audit
v0.10.0 Monitoring integration — read-only Prometheus exporter (pat export) + Grafana dashboard
v0.11.0 Alerting — pat rules emits Prometheus recording + alerting rules
v0.12.0 Visualize & Annotate — Grafana provisioning + pat annotate
v0.13.0 Speak OTLP — vendor-neutral pat export --otlp (hand-rolled OTLP/HTTP+JSON, ADR-0006)
v0.14.0 Reach ephemeral contexts — pat export --pushgateway
v0.15.0 Close the loop — pat scaler (KEDA ScaledObject / HPA on pat's forecast)
v0.16.0 Package & operate — charts/pat-exporter Helm chart (Deployment + ServiceMonitor + PrometheusRule + Grafana dashboard) + Dockerfile
v0.17.0 Evidence arc · Sign the signal — evidence_producer + pat evidence-emit (L-EV-3): runtime-posture degradation as signed evidence-ref@1, consumed by presidio-hardened-x402; key-less daemon, signing in a sidecar
v0.18.0 Training arc · Same question, new domain — ML training parallelism (pat train-analyze/train-what-if: data / fsdp / tensor / pipeline, memory as hard constraint) + training-run@1 evidence with provenance parents (pat train-evidence-emit)
v0.19.0 Evidence-hardening arc — hash-chained observations (pat observe verify) with strict tamper vs legacy exit codes + calibration commitments binding fitted models to their source observations
v0.19.1 Evidence-hardening patch release — publishes ADR-0010 with remediated Actions pins and CodeQL code-scanning alert fixes
v0.20.0 Model the watt — per-layer energy model (α_E/β_E), pat analyze Watts/J-per-req/EEI columns, pat calibrate --energy-observation fit bound by the calibration commitment; measures/models energy, never actuates (E1)
v0.21.0 Measure the watt — measured-energy store + parallel hash chain (pat observe --energy, verify walks both chains), platform-gated fail-closed direct hardware presets (RAPL/DCGM; Kepler attribution is refused), verified read-only consumers, pat calibrate --energy-from-store, modelled + measured exporter gauges, energy alert rules
v0.22.0 Budget the watt — pat budget (max output within a Wh/carbon budget, or least energy for the demand), region carbon intensity (carbon.py, live Electricity Maps + static snapshot), pat what-if --energy-aware idle-vs-trough flip, pat cost --carbon cheapest-greenest rank, pat scaler --signal energy; all modelled, never signed (E1a)
v0.23.0 Train the watt — pat train-calibrate (L-TR-1): fit training α/β overhead from committed JSON-Lines step logs, samples/s/W ranking in train-analyze/train-what-if with an energy-best marker, training-run@1 optional producer-attributed energy fields (--energy-wh/--mean-power-w); training-fit tamper fails closed, energy stays a modelled/producer claim (E1a)
v0.24.0 Sign the watt — Energy Arc finale: pat energy-evidence-emit + pat observe verify --emit-head emit key-less energy-reading@1 carrying the measured-energy chain head hash (build_energy_reading, chain-head accessors); store-only figures, prometheus-override rows refused, emission gated on a clean chain walk (E1a); external anchoring discharges the ADR-0010 deferral — post-hoc rewriting becomes externally detectable
v0.24.1 Family-vector conformance patch — pin the nominal Kepler energy payload and energy-bearing training payload to the merged presidio-evidence vectors without weakening PAT's audited Kepler emission refusal

Full deliberation and feature details: PRESIDIO-REQ.md


License

MIT — see LICENSE.

References

  • V. Stantchev, "Effects of Replication on Web Service Performance in WebSphere," Technical Report, ICSI — International Computer Science Institute, Berkeley, CA, USA.
  • V. Stantchev, C. Schröpfer, "Negotiating and Enforcing QoS and SLAs in Grid and Cloud Computing," in Advances in Grid and Pervasive Computing (GPC 2009), Lecture Notes in Computer Science, vol. 5529, Springer, 2009.
  • V. Stantchev, M. Malek, "Architectural translucency in service-oriented architectures," IEE Proceedings — Software, vol. 153, no. 1, pp. 31–37, 2006. DOI: 10.1049/ip-sen:20050017

SDLC

This repository is developed under the Presidio hardened-family SDLC: https://github.com/presidio-v/presidio-hardened-docs/blob/main/sdlc/sdlc-report.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

presidio_hardened_arch_translucency-0.24.1.tar.gz (593.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file presidio_hardened_arch_translucency-0.24.1.tar.gz.

File metadata

  • Download URL: presidio_hardened_arch_translucency-0.24.1.tar.gz
  • Upload date:
  • Size: 593.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for presidio_hardened_arch_translucency-0.24.1.tar.gz
Algorithm Hash digest
SHA256 2339b25c3fd7ae0d158dd447049820a9612bdd7e684abf1ae2ad714e8677e606
MD5 566028ef8011b24ec1f6ba544926f7d1
BLAKE2b-256 d5647ce9b33ffd2889aac4de3dc0314ce5b2231be97a230e868f175f80a7d4af

See more details on using hashes here.

File details

Details for the file presidio_hardened_arch_translucency-0.24.1-py3-none-any.whl.

File metadata

  • Download URL: presidio_hardened_arch_translucency-0.24.1-py3-none-any.whl
  • Upload date:
  • Size: 220.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for presidio_hardened_arch_translucency-0.24.1-py3-none-any.whl
Algorithm Hash digest
SHA256 579374cb444bac7cdaf54e6fea5b71d2ba77c6da2a2ebd8e4742ece4659ad8d7
MD5 22e4d5fec64afd200e4a2387082b1a62
BLAKE2b-256 2d3d28ce5a59af46635bd1dab009c28c6c55f3dad143723ac04fabe8465ee986

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page