Skip to main content

A unified multimodal model evaluation tracking and engineering report engine.

Project description

Krysta Wing (krysta-wing)

A minimalist, local telemetry and reporting engine designed to audit machine learning models, log multi-modal interpretability artifacts, and flag performance regressions locally.


Core Architecture

Krysta Wing provides a lightweight alternative to heavyweight, cloud-dependent MLOps platforms. It executes entirely in your local runtime environment, tracking performance metrics across iterations and automatically identifying anomalies using moving statistical baselines ($\mu \pm 2\sigma$).

Key Capabilities

  • Model-Agnostic Routing: Native abstraction paths for handling spatial feature maps, attention heatmaps (e.g., Grad-CAM), and NLP token confidence streams.
  • Statistical Regression Detection: Automated tracking engine that runs calculations against historical baselines to intercept memory leaks or latency spikes.
  • Configuration-Driven Portability: Decoupled architecture managing environment settings, directory structures, and alerting boundaries via standard YAML files.

Installation

Install the package directly from PyPI:

pip install krysta-wing

Quick Start
1. Define Environment Constraints
Create a kwing_config.yaml file in your root working directory to set evaluation thresholds and report destination directories dynamically:
```python
workspace_root: "production_reports"

thresholds:
  token_confidence: 0.85
  latency_limit_ms: 50.0
  1. Instrumentation Pipeline Integrate the telemetry tracking wrapper into your evaluation loop:
import numpy as np
from kwing_reporter import ModelReport

reporter = ModelReport(week=22, model_name="ResNet50-XAI", modality="hybrid-omni")

# Log performance telemetry
reporter.metrics = {
    "latency": 14.2,   # in milliseconds
    "vram": 3120.0,    # in Megabytes
    "loss": 0.042
}


tokens = ["Initiating", "attention", "map"]
confidences = [0.94, 0.72, 0.91]

reporter.log_custom_artifact(
    data=tokens,
    artifact_type="tokens",
    title="Layer 4 Token Confidence Pass",
    confidences=confidences,
    sample_phrase=" ".join(tokens)
)


reporter.compile()

License Distributed under the MIT License. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

krysta_wing-1.0.2.tar.gz (7.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

krysta_wing-1.0.2-py3-none-any.whl (7.9 kB view details)

Uploaded Python 3

File details

Details for the file krysta_wing-1.0.2.tar.gz.

File metadata

  • Download URL: krysta_wing-1.0.2.tar.gz
  • Upload date:
  • Size: 7.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.4

File hashes

Hashes for krysta_wing-1.0.2.tar.gz
Algorithm Hash digest
SHA256 d229d4b5d24f1acd9d2dc84d6dabaeb95a5356224b69c314613f6b383bdce30f
MD5 06c9bd5654a85067dcb6e6cea82ed5b5
BLAKE2b-256 777661d1a4d7199faa2bdd75cc847034e67b5d8f82a846b8cfad6d77013986b5

See more details on using hashes here.

File details

Details for the file krysta_wing-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: krysta_wing-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 7.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.4

File hashes

Hashes for krysta_wing-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 b98d62b9eb4e5b33826552accd010066cb4031fcd84b5a90669bee3b6dc4c598
MD5 097324e40c7280ec844eca84e95f61e8
BLAKE2b-256 aaffa947f4de2892adece9988bba6e6c424b7a9f8ab5668cbbbdd6d5a59c0778

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page