Skip to main content

Shared Pydantic contracts for spark-advisor microservices

Project description

spark-advisor-models

Shared Pydantic models and configuration for the spark-advisor ecosystem.

Install

pip install spark-advisor-models

What's inside

  • Spark job metrics — stages, executors, tasks, quantile distributions (model/metrics.py)
  • Analysis output — recommendations, severity levels, causal chains (model/output.py)
  • AI tool schemas — input/output models for Claude API, generated from Pydantic (model/input.py)
  • Spark config wrapper — typed access to spark.* properties (model/spark_config.py)
  • Shared configuration — rule thresholds, AI settings, NATS settings (config.py, settings.py)
  • Structured loggingconfigure_logging(), bind_nats_context(), nats_handler_context() (logging.py)
  • Distributed tracing — OpenTelemetry W3C Traceparent propagation via NATS headers (tracing.py)
  • Utilities — byte formatting, statistics helpers (util/)

Usage

from spark_advisor_models.model.metrics import JobAnalysis, StageMetrics
from spark_advisor_models.config import Thresholds, AiSettings

Links

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spark_advisor_models-0.1.20.tar.gz (15.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

spark_advisor_models-0.1.20-py3-none-any.whl (18.1 kB view details)

Uploaded Python 3

File details

Details for the file spark_advisor_models-0.1.20.tar.gz.

File metadata

  • Download URL: spark_advisor_models-0.1.20.tar.gz
  • Upload date:
  • Size: 15.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for spark_advisor_models-0.1.20.tar.gz
Algorithm Hash digest
SHA256 fa8d5828227199e6eb3d5683e24b410a8bfaebd08808d8fda4b5c4cdc398daab
MD5 7bb26141c4fd83907d9a58bc08428aac
BLAKE2b-256 00bffd51b5fd89048be49d3d40829cdbe270a82d5d04bf8e40a70d3e8ef11db6

See more details on using hashes here.

File details

Details for the file spark_advisor_models-0.1.20-py3-none-any.whl.

File metadata

  • Download URL: spark_advisor_models-0.1.20-py3-none-any.whl
  • Upload date:
  • Size: 18.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for spark_advisor_models-0.1.20-py3-none-any.whl
Algorithm Hash digest
SHA256 ec36b36a1b273fbbedec5c81b1947a8e04c8445497c9159a8f686110a6db8192
MD5 db3bd7d0eb305233b8c6aa2604c7291c
BLAKE2b-256 c519097f45ec05ec938cedab27730edfc05dfad08e7a9996c4fc58e11cb6522d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page