Skip to main content

Shared Pydantic contracts for spark-advisor microservices

Project description

spark-advisor-models

Shared Pydantic models and configuration for the spark-advisor ecosystem.

Install

pip install spark-advisor-models

What's inside

  • Spark job metrics — stages, executors, tasks, quantile distributions (model/metrics.py)
  • Analysis output — recommendations, severity levels, causal chains (model/output.py)
  • AI tool schemas — input/output models for Claude API, generated from Pydantic (model/input.py)
  • Spark config wrapper — typed access to spark.* properties (model/spark_config.py)
  • Shared configuration — rule thresholds, AI settings, NATS settings (config.py, settings.py)
  • Structured loggingconfigure_logging(), bind_nats_context(), nats_handler_context() (logging.py)
  • Distributed tracing — OpenTelemetry W3C Traceparent propagation via NATS headers (tracing.py)
  • Utilities — byte formatting, statistics helpers (util/)

Usage

from spark_advisor_models.model.metrics import JobAnalysis, StageMetrics
from spark_advisor_models.config import Thresholds, AiSettings

Links

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spark_advisor_models-0.1.19.tar.gz (15.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

spark_advisor_models-0.1.19-py3-none-any.whl (18.1 kB view details)

Uploaded Python 3

File details

Details for the file spark_advisor_models-0.1.19.tar.gz.

File metadata

  • Download URL: spark_advisor_models-0.1.19.tar.gz
  • Upload date:
  • Size: 15.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for spark_advisor_models-0.1.19.tar.gz
Algorithm Hash digest
SHA256 36dbdbbbdfec5b1261472c69d6f845b0f3e97cec05f892f639096672bc973429
MD5 b8592bc6b8ba589cb2fb3b40e0c3f2c3
BLAKE2b-256 69771c05be6594a1ad6a8473898523c3d4403015bf40a771070c4ee4eba5f179

See more details on using hashes here.

File details

Details for the file spark_advisor_models-0.1.19-py3-none-any.whl.

File metadata

  • Download URL: spark_advisor_models-0.1.19-py3-none-any.whl
  • Upload date:
  • Size: 18.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for spark_advisor_models-0.1.19-py3-none-any.whl
Algorithm Hash digest
SHA256 4ee10122813e72a19627d0e7a5870ab7f80b880f18cbc85c8e939c3bf994ae53
MD5 5da69c4f17278274463760b006ce02ce
BLAKE2b-256 1ab290883def5914793f78d2aa7dec70b08497a90bfca153c78b052f113f6acf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page