Skip to main content

Python API for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads.

Project description

SparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark performance metrics. The bulk of sparkMeasure is written in Scala. This package contains the Python API for sparkMeasure. Use it from Python programs, PySpark, Jupyter notebooks, or in general as a tool to instrument and collect runtime metrics for your Spark jobs.

Key Features:

  • Interactive troubleshooting for Spark workloads.
  • Batch job analysis with Flight Recorder mode.
  • Monitoring with external systems (InfluxDB, Kafka, Prometheus).
  • Language support for Scala, Java, and Python.
  • Educational tool demonstrating Spark Listener interface.

For more information, see the sparkMeasure GitHub page and documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sparkmeasure-0.28.0.tar.gz (6.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sparkmeasure-0.28.0-py2.py3-none-any.whl (8.5 kB view details)

Uploaded Python 2Python 3

File details

Details for the file sparkmeasure-0.28.0.tar.gz.

File metadata

  • Download URL: sparkmeasure-0.28.0.tar.gz
  • Upload date:
  • Size: 6.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for sparkmeasure-0.28.0.tar.gz
Algorithm Hash digest
SHA256 700b1e89b1411faa5ee767a61f4edc945be2027210a05e2c125ffc05573aa855
MD5 3607e2bbde40b5701fb0594c6a7420b8
BLAKE2b-256 85cca9f956fe4f8bbe4ceb50db963f290ac0aecf4b8cff557992f0dcf0b9346b

See more details on using hashes here.

File details

Details for the file sparkmeasure-0.28.0-py2.py3-none-any.whl.

File metadata

  • Download URL: sparkmeasure-0.28.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 8.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for sparkmeasure-0.28.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 d6c00647727687afe4837fe4d9f6a4c19f6221ed06a7a828cbaf5940a910f2db
MD5 bc918a8d30954089ed32702ec64b1c50
BLAKE2b-256 ec99a5cd1f30bfccaedf340e96aefc5b9de61741ae1daf63193924ed6fe11296

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page