Skip to main content

Guidepost. An overview visualization for understanding supercomputer queue data.

Project description

Guidepost

Guidepost is a Python library designed for seamless integration into Jupyter notebooks to visualize High Performance Computing (HPC) job data. It simplifies the process of understanding HPC workloads by providing a single, interactive visualization that offers an intuitive overview of job performance, resource usage, and other critical metrics.


Features

  • Jupyter Notebook Integration: Designed for your existing workflow. Load and interact with the visualization directly in your Jupyter environment.
  • HPC Job Data Insights: Visualize key metrics, including job runtimes, resource usage, and queue performance.
  • Interactive Exploration: Export selections of specific jobs or groups of jobs for deeper analysis.
  • Lightweight and Easy to Use: Focused on simplicity and efficiency for HPC users.

Installation

Guidepost is available on PyPI. You can install it using pip:

pip install guidepost

Quick Start

1. Import Guidepost

import guidepost as gp

2. Load Your Data

Guidepost supports input data in CSV or Pandas DataFrame format. Ensure your data includes columns such as job IDs, runtime, and resource usage.

import pandas as pd

data = pd.read_csv("hpc_jobs.csv")

3. Generate Visualization

gp.load_visualization(data)

Run the above command in a Jupyter notebook cell to render the visualization directly.


Example Dataset

Below is an example of the kind of data Guidepost works with:

Job ID Runtime (hours) Nodes Used partition Status
12345 5.2 10 short Complete
12346 12.0 20 long Running

Note that a column named "parition" must be sepecified.


API Reference

load_visualization(data)

  • Description: Renders the HPC job data visualization in the current Jupyter notebook.
  • Parameters:
    • data (DataFrame or str): A Pandas DataFrame or a path to a CSV file containing HPC job data.

Contributing

Contributions to Guidepost are welcome! To contribute:

  1. Fork the repository.
  2. Create a new branch for your feature or bugfix.
  3. Submit a pull request with a detailed description of your changes.

License

Guidepost is licensed under the MIT License. See the LICENSE file for details.


Acknowledgments

Guidepost was developed to simplify the analysis of HPC workloads, inspired by the challenges faced by HPC administrators and researchers. Thank you to the open-source community for their support and tools.


Contact

For questions or feedback, please reach out to the maintainers at [your-email@example.com].

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

guidepost-0.2.2.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

guidepost-0.2.2-py3-none-any.whl (4.5 kB view details)

Uploaded Python 3

File details

Details for the file guidepost-0.2.2.tar.gz.

File metadata

  • Download URL: guidepost-0.2.2.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.3

File hashes

Hashes for guidepost-0.2.2.tar.gz
Algorithm Hash digest
SHA256 8ed4a4a992b5c1e538de939a3a63f609e458f1b077c86818d9c244f07d0db8df
MD5 71be526aca694410c59fd77a303850bf
BLAKE2b-256 94847a260f27610394b20665fbff4585a46463a9e1884117556df91b4aeea5ea

See more details on using hashes here.

File details

Details for the file guidepost-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: guidepost-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.3

File hashes

Hashes for guidepost-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 282cca1cc41a1430a3ff8bed429cf4aefefd04bf72ed21d81017086cdd98740d
MD5 e2a2ab7ac242f8f3bfa104ffc21d91ad
BLAKE2b-256 5641aec71796f92f240e2aef9f7eb4982b873fa9a2b23853feed904c3a9517d2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page