Guidepost. An overview visualization for understanding supercomputer queue data.
Project description
Guidepost
Guidepost is a Python library designed for seamless integration into Jupyter notebooks to visualize High Performance Computing (HPC) job data. It simplifies the process of understanding HPC workloads by providing a single, interactive visualization that offers an intuitive overview of job performance, resource usage, and other critical metrics.
Features
- Jupyter Notebook Integration: Designed for your existing workflow. Load and interact with the visualization directly in your Jupyter environment.
- HPC Job Data Insights: Visualize key metrics, including job runtimes, resource usage, and queue performance.
- Interactive Exploration: Export selections of specific jobs or groups of jobs for deeper analysis.
- Lightweight and Easy to Use: Focused on simplicity and efficiency for HPC users.
Installation
Guidepost is available on PyPI. You can install it using pip:
pip install guidepost
Quick Start
1. Import Guidepost
import guidepost as gp
2. Load Your Data
Guidepost supports input data in CSV or Pandas DataFrame format. Ensure your data includes columns such as job IDs, runtime, and resource usage.
import pandas as pd
data = pd.read_csv("hpc_jobs.csv")
3. Generate Visualization
gp.load_visualization(data)
Run the above command in a Jupyter notebook cell to render the visualization directly.
Example Dataset
Below is an example of the kind of data Guidepost works with:
| Job ID | Runtime (hours) | Nodes Used | partition | Status |
|---|---|---|---|---|
| 12345 | 5.2 | 10 | short | Complete |
| 12346 | 12.0 | 20 | long | Running |
Note that a column named "parition" must be sepecified.
API Reference
load_visualization(data)
- Description: Renders the HPC job data visualization in the current Jupyter notebook.
- Parameters:
data(DataFrame or str): A Pandas DataFrame or a path to a CSV file containing HPC job data.
Contributing
Contributions to Guidepost are welcome! To contribute:
- Fork the repository.
- Create a new branch for your feature or bugfix.
- Submit a pull request with a detailed description of your changes.
License
Guidepost is licensed under the MIT License. See the LICENSE file for details.
Acknowledgments
Guidepost was developed to simplify the analysis of HPC workloads, inspired by the challenges faced by HPC administrators and researchers. Thank you to the open-source community for their support and tools.
Contact
For questions or feedback, please reach out to the maintainers at [your-email@example.com].
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file guidepost-0.2.2.tar.gz.
File metadata
- Download URL: guidepost-0.2.2.tar.gz
- Upload date:
- Size: 4.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8ed4a4a992b5c1e538de939a3a63f609e458f1b077c86818d9c244f07d0db8df
|
|
| MD5 |
71be526aca694410c59fd77a303850bf
|
|
| BLAKE2b-256 |
94847a260f27610394b20665fbff4585a46463a9e1884117556df91b4aeea5ea
|
File details
Details for the file guidepost-0.2.2-py3-none-any.whl.
File metadata
- Download URL: guidepost-0.2.2-py3-none-any.whl
- Upload date:
- Size: 4.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
282cca1cc41a1430a3ff8bed429cf4aefefd04bf72ed21d81017086cdd98740d
|
|
| MD5 |
e2a2ab7ac242f8f3bfa104ffc21d91ad
|
|
| BLAKE2b-256 |
5641aec71796f92f240e2aef9f7eb4982b873fa9a2b23853feed904c3a9517d2
|