fractale 0.0.11

Jobspec specification and translation layer for cluster work

fractale

Translation layer for a jobspec specification to cluster execution

This library is primarily being used for development for the descriptive thrust of the Fractale project. It is called fractale, but also not called fractale. You can't be sure of the name until you open the box.

Design

Simple

We provide a simple translation layer between job specifications. We take the assumption that although each manager has many options, the actual options a user would use is a much smaller set, and it's relatively straight forward to translate (and have better accuracy).

See examples/transform for an example.

Complex

We want to:

1. Generate software graphs for some cluster (fluxion JGF) (this is done with compspec
2. Register N clusters to a tool (should be written as a python module)
3. Tool would have ability to select clusters from resources known, return
4. Need graphical representation (json) of each cluster - this will be used with the LLM inference

See examples/fractale for a detailed walk-through of the above.

For graph tool:

conda install -c conda-forge graph-tool

Questions

• Should other subsystem types have edges? How used?
• Should we try to map them to nodes in the graph or use another means (or assume global across cluster nodes as we do now)?
• Can we simplify spack subsystem graph (it's really big...)

License

HPCIC DevTools is distributed under the terms of the MIT license. All new contributions must be made under this license.

See LICENSE, COPYRIGHT, and NOTICE for details.

SPDX-License-Identifier: (MIT)

LLNL-CODE- 842614