ReFrame is a framework for writing regression tests for HPC systems
ReFrame is a framework for writing regression tests for HPC systems. The goal of this framework is to abstract away the complexity of the interactions with the system, separating the logic of a regression test from the low-level details, which pertain to the system configuration and setup. This allows users to write easily portable regression tests, focusing only on the functionality.
Regression tests in ReFrame are simple Python classes that specify the basic parameters of the test. The framework will load the test and will send it down a well-defined pipeline that will take care of its execution. The stages of this pipeline take care of all the system interaction details, such as programming environment switching, compilation, job submission, job status query, sanity checking and performance assessment.
Writing system regression tests in a high-level modern programming language, like Python, poses a great advantage in organizing and maintaining the tests. Users can create their own test hierarchies, create test factories for generating multiple tests at the same time and also customize them in a simple and expressive way.
You may install ReFrame directly from PyPI through
pip install reframe-hpc
ReFrame will be available in your PATH:
Alternatively, and especially if you want to contribute back to the framework, you may clone this repository:
git clone https://github.com/eth-cscs/reframe.git cd reframe ./bin/reframe -V
Finally, you may access all previous versions of ReFrame here.
You may find the official documentation of the latest release and the current master in the following links:
Building the documentation locally
You may build the documentation of the master locally either with Python 2 or Python 3. Here is how to do it:
pip install -r docs/requirements.txt make -C docs latest
For viewing it, you may do the following:
cd docs/html python -m http.server # or python -m SimpleHTTPServer for Python 2
The documentation is now up on localhost:8000, where you can navigate with your browser.
Examples of Regression Tests
cscs-checks/ folder, you can find realistic regression tests used for the CSCS systems that you can reuse and adapt to your system.
Notice that these tests are published as examples and may not run as-is in your system.
However, they can serve as a very good starting point for implementing your system tests in ReFrame.
You can get in contact with the ReFrame community in the following ways:
For keeping up with the latest news about ReFrame, posting questions and, generally getting in touch with other users and the developers, you may follow the mailing list: email@example.com.
Only subscribers may send messages to the list. To subscribe, please send an empty message to firstname.lastname@example.org.
For unsubscribing, you may send an empty message to email@example.com.
You may also reach the community through Slack here.
Release history Release notifications
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size ReFrame_HPC-2.20-py3-none-any.whl (109.0 kB)||File type Wheel||Python version py3||Upload date||Hashes View hashes|
|Filename, size ReFrame-HPC-2.20.tar.gz (89.9 kB)||File type Source||Python version None||Upload date||Hashes View hashes|
Hashes for ReFrame_HPC-2.20-py3-none-any.whl