Python tools to interact with darshan log records of HPC applications.
Project description
Python utilities to interact with Darshan log records of HPC applications. pydarshan requires darshan-utils (3.2.2+) to be installed.
Features
Darshan Report Object Wrapper
CFFI bindings to access darshan log files
Plots typically found in the darshan reports (matplotlib)
Auto-discover darshan-util.so (via darshan-parser in $PATH)
Usage
For examples and Jupyter notebooks to get started with pydarshan make sure to check out the examples subdirectory.
A brief examples showing some of the basic functionality is the following:
import darshan # Open darshan log report = darshan.DarshanReport('example.darshan') # Load some report data report.mod_read_all_records('POSIX') report.mod_read_all_records('MPI-IO') # or fetch all report.read_all_generic_records() # ... # Generate summaries for currently loaded data # Note: aggregations are still experimental and have to be activated: darshan.enable_experimental() report.summarize()
Installation
To install in most cases the following will work:
pip install darshan
For alternative installation instructions and installation from source refer to <docs/install.rst>
Testing
Targets for various tests are included in the makefile. To run the normal test suite use:
make test
Or to test against different version of Python using Tox:
make test-all
Coverage tests can be performed using:
make coverage
Conformance to PEPs can be tested using flake8 via:
make lint
Documentation
Documentation for the python bindings is generated seperatedly from the darshan-utils C library in the interest of using Sphinx. After installing the developement requirements using pip install -r requirements_dev.txt the documentation can be build using make as follows:
pip install -r requirements_dev.txt make docs
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Hashes for darshan-0.0.6-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8df38cdef84c960ac0946d4d6144cb28eb0e744fdce924cdaab59ae0b0aa1ba3 |
|
MD5 | ffd8b348dcc3225fdf8ce28ccdfa10ea |
|
BLAKE2b-256 | bc7287e79e1e11735a10491cd1264af8feee9fab82df74c4ed5a60501461271b |
Hashes for darshan-0.0.6-cp39-cp39-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2646cb072661e998a6e0888dfcb07b3a6ac9eb96f0321b84e5d32a21f352ce02 |
|
MD5 | caa0529b39dfb82bf4d2eb6693b53240 |
|
BLAKE2b-256 | 49b6f5ecbeea5a05a86cdc93fc95bc904ec01f6eafe5922dce3bb94141de1d22 |
Hashes for darshan-0.0.6-cp39-cp39-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd01f39aebc3929026d447b777d6aa9561e46bca4e38c36ace6f943cdec67d91 |
|
MD5 | 5dd9deb6a2f1d03f5aa5aecac3e9b029 |
|
BLAKE2b-256 | ab93484ac6da0af690322eb30de21fa4c1ff33e9158411decc683b1ba094b470 |
Hashes for darshan-0.0.6-cp39-cp39-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ddc8a7b071ec1a8aabfa1abedebf6740b97eb3660852e699d6f1f65d40f63de3 |
|
MD5 | 92d5d7b9eab7ea2c862c207636439f0b |
|
BLAKE2b-256 | 68caa31258633cd5755f688c2be08ee20ca18a07f9d2e6c3856c4e9b893703ea |
Hashes for darshan-0.0.6-cp38-cp38-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 851465249099e46dadd2cee9971bc5a4d1323a0e3c7c5010ecc934ce5be5927c |
|
MD5 | 7ccc26d38d47a0b820c63830fa2f90de |
|
BLAKE2b-256 | 52acf90816617739624f211da36953c7d1245e1e1ba9b399fc2303c4150b43f0 |
Hashes for darshan-0.0.6-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 94c628701e653882231490a8d07b29bde2166ce62099a325b562c39dab8e9b7e |
|
MD5 | 6ea51ce54cd5cbfd4221d70ced5028c5 |
|
BLAKE2b-256 | 6e99afebc86b1ef6e49334fca65f12995b846f2da5171a4c0eb9ad2222dd1ce7 |
Hashes for darshan-0.0.6-cp38-cp38-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8faf32a0d85b7a9f319afa5832e23e41cd2d581d107d5be13a49cac3285578ed |
|
MD5 | 2880fbd3ce156dd5fd1bbdd918dfc212 |
|
BLAKE2b-256 | e1ddd9d44bab56cc6d687cd25912cedb29fc7831db3a5656fea44ac392b0f7fa |
Hashes for darshan-0.0.6-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbf4dbae2dc11b5c5d6356528f8df20fb475d10dea69963373725ad2cb333532 |
|
MD5 | 2f47ceba1ee12488263061ba29d67aa2 |
|
BLAKE2b-256 | 7e3c45a6ef9179c04d63283747f1b162aab57df3eb1ab0105a5634eda4f42709 |
Hashes for darshan-0.0.6-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b2535b9499555d45444bece5d791bfe355d9fbe5e53ffbefb279fc741ae24916 |
|
MD5 | 95462c24649ad46fd78d30af13479a76 |
|
BLAKE2b-256 | e995e18c3d53957c846db924fa6b0e33015ad448196b6dcbe546c337ce5bb2b1 |
Hashes for darshan-0.0.6-cp37-cp37m-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d086d7ce701033ba47f6e3f302e1911560078103f799c6ddefb8b3be83c3af7e |
|
MD5 | f277f5aa7db14fccc77ce9336db4932f |
|
BLAKE2b-256 | 0063ef0d8a121a1c1e9c691d5a1279ab51dae5eaf48cb53a8b36bb789761810e |
Hashes for darshan-0.0.6-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c66d00f99411e921e561e6b6296902679c33c0e760f85afd8ce6fe6d13722b8f |
|
MD5 | c8ad3869ad53f7e762626975f156fe85 |
|
BLAKE2b-256 | 0630203ec733578219ad986cb85511bb2cceff0d45fca5671baafe389efccbe1 |
Hashes for darshan-0.0.6-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 960def70ec1d4bd9cf211c01ed8767a85f59337b9200acc2c7d8af60c1f33c1c |
|
MD5 | bb32f006772d523954e1a052efd73555 |
|
BLAKE2b-256 | 648d92617a6b2562bb53092f0a9852b7c0f0ea1f9d1f192a205d2b86c6cdf7cd |
Hashes for darshan-0.0.6-cp36-cp36m-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ddec063c0425302ad172e3e3311561b2ac0d6a92a595d52a3062167b6cfd15a3 |
|
MD5 | 00808839819a9be14ca0d92b62f0987d |
|
BLAKE2b-256 | 2c9900bb43e26d4e06a6c1e88ddd098adc10a329c915c6a3fe9fa8ccd760a56d |