Skip to main content

Python tools to interact with Darshan log records of HPC applications.

Project description

Python utilities to interact with Darshan log records of HPC applications.

Features

  • Job summary tool for generating HTML reports of I/O activity in a Darshan log

  • Darshan Report interface for common interactive analysis tasks

  • Low-level CFFI bindings for efficient access to Darshan log files

  • Generic plotting capabilities (matplotlib) for Darshan log data

Usage

For examples and Jupyter notebooks to get started with PyDarshan make sure to check out the examples subdirectory.

Installation

To install in most cases the following will work:

pip install darshan

Testing

Targets for various tests are included in the makefile. To run the normal test suite use:

make test

Or to test against a different version of Python using Tox:

make test-all

Coverage tests can be performed using:

make coverage

Conformance to PEPs can be tested using flake8 via:

make lint

Documentation

Documentation for the Python bindings is generated separately from the darshan-util C library in the interest of using Sphinx. After installing the development requirements the documentation can be built using make as follows:

pip install -r requirements_dev.txt
make docs

File List

  • darshan::

    core darshan python module code

  • devel::

    scripts for building Python wheel

  • docs::

    markdown documentation used by sphinx to auto-generate HTML RTD style doc

  • examples::

    Jupyter notebooks showing PyDarshan usage with log files

  • tests::

    PyDarshan-specific test cases

  • requirements.txt::

    pip requirement file for minimum set of dependencies

  • requirements_dev.txt::

    pip requirement file for dependencies needed to run development tools

  • setup.py::

    python file for building/generating PyDarshan package

  • setup.cfg::

    input for setup.py

  • MANIFEST.in::

    input files for setup.py package

  • tox.ini::

    input for tox which runs the automated testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

darshan-3.4.6.0.tar.gz (693.6 kB view hashes)

Uploaded Source

Built Distributions

darshan-3.4.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.8 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp312-cp312-macosx_11_0_arm64.whl (777.4 kB view hashes)

Uploaded CPython 3.12 macOS 11.0+ ARM64

darshan-3.4.6.0-cp312-cp312-macosx_10_9_x86_64.whl (783.0 kB view hashes)

Uploaded CPython 3.12 macOS 10.9+ x86-64

darshan-3.4.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.6 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp311-cp311-macosx_11_0_arm64.whl (777.4 kB view hashes)

Uploaded CPython 3.11 macOS 11.0+ ARM64

darshan-3.4.6.0-cp311-cp311-macosx_10_9_x86_64.whl (783.0 kB view hashes)

Uploaded CPython 3.11 macOS 10.9+ x86-64

darshan-3.4.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.6 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp310-cp310-macosx_11_0_arm64.whl (777.4 kB view hashes)

Uploaded CPython 3.10 macOS 11.0+ ARM64

darshan-3.4.6.0-cp310-cp310-macosx_10_9_x86_64.whl (783.0 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

darshan-3.4.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.5 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp39-cp39-macosx_11_0_arm64.whl (777.4 kB view hashes)

Uploaded CPython 3.9 macOS 11.0+ ARM64

darshan-3.4.6.0-cp39-cp39-macosx_10_9_x86_64.whl (783.0 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

darshan-3.4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (917.0 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp38-cp38-macosx_11_0_arm64.whl (777.4 kB view hashes)

Uploaded CPython 3.8 macOS 11.0+ ARM64

darshan-3.4.6.0-cp38-cp38-macosx_10_9_x86_64.whl (783.0 kB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page