Skip to main content

Python tools to interact with Darshan log records of HPC applications.

Project description

Python utilities to interact with Darshan log records of HPC applications.

Features

  • Job summary tool for generating HTML reports of I/O activity in a Darshan log

  • Darshan Report interface for common interactive analysis tasks

  • Low-level CFFI bindings for efficient access to Darshan log files

  • Generic plotting capabilities (matplotlib) for Darshan log data

Usage

For examples and Jupyter notebooks to get started with PyDarshan make sure to check out the examples subdirectory.

Installation

To install in most cases the following will work:

pip install darshan

Testing

Targets for various tests are included in the makefile. To run the normal test suite use:

make test

Or to test against a different version of Python using Tox:

make test-all

Coverage tests can be performed using:

make coverage

Conformance to PEPs can be tested using flake8 via:

make lint

Documentation

Documentation for the Python bindings is generated separately from the darshan-util C library in the interest of using Sphinx. After installing the development requirements the documentation can be built using make as follows:

pip install -r requirements_dev.txt
make docs

File List

  • darshan::

    core darshan python module code

  • devel::

    scripts for building Python wheel

  • docs::

    markdown documentation used by sphinx to auto-generate HTML RTD style doc

  • examples::

    Jupyter notebooks showing PyDarshan usage with log files

  • tests::

    PyDarshan-specific test cases

  • requirements.txt::

    pip requirement file for minimum set of dependencies

  • requirements_dev.txt::

    pip requirement file for dependencies needed to run development tools

  • setup.py::

    python file for building/generating PyDarshan package

  • setup.cfg::

    input for setup.py

  • MANIFEST.in::

    input files for setup.py package

  • tox.ini::

    input for tox which runs the automated testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

darshan-3.4.6.0.tar.gz (693.6 kB view details)

Uploaded Source

Built Distributions

darshan-3.4.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.8 kB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp312-cp312-macosx_11_0_arm64.whl (777.4 kB view details)

Uploaded CPython 3.12 macOS 11.0+ ARM64

darshan-3.4.6.0-cp312-cp312-macosx_10_9_x86_64.whl (783.0 kB view details)

Uploaded CPython 3.12 macOS 10.9+ x86-64

darshan-3.4.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.6 kB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp311-cp311-macosx_11_0_arm64.whl (777.4 kB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

darshan-3.4.6.0-cp311-cp311-macosx_10_9_x86_64.whl (783.0 kB view details)

Uploaded CPython 3.11 macOS 10.9+ x86-64

darshan-3.4.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.6 kB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp310-cp310-macosx_11_0_arm64.whl (777.4 kB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

darshan-3.4.6.0-cp310-cp310-macosx_10_9_x86_64.whl (783.0 kB view details)

Uploaded CPython 3.10 macOS 10.9+ x86-64

darshan-3.4.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (916.5 kB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp39-cp39-macosx_11_0_arm64.whl (777.4 kB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

darshan-3.4.6.0-cp39-cp39-macosx_10_9_x86_64.whl (783.0 kB view details)

Uploaded CPython 3.9 macOS 10.9+ x86-64

darshan-3.4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (917.0 kB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

darshan-3.4.6.0-cp38-cp38-macosx_11_0_arm64.whl (777.4 kB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

darshan-3.4.6.0-cp38-cp38-macosx_10_9_x86_64.whl (783.0 kB view details)

Uploaded CPython 3.8 macOS 10.9+ x86-64

File details

Details for the file darshan-3.4.6.0.tar.gz.

File metadata

  • Download URL: darshan-3.4.6.0.tar.gz
  • Upload date:
  • Size: 693.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.8.10

File hashes

Hashes for darshan-3.4.6.0.tar.gz
Algorithm Hash digest
SHA256 a105ec5c9bcd4a20469470ca51db8016336ede34a1c33f4488d1ba263a73c378
MD5 5d777df48f694deb6fa88e27c4e1d578
BLAKE2b-256 690d0a3b4daebea76ff51d23fa64bf3765824f41b6e9d4f92e922de634663ae6

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 7840abd6775550462d2330210da5d1f34a653d721fab5f7f621ef1c7ccf27fa3
MD5 5768b938217a1d98cf29a6ea75d25949
BLAKE2b-256 7b058a908706951d8d4504b5e05fe163f6c4f5cfc817201227344da43e319351

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 45a62d44e852808abef5cd85ad221f0b8274380ed98422b244201e1b4c2f95cc
MD5 a847162b062a9280a0bed005111d20e0
BLAKE2b-256 b0e069eb800e931ea0927d0d8bbef63cd6c147070f5002d107732bd4a10b7ffe

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp312-cp312-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp312-cp312-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d5c433e84e4a0ba3d1318ade2da8d25f2704b5a42af75638ba254a196b751788
MD5 ca3e2f6155a25f192423a17ee7fea1ff
BLAKE2b-256 d5ab647c852f1aeee9322ede8b1fe4cfc224dd30d0cbe86f57cc8107d5fbe5ff

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4a00767936ec0940e664abc385283c4dd92071c1f77c292d1d17d979a4f4ebca
MD5 f5d49e1f3f919f85383b58ea4684697c
BLAKE2b-256 df51e8bdeca4360a6d5f43b3f10ce38dea49704cf9dd87f2bce496cfadcbf72c

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 04959dbf67ff25560d68e75003a1afa899cbdc1c43c498c6c2bb4426d5fc068e
MD5 24817ced26cf9449d74c5d45bffd8cef
BLAKE2b-256 a611b01238ef5505777eee04f758e802a9f26186a57ce974450ee07e95b04ce2

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 996a0ada1c27e5b20b8136e003c0f06cf7d38ceeefd3d70a8fb59cb38c0c1169
MD5 cf205693b465fe70710d2eff19b77ba2
BLAKE2b-256 3d6a133afd6b81485b06b3495058e5865b4cb28ab7fe956d3d22a289c232ffb7

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 8540919293ca1ba0746d11bf85b0348f289cc0e16454e6b63442b8c12f0311d0
MD5 6827c2f86de1a9b84173162ed58e315f
BLAKE2b-256 c1663fcca8c39d6fd0bb16d8c85d16656e749284979a4c9f653684bae5cb0b01

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 de3f8d5119f75ba33252608115ce5c32b29ecbf7c611212c0e9b2600bacf2cc1
MD5 c69f03294816fdd85a24e14fbe86e01f
BLAKE2b-256 e057cb2acf7c53cfc5c17f93e69428486b378126203e68b47ae4549060f731b2

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 dbd6c9da9f5fe1342f60d5f58b77a5894f13884382da25bdd74aed0f719846d7
MD5 123bf735edb528bbde10f341728af776
BLAKE2b-256 c3e0741a615dd7da709cb648f6c7fba3c78cf4e98c83fb2b409c15e3b0df46ce

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d7ca4bf3b37edabcadc9c3799f680dd3fc809bd5b4b583a77677cfd51af12b64
MD5 6c122cac994661621b629ee66b05805f
BLAKE2b-256 c83a632a171e905cc6987def174dabb2bd83260a41a1bbbe7f61d9f2b3d68c8c

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 4a52dcbfc684567b73e30cc9aca3e604a2c84bde862335412d9fbe3584722b6e
MD5 d04cfd78d254ffea957a9608f80b2030
BLAKE2b-256 3c5b9107d27755817687d7a107d9618b4a53970e3bd78215af2cce12b3926944

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp39-cp39-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 6e3199cf8a27484d0e6e1588e0c5dd57f7517e0f6916bcabb0c80049feadc7cb
MD5 85147568f51ff23bfb5a4d8e6e263972
BLAKE2b-256 fa40941da0c3050744b1b09f66b80196be076fc73f07ffe0838a40302db8d396

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 c8cd4a45c69d003b9515365f5a6f5d0f2e47a1db013616edcf3632ab64d860b3
MD5 5f46ef2f13f4382814602801dd8dadbd
BLAKE2b-256 54e006a0d264692aa6833091f04d70ee42f4f981cbb02c8c9221db12ac01cbc7

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6806b8408f1e1bf92852f3554f4ef572359a74377c3160cb281a3dfb10e4e4e6
MD5 5b525aa53cf8a83dec664a8b6f9e1207
BLAKE2b-256 cfc283cf1678aff6316cf96945e2d8aee5f172fdcab6200b81a32c5b7f4d7823

See more details on using hashes here.

File details

Details for the file darshan-3.4.6.0-cp38-cp38-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for darshan-3.4.6.0-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 2f44eec494acf129e9a9756c308a5724987510590d754efd032f1c3e65ae3781
MD5 8bd7e74173f0c5ae9557852c2b1dcaf4
BLAKE2b-256 54b75e1241afd10726739590b55cc718c1195c132848e944aabde45f541dd92f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page