Skip to main content

IOR benchmark log file parser for performance analysis and comparison

Project description

ior-parser

A Python package for parsing IOR (Interleaved Or Random) benchmark log files. Extracts performance metrics, test configuration, and filesystem information for analysis, reporting, and automation.

Features

  • Parse IOR log files from command line or Python API
  • Extracts test setup, timing, options, and results sections
  • Converts sizes to bytes and timestamps to Unix time
  • Outputs structured JSON for further analysis
  • CLI and Python API usage
  • Supports IOR logs from multiple versions and verbosity levels

Installation

pip install ior-parser

Or for development:

git clone https://github.com/izzet/ior-parser.git
cd ior-parser
pip install -e .

Usage

Command Line

ior_parser tests/logs/write_only.log --json --pretty

Example output:

{
  "test_setup": {
    "ior_version": "4.0.0",
    "command_line": "bin/ior -a POSIX -s 128 -b 4M -t 1M -F -w -o /tmp/write_only/data/testfile",
    "machine": "Linux corona211",
    "test_id": "0",
    "path": "/tmp/write_only/data/testfile.00000000",
    "file_system_info_text": "14.3 TiB   Used FS: 0.4%   Inodes: 190.7 Mi   Used Inodes: 0.4%",
    "file_system_info": {
      "total_size_bytes": 15723016277196,
      "used_fs_percent": 0.4,
      "total_inodes": 190700000,
      "used_inodes_percent": 0.4
    }
  },
  "test_times": {
    "began_text": "Sun Jul 27 08:35:50 2025",
    "began": 1753630550,
    "start_time_text": "Sun Jul 27 08:35:50 2025",
    "start_time": 1753630550,
    "finished_text": "Sun Jul 27 08:35:51 2025",
    "finished": 1753630551,
    "elapsed_seconds": 1.0
  },
  "options": {
    "api": "POSIX",
    "api_version": null,
    "test_filename": "/tmp/write_only/data/testfile",
    "access": "file-per-process",
    "type": "independent",
    "segments": 128,
    "ordering_in_file": "sequential",
    "ordering_inter_file": "no tasks offsets",
    "nodes": 1,
    "tasks": 1,
    "clients_per_node": 1,
    "repetitions": 1,
    "xfer_size_text": "1 MiB",
    "xfer_size_bytes": 1048576,
    "block_size_text": "4 MiB",
    "block_size_bytes": 4194304,
    "aggregate_file_size_text": "512 MiB",
    "aggregate_file_size_bytes": 536870912
  },
  "results": {
    "write": {
      "bandwidth_mib_max": 660.64,
      "bandwidth_mib_min": 660.64,
      "bandwidth_mib_mean": 660.64,
      "bandwidth_mib_std": 0.0,
      "ops_max": 660.64,
      "ops_min": 660.64,
      "ops_mean": 660.64,
      "ops_std": 0.0,
      "time_seconds_mean": 0.77501
    }
  },
  "_source_file": "tests/logs/write_only.log"
}

Python API

from ior_parser import parse_ior_log
result = parse_ior_log("path/to/ior.log")
print(result.to_dict())

Output Structure

  • test_setup: IOR version, command line, machine, path, filesystem info
  • test_times: began, finished, elapsed (as Unix timestamps)
  • options: parsed IOR options (API, block size, transfer size, etc.)
  • results: read/write operation metrics (bandwidth, IOPS, time)

Development

  • Lint: ruff check .
  • Format: ruff format .
  • Test: pytest
  • Pre-commit: pre-commit run --all-files

License

MIT

Author

Izzet Yildirim (izzetcyildirim@gmail.com)

Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ior_parser-0.1.1.tar.gz (34.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ior_parser-0.1.1-py3-none-any.whl (10.6 kB view details)

Uploaded Python 3

File details

Details for the file ior_parser-0.1.1.tar.gz.

File metadata

  • Download URL: ior_parser-0.1.1.tar.gz
  • Upload date:
  • Size: 34.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ior_parser-0.1.1.tar.gz
Algorithm Hash digest
SHA256 1547f4c580bdbf71e72d3feadf71c274cff8c5ceccddfa8eb4fd9917f24a9e9f
MD5 28e9ab0ad73186779bc1ee1654b032cd
BLAKE2b-256 e38bcdbcadeb2ee16936d86d68b2209c546e755d5842fb6c7a062d2a73d705bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for ior_parser-0.1.1.tar.gz:

Publisher: release.yml on izzet/ior-parser

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ior_parser-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: ior_parser-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 10.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ior_parser-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c8d04988e481d09c27f1133b31c108ed8328527440288a5ff9724875181603f0
MD5 ced19363e5531e834c54ae89b9b384fc
BLAKE2b-256 5d0610fc92881c6515d6a65940c6f4f2a438f1b114d904978fb2d2bd3620759c

See more details on using hashes here.

Provenance

The following attestation bundles were made for ior_parser-0.1.1-py3-none-any.whl:

Publisher: release.yml on izzet/ior-parser

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page