importtime-convert 1.0.0.post1

Parse the output of `python -X importtime` and convert it to other formats.

Overview

This is a CLI tool and small library to parse the output of python -X importtime and convert it to other formats. Use it to help visualize and understand your Python import times—for example, by generating flame graphs.

Usage as a CLI tool

This tool expects the raw -X importtime data on stdin and outputs the converted result on stdout.

Typical usage example, with Bash redirection syntax:

# Python outputs its raw importtime data to stderr. Save it to raw_importtime.txt.
python -X importtime -c 'import module_to_test' 2> raw_importtime.txt
# Convert it to "flamegraph.pl" format and save that to converted_importtime.txt.
python -m importtime_convert --output-format flamegraph.pl <raw_importtime.txt >converted_importtime.txt

Or, all in one step:

python -X importtime -c 'import module_to_test' \
    2>&1 >/dev/null \
    | python -m importtime_convert --output-format flamegraph.pl \
    > converted_importtime.txt

See the available output formats below and python -m importtime_convert --help for full details.

Usage as a library

The following are available from import importtime_convert:

parse(input: typing.TextIO | str) -> list[Import]

parse() takes the raw -X importtime data, as a string or as a file-like object. It returns the parsed import structure as a list of top-level imports. The list is in the order that the interpreter traversed them.

Import

An Import is a dataclass with the following keys:

• package: str: The full package path of this import, e.g. "foo.bar".
• cumulative_us: int: The time, in microseconds, that the interpreter spent on this module, including any subimports.
• self_us: int: The time, in microseconds, that the interpreter spent on this module, not including any subimports.
• subimports: list[Import]: This module's subimports. The list is in the order that the interpreter traversed them.

Output conversion functions

• to_flamegraph_pl(imports: list[Import]) -> str
• to_json_serializable(imports: list[Import]) -> list[dict[str, Any]]

See the available output formats below for details.

Available output formats

• --output-format flamegraph.pl (CLI) / to_flamegraph_pl() (API)

  For flame graph generation tools.

  The format is defined by Brendan Gregg's flamegraph.pl script, but other flame graph tools accept it, too. (For example, https://www.speedscope.app/ and https://flamegraph.com/.)

• --output-format json (CLI) / to_json_serializable() (API)

  A simple JSON format specific to this tool. Looks like this:

  [
    {
      "package": "foo",
      "self_us": 200,
      "cumulative_us": 300,
      "subimports": [
        {
          "package": "bar",
          "self_us": 100,
          "cumulative_us": 100,
          "subimports": []
        }
      ]
    },
    {
      "package": "baz.baz",
      "self_us": 100,
      "cumulative_us": 100,
      "subimports": []
    }
  ]
  

  See the API docs above for the meanings of the fields.

Feature requests and pull requests are welcome for additional output formats.

Related work and alternatives

• https://github.com/asottile/importtime-waterfall
• https://github.com/dominikwalk/importtime-output-wrapper
• https://github.com/kmichel/python-importtime-graph
• https://github.com/nschloe/tuna