metaflow-pyinstrument 0.1.0

Profile Metaflow steps with pyinstrument and render as HTML cards

metaflow-pyinstrument

Profile Metaflow steps with pyinstrument and view results as interactive HTML cards.

Installation

pip install metaflow-pyinstrument

Usage

from metaflow import FlowSpec, step, pypi_base
from metaflow_pyinstrument import pyinstrument_card

@pypi_base(packages={'pyinstrument': ''})
class MyFlow(FlowSpec):

    @pyinstrument_card()
    @step
    def train(self):
        # Your code here - will be profiled
        result = sum(i**2 for i in range(100000))
        self.next(self.end)

    @step
    def end(self):
        pass

if __name__ == '__main__':
    MyFlow()

Run with:

python myflow.py --environment=fast-bakery --with kubernetes run

View the card:

python myflow.py card view train

Parameters

Parameter	Default	Description
card_id	"pyinstrument"	Card identifier
interval	0.001	Sampling interval (seconds). Use 0.0001 for fast code
html_attribute	"html"	Artifact name for HTML output