lazyscribe-arrow 0.2.0

Arrow-based artifact handlers for Lazyscribe

Arrow-based artifact handling for lazyscribe

lazyscribe-arrow is a lightweight package that adds the following artifact handlers for lazyscribe:

• csv

Any data structure that implements the Arrow PyCapsule Interface will be compatible with the handlers in this library. Popular compatible open source data structures include

• pandas.DataFrame
• polars.DataFrame
• polars.LazyFrame

Installation

Python 3.10 and above is required. use pip to install:

$ python -m pip install lazyscribe-arrow

Usage

To use this library, simply log an artifact to a lazyscribe experiment or repository with

• handler="csv" for a CSV output

import pyarrow as pa
from lazyscribe import Project

project = Project("project.json", mode="w")
with project.log("My experiment") as exp:
    data = pa.Table.from_arrays([[0, 1, 2]], names=["a"])
    exp.log_artifact(name="data", value=data, handler="csv")

project.save()