schemarrow 0.1.0a0

right out of the box mljar pipeline.

SchemArrow

SchemArrow simplifies the conversion between pandas and Arrow DataFrames, allowing you to seamlessly switch back and forth. Get started:

Get started:

Installation

To install the package use pip:

pip install schemarrow

Usage

import pandas as pd
from schemarrow import SchemArrow

# Create a pandas DataFrame
df = pd.DataFrame({
    'A': [1, 2, 3],
    'B': ['a', 'b', 'c'],
    'C': [1.1, 2.2, 3.3],
    'D': [True, False, True]
})

# Instantiate a SchemArrow object
arrow_schema = SchemArrow()

# Convert the pandas DataFrame dtypes to arrow dtypes
df_pa: pd.DataFrame = arrow_schema(df)

print(df_pa.dtypes)

outputs:

A     int64[pyarrow]
B    string[pyarrow]
C    double[pyarrow]
D      bool[pyarrow]
dtype: object