Convert Pyarrow schema to Unity Catalog schema
Project description
pyarrow-unity
This library provides functions to convert Pyarrow schema to Unity Catalog schema.
Installation
pip install pyarrow-unity
Functions
model_unity_schema(schema) Converts a Pyarrow schema to a list of Unity Catalog columns.
Parameters:
- schema: The Pyarrow schema to convert.
Returns: A list of Column objects representing the Unity Catalog schema.
Example:
import pyarrow as pa
from pyarrow_unity.model import model_unity_schema
schema = pa.schema([
pa.field('col1', pa.int32(), nullable=True),
pa.field('col2', pa.string(), nullable=False),
pa.field('col3', pa.decimal128(10, 2), nullable=True)
])
columns = model_unity_schema(schema)
for column in columns:
print(f"Name: {column.name}, Type: {column.type_name}, Nullable: {column.nullable}")
License
This project is licensed under the MIT License - see the LICENSE file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyarrow_unity-0.1.0.tar.gz
(2.9 kB
view hashes)
Built Distribution
Close
Hashes for pyarrow_unity-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1140d8abaea4d7d11830ec0a885ea5e018dedb06c50fb154fcf6145c1c80bbe1 |
|
MD5 | 4fd5917989b5518f71aba980c19e8969 |
|
BLAKE2b-256 | 5d953af01122bb56edae78a10839f1d2625e66a188c8dbc031c94f5f9b1568fe |