Convert Pyarrow schema to Unity Catalog schema
Project description
pyarrow-unity
This library provides functions to convert Pyarrow schema to Unity Catalog schema.
Installation
pip install pyarrow-unity
Functions
model_unity_schema(schema) Converts a Pyarrow schema to a list of Unity Catalog columns.
Parameters:
- schema: The Pyarrow schema to convert.
Returns: A list of Column objects representing the Unity Catalog schema.
Example:
import pyarrow as pa
from pyarrow_unity.model import model_unity_schema
schema = pa.schema([
pa.field('col1', pa.int32(), nullable=True),
pa.field('col2', pa.string(), nullable=False),
pa.field('col3', pa.decimal128(10, 2), nullable=True)
])
columns = model_unity_schema(schema)
for column in columns:
print(f"Name: {column.name}, Type: {column.type_name}, Nullable: {column.nullable}")
License
This project is licensed under the MIT License - see the LICENSE file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyarrow_unity-0.1.0.tar.gz
(2.9 kB
view details)
Built Distribution
File details
Details for the file pyarrow_unity-0.1.0.tar.gz
.
File metadata
- Download URL: pyarrow_unity-0.1.0.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa9488391c3f5a85cc1426ff4c500bb42ce9d2a849af1094a78bbf2b6be80769 |
|
MD5 | 01070989222a521f37bddb1da69e78a0 |
|
BLAKE2b-256 | f9d753315546fb8fe198288ca101dbf432e7c53c2e87173baa9f688e707f73a5 |
File details
Details for the file pyarrow_unity-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: pyarrow_unity-0.1.0-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1140d8abaea4d7d11830ec0a885ea5e018dedb06c50fb154fcf6145c1c80bbe1 |
|
MD5 | 4fd5917989b5518f71aba980c19e8969 |
|
BLAKE2b-256 | 5d953af01122bb56edae78a10839f1d2625e66a188c8dbc031c94f5f9b1568fe |