Skip to main content

Convert Pyarrow schema to Unity Catalog schema

Project description

Github Actions Status

pyarrow-unity

This library provides functions to convert Pyarrow schema to Unity Catalog schema.

Installation

pip install pyarrow-unity

Functions

model_unity_schema(schema) Converts a Pyarrow schema to a list of Unity Catalog columns.

Parameters:

  • schema: The Pyarrow schema to convert.

Returns: A list of Column objects representing the Unity Catalog schema.

Example:

import pyarrow as pa
from pyarrow_unity.model import model_unity_schema

schema = pa.schema([
    pa.field('col1', pa.int32(), nullable=True),
    pa.field('col2', pa.string(), nullable=False),
    pa.field('col3', pa.decimal128(10, 2), nullable=True)
])

columns = model_unity_schema(schema)
for column in columns:
    print(f"Name: {column.name}, Type: {column.type_name}, Nullable: {column.nullable}")

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyarrow_unity-0.1.0.tar.gz (2.9 kB view details)

Uploaded Source

Built Distribution

pyarrow_unity-0.1.0-py3-none-any.whl (3.6 kB view details)

Uploaded Python 3

File details

Details for the file pyarrow_unity-0.1.0.tar.gz.

File metadata

  • Download URL: pyarrow_unity-0.1.0.tar.gz
  • Upload date:
  • Size: 2.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for pyarrow_unity-0.1.0.tar.gz
Algorithm Hash digest
SHA256 fa9488391c3f5a85cc1426ff4c500bb42ce9d2a849af1094a78bbf2b6be80769
MD5 01070989222a521f37bddb1da69e78a0
BLAKE2b-256 f9d753315546fb8fe198288ca101dbf432e7c53c2e87173baa9f688e707f73a5

See more details on using hashes here.

File details

Details for the file pyarrow_unity-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for pyarrow_unity-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1140d8abaea4d7d11830ec0a885ea5e018dedb06c50fb154fcf6145c1c80bbe1
MD5 4fd5917989b5518f71aba980c19e8969
BLAKE2b-256 5d953af01122bb56edae78a10839f1d2625e66a188c8dbc031c94f5f9b1568fe

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page