qbeast-sharing 0.4.0.dev0

Python Connector for Delta Sharing

Qbeast Sharing

Warning: This project is an experimental extension to Delta Sharing!

This project has been created by forking the official Delta Sharing repository in order to introduce sampling pushdown to the python client.

Qbeast Sharing extends the Delta Sharing open protocol and adds the capabilities of sampling large datasets. Delta Sharing has been designed for secure real-time exchange of large datasets, which enables secure data sharing across different computing platforms. It lets organizations share access to existing Delta Lake and Apache Parquet tables with other organizations, who can then directly read the table in Pandas, Apache Spark, or any other software that implements the open protocol.

This is the Python client library for Delta Sharing, which lets you load shared tables as pandas DataFrames or as Apache Spark DataFrames if running in PySpark with the Apache Spark Connector library.

Installation and Usage

1. Install using pip install qbeast-sharing.
2. To use the Python Connector, see the project docs for details.

Documentation

This README only contains basic information about the Qbeast Sharing Python Connector. Please read the project documentation for full usage details.