A library containing various utility functions for playing with PySpark DataFrames
Project description
Spark-frame
What is it ?
Spark-frame is a library that brings several utility methods and transformation functions for PySpark DataFrames. These methods were initially part of the karadoc project used at Younited, but they don't rely on karadoc, so it makes more sense to keep them as standalone library.
Several of these methods were my initial inspiration to make the cousin project
bigquery-frame, which is why you will find similar
methods in transformations and data_diff for both spark_frame and bigquery_frame, except
the former runs on PySpark while the latter runs on BigQuery (obviously).
Installation
spark-frame is available on PyPi.
pip install spark-frame
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for spark_frame-0.0.2-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8848308842a2f7800770185aa86dad39f49d34aab8bed03a73a1127c20c4f130 |
|
| MD5 | 901cdadce90996962cb3e5b52ec0a982 |
|
| BLAKE2b-256 | ebf35be93f9bd743c600e110d51836c789058c83de590d86722224d86ed9bfed |
