PIT join library for PySpark
Project description
Spark-PIT - Utility library for PIT-joins in PySpark
Description
This projects aims to expose different ways of executing PIT-joins, also called ASOF-joins, in PySpark. This project is created as a part of a research project to evaluate different ways of executing Spark PIT joins.
Prerequisite
In order to run this project in PySpark, you will need to have the JAR file of the Scala implementation be available inside you Spark Session.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
spark-pit-0.1.1.tar.gz
(3.7 kB
view hashes)