11 projects
pyspark-client-rust
Rust-backed drop-in for the PySpark Spark Connect client (pyspark-client): the same `pyspark` API and results, powered by a native Rust engine (tonic) instead of grpcio/py4j.
elementwise-udf
Use Python UDFs inside Spark's native higher-order functions
adbc-driver-spark
ADBC (Arrow Database Connectivity) driver for Apache Spark Connect
pyspark
Apache Spark Python API
pyspark-client
Python Spark Connect client for Apache Spark
pyspark-connect
Apache Spark Python API with Spark Connect by default
pyspark-connect-web
Run the PySpark Connect client in JupyterLite/Pyodide via a grpc-web transport (PySpark in JupyterLite).
z4ai
Lossless compression codec tuned for neural-network model weights
cloudpickle
Pickler class to extend the standard pickle.Pickler functionality
py4j
Enables Python programs to dynamically access arbitrary Java objects
pyspark-jira
PySpark JIRA Data Source
