PySpark emulator — Polars for DataFrames, DuckDB for SQL, fake HDFS on local filesystem
Project description
singlespark
PySpark emulator — no JVM required.
- Polars for DataFrame operations
- DuckDB for Spark SQL
- Local filesystem for fake HDFS
Quick start
from singlespark import SparkSession
from singlespark.sql import functions as F
spark = SparkSession.builder.appName("MyApp").getOrCreate()
df = spark.createDataFrame([("Alice", 30), ("Bob", 25)], ["name", "age"])
df.filter(F.col("age") > 26).show()
spark.stop()
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
singlespark-0.1.0.tar.gz
(31.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file singlespark-0.1.0.tar.gz.
File metadata
- Download URL: singlespark-0.1.0.tar.gz
- Upload date:
- Size: 31.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b7e5ea55fbb3b7b82d3a59f25711b940d278d9153144e66771803a63d1ab6fd6
|
|
| MD5 |
eb91dcf3eddba1287553c344e2d65c83
|
|
| BLAKE2b-256 |
a80654c4f81f647891dd237940f7074719515b246359d92e3aeb45cbb5075483
|
File details
Details for the file singlespark-0.1.0-py3-none-any.whl.
File metadata
- Download URL: singlespark-0.1.0-py3-none-any.whl
- Upload date:
- Size: 31.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
996173fca09ccb7f83b1d5de635b2469f2537718ec4f4ce3a2943c832cb028fa
|
|
| MD5 |
29db5fb6fafbacc3bcc1b297ce347b63
|
|
| BLAKE2b-256 |
269f649a27ae167a8b5ff2d9ef88f779ac09da30e48a2d11309a9c575af73ebd
|
