Skip to main content

sparkless-testing

Backend-independent pytest fixtures and helpers for test suites that run against Sparkless or PySpark. Install sparkless[testing] when testing a Sparkless application, or install sparkless-testing directly for a suite that selects its backend independently.

python -m pip install "sparkless[testing]==4.20.0"

Add this to your suite's root conftest.py to load the fixtures and backend markers:

pytest_plugins = ["sparkless_testing.plugin"]

Use the spark fixture in your tests. It selects Sparkless by default. To run the same tests on a local PySpark installation, set SPARKLESS_TEST_MODE=pyspark. The testing guide covers PySpark and Java setup and the compatibility profiles.

Use compare_dataframes() for structured row, ordered-column, and schema results, or assert_dataframes_equal() to fail a test on any difference. Schema checks cover names/order, types, nullability, declared metadata, decimals, and nested struct/array/map fields. An expected mapping can declare schema and an empty data list. See the comparison API contract.

The published 4.19.0 package had the schema comparison defect in #1746. Version 4.20.0 fixes schema comparison for empty results and nested types.

Metadata

Release files for sparkless-testing 4.20.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sparkless-testing 4.20.0
File Size Uploaded Provenance Actions
sparkless_testing-4.20.0.tar.gz 20.2 kB Without provenance Details for sparkless_testing-4.20.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for sparkless-testing 4.20.0
File Interpreter ABI Platform Actions
sparkless_testing-4.20.0-py3-none-any.whl Python 3 none any Details for sparkless_testing-4.20.0-py3-none-any.whl

Total release size: 43.4 kB

Release files / sparkless_testing-4.20.0.tar.gz

Download URL sparkless_testing-4.20.0.tar.gz
Size 20.2 kB
Tags Source
SHA-256 checksum
How to use checksums
f3d4dd998dd09a535810756a9ee62f2875868d347fd9a93fe47cac52468d2dda
BLAKE2b-256 checksum
How to use checksums
83e4ed9b4c1b55b9aa86f5f66ca2a9ea3176a5c626b17db0282988ede8451578
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / sparkless_testing-4.20.0-py3-none-any.whl

Download URL sparkless_testing-4.20.0-py3-none-any.whl
Size 23.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9c6b5a0470f3a9bbb4a34c7c72240dcaba3f1145fe8a4757265a275e1125cd72
BLAKE2b-256 checksum
How to use checksums
178d6f4ba16558cd15fd8a1c4abc32fa5534bd3593ae7fe559969bfb812e20a1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Security for sparkless-testing 4.20.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page