pyspark-inspect
pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.
Compatibility & Limitiations
There is only a subset of functions implemented.
Tested against:
| Spark Classic | 3.5.2 | Databricks Runtime 16.4 |
| 3.5.9 | Apache Spark | |
| Spark Connect | 3.5.2 | Databricks Runtime 16.4 |
| 4.2.0 | Databricks Serverless |
Basic Usage
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E
ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_col()
1 maintainer
Metadata
1 maintainer
Release files for pyspark-inspect 0.5.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pyspark_inspect-0.5.3.tar.gz | 6.7 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyspark_inspect-0.5.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 15.4 kB
Release files / pyspark_inspect-0.5.3.tar.gz
| Download URL | pyspark_inspect-0.5.3.tar.gz |
|---|---|
| Size | 6.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
887e5781890a310ff299544142c6e38614accfa8f97a86e70e26182bea43c8c4
|
|
BLAKE2b-256 checksum How to use checksums |
47bd2f4d193a8c70e83137d744deadc1cf1986a5751505d65d04af0129746d8a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Release files / pyspark_inspect-0.5.3-py3-none-any.whl
| Download URL | pyspark_inspect-0.5.3-py3-none-any.whl |
|---|---|
| Size | 8.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f39422616ebf7ad47832179f4f9d01b6784f462a391c312cc3220cae44d1d2b4
|
|
BLAKE2b-256 checksum How to use checksums |
63b51b986e6d137afd35e58c79e09848714a608140e944eff768a5847aa01926
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Security for pyspark-inspect 0.5.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
