pyspark-inspect
pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.
Compatibility & Limitiations
There is only a subset of functions implemented.
Tested against:
| Spark Classic | 3.5.2 | Databricks Runtime 16.4 |
| 3.5.9 | Apache Spark | |
| Spark Connect | 3.5.2 | Databricks Runtime 16.4 |
| 4.2.0 | Databricks Serverless |
Basic Usage
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E
ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_column()
1 maintainer
Metadata
1 maintainer
Release files for pyspark-inspect 0.5.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pyspark_inspect-0.5.1.tar.gz | 5.8 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyspark_inspect-0.5.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.6 kB
Release files / pyspark_inspect-0.5.1.tar.gz
| Download URL | pyspark_inspect-0.5.1.tar.gz |
|---|---|
| Size | 5.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
37330016972bcbc43360086a0b49e03db3e2bbe637e15f2d4bd2ee62185380ba
|
|
BLAKE2b-256 checksum How to use checksums |
1cec5ce383cc0b4ee025330cb9b86e98fa84e431923a1bcb2eed6971ec7843fa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Release files / pyspark_inspect-0.5.1-py3-none-any.whl
| Download URL | pyspark_inspect-0.5.1-py3-none-any.whl |
|---|---|
| Size | 7.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
4b5d4036f6e64c334db5c12d1244b018e63bf666f5c17fd7a0db1d2f559e4a3e
|
|
BLAKE2b-256 checksum How to use checksums |
b416eede28b93138f5c530b704e856c4ade04702886dfdd7c6328858f61db31c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Security for pyspark-inspect 0.5.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
