pyspark-inspect
pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.
Compatibility & Limitiations
There is only a subset of functions implemented.
Tested against:
| Spark Classic | 3.5.2 | Databricks Runtime 16.4 |
| 3.5.9 | Apache Spark | |
| Spark Connect | 3.5.2 | Databricks Runtime 16.4 |
| 4.2.0 | Databricks Serverless |
Basic Usage
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E
ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_column()
1 maintainer
Metadata
1 maintainer
Release files for pyspark-inspect 0.4.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pyspark_inspect-0.4.5.tar.gz | 5.5 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyspark_inspect-0.4.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.0 kB
Release files / pyspark_inspect-0.4.5.tar.gz
| Download URL | pyspark_inspect-0.4.5.tar.gz |
|---|---|
| Size | 5.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e64a0bb302bc50b9c93928cd78f3fca382ed4426e9061dc659e776a544bd900a
|
|
BLAKE2b-256 checksum How to use checksums |
162b92fbb03921533525c0214e18c08f7b4b3f22abdaa3a79919e8fd01725201
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Release files / pyspark_inspect-0.4.5-py3-none-any.whl
| Download URL | pyspark_inspect-0.4.5-py3-none-any.whl |
|---|---|
| Size | 7.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2b902e99071a035398dc3188cca5a485dd5e77e824f477d42959fcbd077fadd2
|
|
BLAKE2b-256 checksum How to use checksums |
aed3f2805d15a8fb17ffc01d36268f72d60e8d8003d7f784555d0bea2f4a88de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Security for pyspark-inspect 0.4.5
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
