pyspark-inspect
pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.
Compatibility & Limitiations
There is only a subset of functions implemented.
Tested against:
| Spark Classic | 3.5.2 | Databricks Runtime 16.4 |
| 3.5.9 | Apache Spark | |
| Spark Connect | 3.5.2 | Databricks Runtime 16.4 |
| 4.2.0 | Databricks Serverless |
Basic Usage
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E
ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_column()
1 maintainer
Metadata
1 maintainer
Release files for pyspark-inspect 0.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pyspark_inspect-0.5.0.tar.gz | 5.6 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyspark_inspect-0.5.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.1 kB
Release files / pyspark_inspect-0.5.0.tar.gz
| Download URL | pyspark_inspect-0.5.0.tar.gz |
|---|---|
| Size | 5.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
29b5235500f44a0c0ef9d5768807978d6ae4dcb91f4570849eabcaf90d6c96a6
|
|
BLAKE2b-256 checksum How to use checksums |
0fbc8e915c6fe258bf692163772aba4c01fd4ba14b6220573ab718cd4f804e6b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Release files / pyspark_inspect-0.5.0-py3-none-any.whl
| Download URL | pyspark_inspect-0.5.0-py3-none-any.whl |
|---|---|
| Size | 7.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2af350d888f91a9cc52304b826fd2e4302d6be463b7d3416ac24bf6b53aa659a
|
|
BLAKE2b-256 checksum How to use checksums |
ff0d17022c3c331503a8e334a411b9a90606721f567435b01703194aa91f6140
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Security for pyspark-inspect 0.5.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
