pyspark-inspect
pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.
Compatibility & Limitiations
There is only a subset of functions implemented.
Tested against:
| Spark Classic | 3.5.2 | Databricks Runtime 16.4 |
| 3.5.9 | Apache Spark | |
| Spark Connect | 3.5.2 | Databricks Runtime 16.4 |
| 4.2.0 | Databricks Serverless |
Basic Usage
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E
ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_col()
1 maintainer
Metadata
1 maintainer
Release files for pyspark-inspect 0.5.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pyspark_inspect-0.5.2.tar.gz | 6.7 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyspark_inspect-0.5.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 15.5 kB
Release files / pyspark_inspect-0.5.2.tar.gz
| Download URL | pyspark_inspect-0.5.2.tar.gz |
|---|---|
| Size | 6.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d5824e039edf123c169fd55bf02ad627aa77a6ec63f09ea15416bf929a69161c
|
|
BLAKE2b-256 checksum How to use checksums |
24d535145f2119714868e9eea2eb58fb5fd74be886e30b4e4a85f088c74d06c4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Release files / pyspark_inspect-0.5.2-py3-none-any.whl
| Download URL | pyspark_inspect-0.5.2-py3-none-any.whl |
|---|---|
| Size | 8.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
11bc68b5de58956f799ab9d13f70c11d389b703c71d80cd5f0d1563204b472bc
|
|
BLAKE2b-256 checksum How to use checksums |
14ada314a1b1d1e04db5a89bc11bf7d1ef7b77bffaaad514056133f10a3b6c43
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0
|
Security for pyspark-inspect 0.5.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
