Skip to main content

pyspark-inspect

pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.

Compatibility & Limitiations

  • Tested against Spark 3.5 Classic and Connect, Spark 4.3 Connect
  • No full coverage

Basic Usage

from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E

ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_column()

Metadata

Release files for pyspark-inspect 0.4.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pyspark-inspect 0.4.0
File Size Uploaded
pyspark_inspect-0.4.0.tar.gz 4.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pyspark-inspect 0.4.0
File Interpreter ABI Platform
pyspark_inspect-0.4.0-py3-none-any.whl Python 3 none any Details

Total release size: 10.8 kB

Release files / pyspark_inspect-0.4.0.tar.gz

Download URL pyspark_inspect-0.4.0.tar.gz
Size 4.4 kB
Tags Source
SHA-256 checksum
How to use checksums
68e13ec25493d99395c7c4fe6e0a92bd17aea2814a9a59ca278eb521075e4323
BLAKE2b-256 checksum
How to use checksums
07e1a90b95d6cf70560e75ea26a7f11e6c438192c38c490d6937c652b8aff4ed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0

Release files / pyspark_inspect-0.4.0-py3-none-any.whl

Download URL pyspark_inspect-0.4.0-py3-none-any.whl
Size 6.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0653336c41177c646e7eee6a3a1994d5d6df5e3575c6732f24785462de13d9a7
BLAKE2b-256 checksum
How to use checksums
b068bea97bb7f777336fc38eadff4e94bbc9c1ec3cbfd4df7f00c11b1c57f7ed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.3.2 CPython/3.14.6 Darwin/24.6.0

Release history Release notifications | RSS feed

0.4.2

2 release files

0.4.1

2 release files

This release

0.4.0 This release

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.0

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page