Skip to main content

typedschema

This is minimally intrusive library to type or annotate pyspark data frames.

There are existing projects which try to change how you interact with pyspark, but this is not the goal of this library. Goals:

  • Create a simple way to define a schema for a pyspark DataFrame.
  • Supply some utility functions to test if the DataFrame adheres to a predefined schema.
  • Enable schema column autocompletion in your editor
  • Re-use existing stuff, such as StructField, from pyspark

For full documentation see typedschema documentation

Metadata

Release files for pyspark-typedschema 0.0.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pyspark-typedschema 0.0.6
File Size Uploaded
pyspark_typedschema-0.0.6.tar.gz 28.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pyspark-typedschema 0.0.6
File Interpreter ABI Platform
pyspark_typedschema-0.0.6-py3-none-any.whl Python 3 none any Details

Total release size: 46.5 kB

Release files / pyspark_typedschema-0.0.6.tar.gz

Download URL pyspark_typedschema-0.0.6.tar.gz
Size 28.4 kB
Tags Source
SHA-256 checksum
How to use checksums
947bfa0be38a27a1c4c259d04e1361d18ddde07aa718d5f24200ffe150639bdf
BLAKE2b-256 checksum
How to use checksums
66881365623cff061a5435c82914d2f9e03d2c0c87af191f1b7b8b33a23a9c9a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release files / pyspark_typedschema-0.0.6-py3-none-any.whl

Download URL pyspark_typedschema-0.0.6-py3-none-any.whl
Size 18.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a31f7d3d1fb988d847def3c8088ac77d067dd0e296aeed70fdbcc39b9f47db32
BLAKE2b-256 checksum
How to use checksums
1732ad0b0670e96fbf369e749fb89b2a7632d93cedee6074b1b1bf8931e93af2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.8

Release history Release notifications | RSS feed

This release

0.0.6 This release

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page