Skip to main content

toolbox-pyspark

implementation python-versions version github-release
os pypi-status pypi-format github-license pypi-downloads codecov-repo style
contributions
CI CD

Introduction

The purpose of this package is to provide some helper files/functions/classes for generic PySpark processes.

Key URLs

For reference, these URL's are used:

Type Source URL
Git Repo GitHub https://github.com/data-science-extensions/toolbox-pyspark
Python Package PyPI https://pypi.org/project/toolbox-pyspark
Package Docs Pages https://data-science-extensions.com/toolbox-pyspark

Installation

You can install and use this package multiple ways by using any of your preferred methods: pip, pipenv, poetry, or uv.

Using pip:

  1. In your terminal, run:

    python3 -m pip install --upgrade pip
    python3 -m pip install toolbox-pyspark
    
  2. Or, in your requirements.txt file, add:

    toolbox-pyspark
    

    Then run:

    python3 -m pip install --upgrade pip
    python3 -m pip install --requirement=requirements.txt
    

Using pipenv:

  1. Install using environment variables:

    In your Pipfile file, add:

    [[source]]
    url = "https://pypi.org/simple"
    verify_ssl = false
    name = "pypi"
    
    [packages]
    toolbox-pyspark = "*"
    

    Then run:

    python3 -m pip install pipenv
    python3 -m pipenv install --verbose --skip-lock --categories=root index=pypi toolbox-pyspark
    
  2. Or, in your requirements.txt file, add:

    toolbox-pyspark
    

    Then run:

    python3 -m run pipenv install --verbose --skip-lock --requirements=requirements.txt
    
  3. Or just run this:

    python3 -m pipenv install --verbose --skip-lock toolbox-pyspark
    

Using poetry:

  1. In your pyproject.toml file, add:

    [project]
    dependencies = [
        "toolbox-pyspark==1.*",
    ]
    

    Then run:

    poetry sync
    poetry install
    
  2. Or just run this:

    poetry add "toolbox-pyspark==1.*"
    poetry sync
    poetry install
    

Using uv:

  1. In your pyproject.toml file, add:

    [project]
    dependencies = [
        "toolbox-pyspark==1.*",
    ]
    

    Then run:

    uv sync
    
  2. Or run this:

    uv add "toolbox-pyspark==1.*"
    uv sync
    
  3. Or just run this:

    uv pip install "toolbox-pyspark==1.*"
    

Contribution

Check the CONTRIBUTING.md file or Contributing page.

Release files for toolbox-pyspark 1.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for toolbox-pyspark 1.2.1
File Size Uploaded
toolbox_pyspark-1.2.1.tar.gz 72.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for toolbox-pyspark 1.2.1
File Interpreter ABI Platform
toolbox_pyspark-1.2.1-py3-none-any.whl Python 3 none any Details

Total release size:157.2 kB

Release files / toolbox_pyspark-1.2.1.tar.gz

Download URL toolbox_pyspark-1.2.1.tar.gz
Size 72.6 kB
Tags Source
SHA-256 checksum
How to use checksums
4c81a1b532e121691b08d9cb36cec3a50e25c785f9311b0b619711491f588107
BLAKE2b-256 checksum
How to use checksums
406d437c65ae27a9ae510801614ac3facaf024c0566579d54fd38368003382b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.0.1 CPython/3.13.1 Linux/6.8.0-1020-azure

Release files / toolbox_pyspark-1.2.1-py3-none-any.whl

Download URL toolbox_pyspark-1.2.1-py3-none-any.whl
Size 84.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e490088aadb5edb0ec940c2b88b8a7873900f8bdf33ea134561e811624792b64
BLAKE2b-256 checksum
How to use checksums
fe7c30b572ad2da09e94197c78bc1549337e61ae7c2278d209fd7b9e45c519e1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.0.1 CPython/3.13.1 Linux/6.8.0-1020-azure

Release history Release notifications | RSS feed

This release

1.2.1 This release

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.0

2 release files

0.12.0

2 release files

0.11.0

2 release files

0.10.0

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.0

2 release files

0.1.0

2 release files

0.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page