Reusable utilities for working with Glue PySpark jobs
Reason this release was yanked:
buggy
Project description
glue-utils
Description
Reusable utilities for working with Glue PySpark jobs
Installation
As a runtime (or production) dependency...
pip install glue-utils
For development...
This library does not include pyspark and aws-glue-libs as
dependencies as they are already pre-installed in Glue's runtime
environment.
To help in developing your Glue jobs locally in your IDE, it is helpful
to install pyspark and aws-glue-libs. Unfortunately, aws-glue-libs
is not available through PyPI so we can only install it from its git
repository.
pip install pyspark==3.3.0
pip install git+https://github.com/awslabs/aws-glue-libs.git@master
To make your local environment as close to Glue's runtime as possible, use the versions specified in this document.
Documentation
For more details on what you can use this library for, check out the project wiki.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file glue_utils-0.2.2b2.tar.gz.
File metadata
- Download URL: glue_utils-0.2.2b2.tar.gz
- Upload date:
- Size: 4.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.12.3 Darwin/23.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c0a8743c2ffd8a2eaaf3a8337497630826239359ffd2989cbaab7e452875aaf6
|
|
| MD5 |
446498f6f3f3c2cb1c99c0c09df8dc7d
|
|
| BLAKE2b-256 |
c9b2ab6635e62fb37a98d80b793625ecabb55d6c5cda430a917526441307e15b
|
File details
Details for the file glue_utils-0.2.2b2-py3-none-any.whl.
File metadata
- Download URL: glue_utils-0.2.2b2-py3-none-any.whl
- Upload date:
- Size: 4.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.12.3 Darwin/23.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7b869aa35cc3ffe7b9ccd179b7e418bebeaff9b53fa94aa96b244ab4b55bdea8
|
|
| MD5 |
750e5439b78ae6364ba7d2d81f6b8c81
|
|
| BLAKE2b-256 |
1c442037ddff9b28c14995063ff44ce4bb9088709b7aebad794803d31d5d8cc0
|
