Reusable utilities for working with Glue PySpark jobs
Project description
glue-utils
Description
Reusable utilities for working with Glue PySpark jobs
Installation
pip install glue-utils
Usage
from glue_utils.context import ManagedGlueContext
options = getResolvedOptions(sys.argv, [])
with ManagedGlueContext(options=options) as glue_context:
dyf = extract(
glue_context=glue_context,
path="s3://awsglue-datasets/examples/us-legislators/all/persons.json",
)
dyf.printSchema()
License
This project is licensed under the MIT License.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
glue_utils-0.1.0.tar.gz
(3.0 kB
view hashes)
Built Distribution
Close
Hashes for glue_utils-0.1.0-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 29f293add610a2fbc3750158d61b0c9df4f7c159a3e272a8283b9c14e707ff72 |
|
| MD5 | 471a43f1f313a07e65b989382bfdf26d |
|
| BLAKE2b-256 | 810f76b662d2170b47d8bf3facaa5ad42028a51fbbec674d44af31c73ed2b111 |
