Skip to main content

AWS EMR Launch modules

Project description

EMR Launch

READ THIS FIRST

This project is currently in Beta testing with select customers. It is considered INTERNAL ONLY and should not be shared with customers outside of a paid ProServe engagement.

If you're interested in using this library on an engagement, contact chamcca@

Development

See the docs/!

And the examples/...

Install Project Dependencies

Install aws cdk

npm install -g aws-cdk

Install pipenv

Then install this project's development dependencies using

pipenv install --dev

Install this project's dependencies using

pipenv install '-e .'

Installing New Layer Packages

The following will install

  1. Update the lambda_layer_requirements.txt adding the new package(s)
  2. Install new package(s): pipenv run pip install -r lambda_layer_requirements.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/
    • This will skip upgrades of previously installed packages

Updating Lambda Layer Packages

To Update the Lambda Layer packages it is recommended that you first delete the entire layer contents to eliminate bloat.

  1. Remove packages: rm -fr aws_emr_launch/lambda_sources/layers/emr_config_utils/*
  2. Update the lambda_layer_requirements.txt
  3. Reinstall packages: pipenv run pip install -r lambda_layer_requirements.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/

Testing

To run the test suite (be sure to deactivate the examples virtualenv)

pipenv run pytest

After running tests

View test coverage reports by opening htmlcov/index.html in your web browser.

To write a test

  • start a file named test_[the module you want to test].py
  • import the module you want to test at the top of the file
  • write test case functions that match either test_* or *_test

For more information refer to pytest docs

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aws_emr_launch-1.2.1-py3-none-any.whl (7.4 MB view details)

Uploaded Python 3

File details

Details for the file aws_emr_launch-1.2.1-py3-none-any.whl.

File metadata

  • Download URL: aws_emr_launch-1.2.1-py3-none-any.whl
  • Upload date:
  • Size: 7.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.5

File hashes

Hashes for aws_emr_launch-1.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 928f821f945cc6de97893e69e0177775231332a6c884ba3f83a6b2b8ba7090c4
MD5 74b872c6a2463d61bc331134086cccca
BLAKE2b-256 90c2ce2f2736ce52b13dcaa8e430faaa68f9b52c1ff7c0d468627d58e887b0fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page