Skip to main content

AWS EMR Launch modules

Project description

EMR Launch

READ THIS FIRST

This project is currently in Beta testing with select customers. It is considered INTERNAL ONLY and should not be shared with customers outside of a paid ProServe engagement.

If you're interested in using this library on an engagement, contact chamcca@

Development

See the docs/!

And the examples/...

Install Project Dependencies

Install aws cdk

npm install -g aws-cdk

Install pipenv

Then install this project's development dependencies using

pipenv install --dev

Install this project's dependencies using

pipenv install '-e .'

Installing New Layer Packages

The following will install

  1. Update the lambda_layer_requirements.txt adding the new package(s)
  2. Install new package(s): pipenv run pip install -r lambda_layer_requirements.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/
    • This will skip upgrades of previously installed packages

Updating Lambda Layer Packages

To Update the Lambda Layer packages it is recommended that you first delete the entire layer contents to eliminate bloat.

  1. Remove packages: rm -fr aws_emr_launch/lambda_sources/layers/emr_config_utils/*
  2. Update the lambda_layer_requirements.txt
  3. Reinstall packages: pipenv run pip install -r lambda_layer_requirements.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/

Testing

To run the test suite (be sure to deactivate the examples virtualenv)

pipenv run pytest

After running tests

View test coverage reports by opening htmlcov/index.html in your web browser.

To write a test

  • start a file named test_[the module you want to test].py
  • import the module you want to test at the top of the file
  • write test case functions that match either test_* or *_test

For more information refer to pytest docs

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

aws_emr_launch-1.2.1-py3-none-any.whl (7.4 MB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page