AWS EMR Launch modules
Project description
EMR Launch
READ THIS FIRST
This project is currently in Beta testing with select customers. It is considered INTERNAL ONLY and should not be shared with customers outside of a paid ProServe engagement.
If you're interested in using this library on an engagement, contact chamcca@
See the docs/!
And the examples/...
Usage
This library is acts as a plugin to the AWS CDK providing additional L2 Constructs. To avoid circular references with CDK dependencies, this package will not install CDK and Boto3. Instead it expects these packages to already be installed.
It is recommended that a Python3 venv
be used for all CDK builds and deployments.
To get up and running quickly:
-
Install the CDK CLI
npm install -g aws-cdk
-
Use your mechanism of choice to create and activate a Python3
venv
:python3 -m venv .env source .env/bin/activate
-
Install the CDK and Boto3 minimum requirements:
pip install -r requirements.txt
-
Install
aws-emr-launch
package (package is currently installed from awheel
file):pip install aws-emr-launch
Development
Follow Step 1 - 3 above to configure an environment and install requirements
Install development requirements
After activating your venv
:
pip install -r requirements-dev.txt
Installing New Layer Packages
The following will install the Lambda Layer packages
- Update the
requirements-lambda-layer.txt
adding the new package(s) - Install new package(s):
pip install -r requirements-lambda-layer.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/
- This will skip upgrades of previously installed packages
Updating Lambda Layer Packages
To Update the Lambda Layer packages it is recommended that you first delete the entire layer contents to eliminate bloat.
- Remove packages:
rm -fr aws_emr_launch/lambda_sources/layers/emr_config_utils/*
- Update the
requirements-lambda-layer.txt
- Reinstall packages:
pip install -r requirements-lambda-layer.txt --target=aws_emr_launch/lambda_sources/layers/emr_config_utils/python/lib/python3.7/site-packages/
Testing
To run the test suite (from within the venv
):
pytest
After running tests
View test coverage reports by opening htmlcov/index.html
in your web browser.
To write a test
- start a file named test_[the module you want to test].py
- import the module you want to test at the top of the file
- write test case functions that match either
test_*
or*_test
For more information refer to pytest docs
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for aws_emr_launch-1.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a7dd0fbc70ea3a4b4fb9e0cb0e791d89a45fea28a69f595f8be068192fe1f51 |
|
MD5 | b094774fe808445ecd7bc9224443fc4c |
|
BLAKE2b-256 | 4884b17a5058fa7d0af137b05eb0e2e017fa073ee32ba9d9d8894ce43c1ba6d0 |