echofish-aws-resample-and-write-to-zarr-store-lambda

Setting up the Python Environment

MacOS

Install pyenv (https://github.com/pyenv/pyenv#set-up-your-shell-environment-for-pyenv)
1. brew update
2. brew install pyenv
3. In ~/.bashrc add
  1. export PYENV_ROOT="$HOME/.pyenv"
  2. export PATH="$PYENV_ROOT/bin:$PATH"
  3. eval "$(pyenv init -)"
4. brew install openssl readline sqlite3 xz zlib tcl-tk
Install pyenv-virtualenv (https://github.com/pyenv/pyenv-virtualenv)
1. brew install pyenv-virtualenv
2. In ~/.bashrc add
  1. eval "$(pyenv virtualenv-init -)"
Open a new terminal
Install Python version
1. env PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv install 3.9.16
2. Optional: set global version of Python env PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv global 3.9.16
Create virtual env
1. pyenv virtualenv 3.9.16 echofish-aws-resample-and-write-to-zarr-store-lambda
Set local version of python (if not done already)
1. change directory to root of project
2. pyenv local echofish-aws-resample-and-write-to-zarr-store-lambda

Other OS

Get a Mac
See Above MacOS

Setting up IntelliJ

Install the IntelliJ Python plugin
Set up pyenv
1. File -> Project Structure or CMD + ;
2. SDKs -> + -> Add Python SDK -> Virtual Environment
3. Select Existing Environment
4. Choose ~/.pyenv/versions/echofish-aws-resample-and-write-to-zarr-store-lambda/bin/python
Set up Python Facet (not sure if this is required)
1. File -> Project Structure or CMD + ;
2. Facets -> + -> Python
3. Set interpreter

Installing Dependencies

Add dependencies with versions to requirements.txt
pip install --upgrade pip && pip install -r requirements_dev.txt

Maven

This project can use Apache Maven to easily build this project. However, this is not required, but recommended. Maven can be easily installed by downloading it from the Maven site or using sdkman.

Build with Maven

After setting up your pyenv run: mvn clean install

Functional Testing

To run a functional test, developer will need to save the associated environment variables in .env for the lambda to use. The ACCESS_KEY and SECRET_ACCESS_KEY can be generated in IAM, users, rudy-dev, security credentials, access keys, create access key. Copy other values as needed from deployed CloudFormation Template.

export OUTPUT_BUCKET=rudy-dev-echofish-118234403147-echofish-dev-output
export TABLE_NAME=rudy-dev-echofish-EchoFish-File-Info
export OUTPUT_BUCKET_ACCESS_KEY="XXX"
export OUTPUT_BUCKET_SECRET_ACCESS_KEY="YYY"
export TOPIC_ARN="arn:aws:sns:us-west-2:118234403147:rudy-dev-echofish-processing-finished"

Elastic Container Registry

Note that the main repository is built and curated in the mgg-dev account in us-west-2. The derived docker image is built and pushed to the echofish us-east-1 ECR. That image is then replicated to the echofish us-west-2 account. You will need to go to the echofish ECR -> Repositories -> [repo] -> Permissions and copy the values from an existing project (for both regions).

Metadata

Release files for echofish-aws-resample-and-write-to-zarr-store-lambda 1.0.0.dev20230930042637

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for echofish-aws-resample-and-write-to-zarr-store-lambda 1.0.0.dev20230930042637
File	Size	Uploaded
echofish-aws-resample-and-write-to-zarr-store-lambda-1.0.0.dev20230930042637.tar.gz	12.9 kB	Sep 30, 2023	Details

Built distribution (wheel)

Table of built distributions (wheels) for echofish-aws-resample-and-write-to-zarr-store-lambda 1.0.0.dev20230930042637
File	Interpreter	ABI	Platform	Reset
echofish_aws_resample_and_write_to_zarr_store_lambda-1.0.0.dev20230930042637-py3-none-any.whl 14.2 kB Sep 30, 2023	Python 3	none	any	Details

Total release size: 27.1 kB

Release files / echofish-aws-resample-and-write-to-zarr-store-lambda-1.0.0.dev20230930042637.tar.gz

Download URL	echofish-aws-resample-and-write-to-zarr-store-lambda-1.0.0.dev20230930042637.tar.gz
Size	12.9 kB
Tags	Source
SHA-256 checksum How to use checksums	`8f5d78258539a7f15c6d0468777eaf73e194af26cde8f1c3b1924e8f52276b66`
BLAKE2b-256 checksum How to use checksums	`a26d1c9cce4b5dcb504ee55ad2cfc003653054c41bb1b95e501d1cfd91dfb6c9`
Upload date	Sep 30, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / echofish_aws_resample_and_write_to_zarr_store_lambda-1.0.0.dev20230930042637-py3-none-any.whl

Download URL	echofish_aws_resample_and_write_to_zarr_store_lambda-1.0.0.dev20230930042637-py3-none-any.whl
Size	14.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`a4b67470c7b3a65ae613f224c7b8b709b9e954a9298ab21864209a9a2c6a95d2`
BLAKE2b-256 checksum How to use checksums	`d5ec4cfeca1c83a2bc65de7e267c37da8b7d9a45f43e970301e2934b6c7c291b`
Upload date	Sep 30, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`