Skip to main content

Continuous integration pipeline for aws lambda function

Project description

Continuous integration pipeline for aws lambda function

https://github.com/obytes/aws-lambda-ci/raw/main/docs/images/demo_code_changed_deps_changed.gif

Features

✅ Supports the two famous lambda runtimes python and nodejs.

✅ Supports installing custom packages that does not exist in lambda runtime passed to CI process as a package’s descriptor file path in git repository.

✅ Supports installing custom pip/npm dependencies that does not exist in lambda runtime and passed to CI process as a package’s descriptor file path, packages.json or requirements.txt.

✅ The integration/deployment process is fast thanks to code and dependencies caching.

✅ The lambda dependencies packages are built in a sandboxed local environment that replicates the live AWS Lambda environment almost identically – including installed software and libraries.

✅ The pipeline does not break the currently published version and traffic shifting between the current and new deployment is seamless.

Requirements

IAM Permissions

The user/role that call this pipeline should have these permissions attached to it.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "",
            "Effect": "Allow",
            "Action": [
                "s3:ListBucket",
                "s3:GetObject"
            ],
            "Resource": [
                "arn:aws:s3:::artifacts-bucket-name/*",
                "arn:aws:s3:::artifacts-bucket-name"
            ]
        },
        {
            "Sid": "",
            "Effect": "Allow",
            "Action": [
                "s3:PutObject",
                "s3:GetObject"
            ],
            "Resource": [
                "arn:aws:s3:::artifacts-bucket-name/lambda-ci/function-name/*",
                "arn:aws:s3:::artifacts-bucket-name/lambda-ci/function-name"
            ]
        },
        {
            "Sid": "",
            "Effect": "Allow",
            "Action": [
                "lambda:UpdateFunctionConfiguration",
                "lambda:UpdateFunctionCode",
                "lambda:UpdateAlias",
                "lambda:PublishVersion",
                "lambda:GetFunction"
            ],
            "Resource": "arn:aws:lambda:us-east-1:YOUR_ACCOUNT_ID:function:function-name"
        },
        {
            "Sid": "",
            "Effect": "Allow",
            "Action": [
                "lambda:PublishLayerVersion",
                "Lambda:ListLayerVersions"
            ],
            "Resource": "arn:aws:lambda:us-east-1:YOUR_ACCOUNT_ID:layer:function-layer-name"
        },
        {
            "Sid": "",
            "Effect": "Allow",
            "Action": "lambda:GetLayerVersion",
            "Resource": "arn:aws:lambda:us-east-1:YOUR_ACCOUNT_ID:layer:function-layer-name:*"
        }
    ]
}

Packages

  • python3

  • docker

Usage

Installation

pip3 install aws-lambda-ci

Arguments

These are the available arguments:

ARG

USAGE

–app-s3-bucket

The s3 bucket name that will hold the application code and dependencies

Required

Default: None

Allowed: existing S3 bucket name

–function-name

AWS lambda function name

Required

Default: None

Allowed: existing lambda function name

–function-runtime

AWS lambda function runtime (eg: python3.7)

Optional

Default: python3.8

Allowed: pythonX.x``|``nodejsX.x

–function-alias-name

AWS Lambda alias name (eg: latest)

Optional

Default: latest

Allowed: version tag (eg: latest, qa, prod …)

–function-layer-name

AWS Lambda layer name (eg: demo-lambda-dependencies)

Optional

Default: {function-name}-deps

Allowed: a valid layer name

–app-src-path

Lambda function sources directory that will be archived (eg: demo-lambda/src)

Optional

Default: current directory

Allowed: an existing directory with source code

–app-packages-descriptor-path

Packages descriptor path (eg: demo-lambda/requirements.txt)

Optional

Default: requirements.txt

Allowed: an existing and valid requirements.txt or package.json

–source-version

The unique revision id (eg: github commit sha, or SemVer tag)

Optional

Default: Random hash

Allowed: commit hash | tag ver

–aws-profile-name

AWS profile name (if not provided, will use default aws env variables)

Optional

Default: None

Allowed: existing aws profile name

–watch-log-stream

Watch lambda log stream in realtime after publishing the function

Optional

Default: True

Allowed: Boolean

–build-docker-repo

Use custom build docker repository (other than lambci/lambda)

Optional

Default: lambci/lambda

Allowed: a valid docker repo without image tag part

–build-docker-image

Custom build docker image tag (if not provided, will use build-{[python|node][runtime-version]}) lambci/lambda repo

Optional

Default: None

Allowed: an existing docker image tag

Example

aws-lambda-ci \
--app-s3-bucket "kodhive-prd-useast1-ippan-core-artifacts" \
--function-name "useast1-mimoto-api-v1-codeless" \
--function-runtime "python3.11" \
--function-alias-name "latest" \
--function-layer-name "useast1-mimoto-api-v1-codeless-deps" \
--app-src-path "app/api/src" \
--app-packages-descriptor-path "app/api/src/requirements/lambda.txt" \
--source-version "1.0.1" \
--aws-profile-name "kodhive_prd" \
--watch-log-stream \
--build-docker-repo public.ecr.aws/sam/build-python3.11 \
--build-docker-image latest

Demos

Code and dependencies changes

If both code and dependencies changed, the pipeline will publish both changes.

https://github.com/obytes/aws-lambda-ci/raw/main/docs/images/demo_code_changed_deps_changed.gif

Just code changed

If code changed but not dependencies, the pipeline with publish new code and the dependencies will be left intact.

https://github.com/obytes/aws-lambda-ci/raw/main/docs/images/demo_just_code_changed.gif

Nothing changed

If both code and dependencies not changed, the pipeline will not publish anything.

https://github.com/obytes/aws-lambda-ci/raw/main/docs/images/demo_nothing_changed.gif

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aws_lambda_ci-0.0.8.tar.gz (12.7 kB view details)

Uploaded Source

Built Distribution

aws_lambda_ci-0.0.8-py3-none-any.whl (13.0 kB view details)

Uploaded Python 3

File details

Details for the file aws_lambda_ci-0.0.8.tar.gz.

File metadata

  • Download URL: aws_lambda_ci-0.0.8.tar.gz
  • Upload date:
  • Size: 12.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for aws_lambda_ci-0.0.8.tar.gz
Algorithm Hash digest
SHA256 9d21b81ead75630cf0b4696266b0cd503762fb8911b12f2a263daf60a7f0f425
MD5 dc353d645e6a6824486a87276c932753
BLAKE2b-256 a5cbd75698d4c444f5763e5a6bf8cabf776f22a12d702e527ef70d947df36f4f

See more details on using hashes here.

File details

Details for the file aws_lambda_ci-0.0.8-py3-none-any.whl.

File metadata

File hashes

Hashes for aws_lambda_ci-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 10fc9ca132cbd35a816d765650b6dbb5affc8d60f823bebf537662b0b38c9df3
MD5 7c65837b635db494667c4bc576ec09b0
BLAKE2b-256 ac8ff2fe0bb0def36ae936d591d6b74b7f6b015f823b938e20bb778a836e6106

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page