Serverless WSGI With AWS Lambda + API Gateway
Project description
.. raw:: html
<p align="center">
.. raw:: html
</p>
Zappa - Serverless Python Web Services
======================================
|Build Status| |Coverage| |Requirements Status| |PyPI| |Slack|
.. raw:: html
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
.. raw:: html
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
- `About <#about>`__
- `Installation and Configuration <#installation-and-configuration>`__
- `Running the Initial Setup /
Settings <#running-the-initial-setup--settings>`__
- `Basic Usage <#basic-usage>`__
- `Initial Deployments <#initial-deployments>`__
- `Updates <#updates>`__
- `Rollback <#rollback>`__
- `Scheduling <#scheduling>`__
- `Executing in Response to AWS
Events <#executing-in-response-to-aws-events>`__
- `Undeploy <#undeploy>`__
- `Status <#status>`__
- `Tailing Logs <#tailing-logs>`__
- `Remote Function Invocation <#remote-function-invocation>`__
- `Django Management Commands <#django-management-commands>`__
- `Let's Encrypt SSL Domain Certification and
Installation <#lets-encrypt-ssl-domain-certification-and-installation>`__
- `Advanced Settings <#advanced-settings>`__
- `Advanced Usage <#advanced-usage>`__
- `Keeping The Server Warm <#keeping-the-server-warm>`__
- `Serving Static Files / Binary
Uploads <#serving-static-files--binary-uploads>`__
- `Enabling CORS <#enabling-cors>`__
- `Enabling Secure Endpoints on API Gateway (API
Key) <#enabling-secure-endpoints-on-api-gateway-api-key>`__
- `Enabling Secure Endpoints on API Gateway (IAM
Policy) <#enabling-secure-endpoints-on-api-gateway-iam-policy>`__
- `Deploying to a Domain With a Let's Encrypt Certificate (DNS
Auth) <#deploying-to-a-domain-with-a-lets-encrypt-certificate-dns-auth>`__
- `Deploying to a Domain With a Let's Encrypt Certificate (HTTP
Auth) <#deploying-to-a-domain-with-a-lets-encrypt-certificate-http-auth>`__
- `Setting Environment Variables <#setting-environment-variables>`__
- `Local Environment Variables <#local-environment-variables>`__
- `Remote Environment Variables <#remote-environment-variables>`__
- `Setting Integration Content-Type
Aliases <#setting-integration-content-type-aliases>`__
- `Catching Unhandled Exceptions <#catching-unhandled-exceptions>`__
- `Using Custom AWS IAM Roles and
Policies <#using-custom-aws-iam-roles-and-policies>`__
- `Zappa Guides <#zappa-guides>`__
- `Zappa in the Press <#zappa-in-the-press>`__
- `Sites Using Zappa <#sites-using-zappa>`__
- `Related Projects <#related-projects>`__
- `Hacks <#hacks>`__
- `Contributing <#contributing>`__
- `Using a Local Repo <#using-a-local-repo>`__
- `Support / Development / Training /
Consulting <#support--development--training--consulting>`__
.. raw:: html
<!-- END doctoc generated TOC please keep comment here to allow auto update -->
About
=====
.. raw:: html
<p align="center">
.. raw:: html
</p>
.. raw:: html
<p align="center">
In a hurry? Click to see slides from Serverless SF!
.. raw:: html
</p>
**Zappa** makes it super easy to deploy all Python WSGI applications on
AWS Lambda + API Gateway. Think of it as "serverless" web hosting for
your Python web apps. That means **infinite scaling**, **zero
downtime**, **zero maintenance** - and at a fraction of the cost of your
current deployments!
If you've got a Python web app (including Django and Flask apps), it's
as easy as:
::
$ pip install zappa
$ zappa init
$ zappa deploy
and now you're server-less! *Wow!*
What do you mean "serverless"?
Okay, so there still is a server - but it only has a *40 millisecond*
life cycle! Serverless in this case means **"without any permanent
infrastucture."**
With a traditional HTTP server, the server is online 24/7, processing
requests one by one as they come in. If the queue of incoming requests
grows too large, some requests will time out. With Zappa, **each request
is given its own virtual HTTP "server"** by Amazon API Gateway. AWS
handles the horizontal scaling automatically, so no requests ever time
out. Each request then calls your application from a memory cache in AWS
Lambda and returns the response via Python's WSGI interface. After your
app returns, the "server" dies.
Better still, with Zappa you only pay for the milliseconds of server
time that you use, so it's many **orders of magnitude cheaper** than
VPS/PaaS hosts like Linode or Heroku - and in most cases, it's
completely free. Plus, there's no need to worry about load balancing or
keeping servers online ever again.
It's great for deploying serverless microservices with frameworks like
Flask and Bottle, and for hosting larger web apps and CMSes with Django.
Or, you can use any WSGI-compatible app you like! You **probably don't
need to change your existing applications** to use it, and you're not
locked into using it.
And finally, Zappa is **super easy to use**. You can deploy your
application with a single command out of the box.
**Awesome!**
.. raw:: html
<p align="center">
.. raw:: html
</p>
Installation and Configuration
==============================
*Before you begin, make sure you have a valid AWS account and your `AWS
credentials
file <https://blogs.aws.amazon.com/security/post/Tx3D6U6WSFGOK2H/A-New-and-Standardized-Way-to-Manage-Credentials-in-the-AWS-SDKs>`__
is properly installed.*
**Zappa** can easily be installed through pip, like so:
::
$ pip install zappa
Please note that Zappa ***must*** be installed into your project's
`virtual
environment <http://docs.python-guide.org/en/latest/dev/virtualenvs/>`__.
*(If you use `pyenv <https://github.com/yyuu/pyenv>`__ and love to
manage virtualenvs with **pyenv-virtualenv**, you just have to call
``pyenv local [your_venv_name]`` and it's ready.
`Conda <http://conda.pydata.org/docs/>`__ users should comment
`here <https://github.com/Miserlou/Zappa/pull/108>`__.)*
Next, you'll need to define your local and server-side settings.
Running the Initial Setup / Settings
------------------------------------
**Zappa** can automatically set up your deployment settings for you with
the ``init`` command:
::
$ zappa init
This will automatically detect your application type (Flask/Django -
Pyramid users `see
here <https://github.com/Miserlou/Zappa/issues/278#issuecomment-241917956>`__)
and help you define your deployment configuration settings. Once you
finish initialization, you'll have a file named *zappa\_settings.json*
in your project directory defining your basic deployment settings. It
will probably look something like this for most WSGI apps:
.. code:: javascript
{
"dev": { // The name of your environment
"s3_bucket": "lmbda", // The name of your S3 bucket
"app_function": "your_module.app" // The python path to your WSGI application function. In Flask, this is your 'app' object.
}
}
or for Django:
.. code:: javascript
{
"dev": { // The name of your environment
"s3_bucket": "lmbda", // The name of your S3 bucket
"django_settings": "your_project.settings" // The python path to your Django settings.
}
}
You can define as many environments as your like - we recommend having
*dev*, *staging*, and *production*.
Now, you're ready to deploy!
Basic Usage
===========
Initial Deployments
-------------------
Once your settings are configured, you can package and deploy your
application to an environment called "production" with a single command:
::
$ zappa deploy production
Deploying..
Your application is now live at: https://7k6anj0k99.execute-api.us-east-1.amazonaws.com/production
And now your app is **live!** How cool is that?!
To explain what's going on, when you call ``deploy``, Zappa will
automatically package up your application and local virtual environment
into a Lambda-compatible archive, replace any dependencies with versions
`precompiled for
Lambda <https://github.com/Miserlou/lambda-packages>`__, set up the
function handler and necessary WSGI Middleware, upload the archive to
S3, register it as a new Lambda function, create a new API Gateway
resource, create WSGI-compatible routes for it, link it to the new
Lambda function, and finally delete the archive from your S3 bucket.
Handy!
Updates
-------
If your application has already been deployed and you only need to
upload new Python code, but not touch the underlying routes, you can
simply:
::
$ zappa update production
Updating..
Your application is now live at: https://7k6anj0k99.execute-api.us-east-1.amazonaws.com/production
This creates a new archive, uploads it to S3 and updates the Lambda
function to use the new code, but doesn't touch the API Gateway routes.
Rollback
--------
You can also ``rollback`` the deployed code to a previous version by
supplying the number of revisions to return to. For instance, to
rollback to the version deployed 3 versions ago:
::
$ zappa rollback production -n 3
Scheduling
----------
Zappa can be used to easily schedule functions to occur on regular
intervals. This provides a much nicer, maintenance-free alternative to
Celery! These functions will be packaged and deployed along with your
``app_function`` and called from the handler automatically. Just list
your functions and the expression to schedule them using `cron or rate
syntax <http://docs.aws.amazon.com/lambda/latest/dg/tutorial-scheduled-events-schedule-expressions.html>`__
in your *zappa\_settings.json* file:
.. code:: javascript
{
"production": {
...
"events": [{
"function": "your_module.your_function", // The function to execute
"expression": "rate(1 minute)" // When to execute it (in cron or rate format)
}],
...
}
}
And then:
::
$ zappa schedule production
And now your function will execute every minute!
If you want to cancel these, you can simply use the ``unschedule``
command:
::
$ zappa unschedule production
And now your scheduled event rules are deleted.
See the `example <example/>`__ for more details.
Executing in Response to AWS Events
-----------------------------------
Similarly, you can have your functions execute in response to events
that happen in the AWS ecosystem, such as S3 uploads, DynamoDB entries,
Kinesis streams, and SNS messages.
In your *zappa\_settings.json* file, define your `event
sources <http://docs.aws.amazon.com/lambda/latest/dg/invoking-lambda-function.html>`__
and the function you wish to execute. For instance, this will execute
``your_module.your_function`` in response to new objects in your
``my-bucket`` S3 bucket. Note that ``your_function`` must accept
``event`` and ``context`` paramaters.
.. code:: javascript
{
"production": {
...
"events": [{
"function": "your_module.your_function",
"event_source": {
"arn": "arn:aws:s3:::my-bucket",
"events": [
"s3:ObjectCreated:*"
]
}
}],
...
}
}
And then:
::
$ zappa schedule production
And now your function will execute every time a new upload appears in
your bucket!
Similarly, for a `Simple Notification
Service <https://aws.amazon.com/sns/>`__ event:
.. code:: javascript
"events": [
{
"function": "your_module.your_function",
"event_source": {
"arn": "arn:aws:sns:::your-event-topic-arn",
"events": [
"sns:Publish"
]
}
}
]
Undeploy
--------
If you need to remove the API Gateway and Lambda function that you have
previously published, you can simply:
::
$ zappa undeploy production
You will be asked for confirmation before it executes.
If you enabled CloudWatch Logs for your API Gateway service and you
don't want to keep those logs, you can specify the ``--remove-logs``
argument to purge the logs for your API Gateway and your Lambda
function:
::
$ zappa undeploy production --remove-logs
Status
------
If you need to see the status of your deployment and event schedules,
simply use the ``status`` command.
::
$ zappa status production
Tailing Logs
------------
You can watch the logs of a deployment by calling the ``tail``
management command.
::
$ zappa tail production
Remote Function Invocation
--------------------------
You can execute any function in your application directly at any time by
using the ``invoke`` command.
For instance, suppose you have a basic application in a file called
"my\_app.py", and you want to invoke a function in it called
"my\_function". Once your application is deployed, you can invoke that
function at any time by calling:
::
$ zappa invoke production 'my_app.my_function'
Any remote print statements made and the value the function returned
will then be printed to your local console. **Nifty!**
Django Management Commands
--------------------------
As a convenience, Zappa can also invoke remote Django 'manage.py'
commands with the ``manage`` command. For instance, to perform the basic
Django status check:
::
$ zappa manage production check
Obviously, this only works for Django projects which have their settings
properly defined. *(Please note that commands which take over 30 seconds
to execute may time-out. See `this related
issue <https://github.com/Miserlou/Zappa/issues/205#issuecomment-236391248>`__
for a work-around.)*
Let's Encrypt SSL Domain Certification and Installation
-------------------------------------------------------
If you want to use Zappa applications on a custom domain or subdomain,
you'll need to supply a valid SSL certificate. Fortunately for you,
Zappa can automatically create and install free valid SSL certificates
using Let's Encrypt!
If your domain is located within an AWS Route 53 Hosted Zone and you've
defined ``domain`` and ``lets_encrypt_key`` (ex:
``openssl genrsa 2048 > account.key``) settings, all you need to do is:
::
$ zappa certify production
And your domain will be verified, certified and registered!
*(Please note that this can take around 45 minutes to take effect the
first time your run the command, and around 60 seconds every time after
that.)*
More detailed instructions are available `in this handy
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_dns.md>`__.
Advanced Settings
=================
There are other settings that you can define in your local settings to
change Zappa's behavior. Use these at your own risk!
.. code:: javascript
{
"dev": {
"api_key_required": false, // enable securing API Gateway endpoints with x-api-key header (default False)
"api_key": "your_api_key_id" // optional, use an existing API key. The option "api_key_required" must be true to apply
"assume_policy": "my_assume_policy.json", // optional, IAM assume policy JSON file
"attach_policy": "my_attach_policy.json", // optional, IAM attach policy JSON file
"authorization_type": "AWS_IAM", // optional, use IAM to require request signing. Defaults to "NONE".
"aws_region": "us-east-1", // AWS Region (default US East),
"callbacks": { // Call custom functions during the local Zappa deployment/update process
"settings": "my_app.settings_callback", // After loading the settings
"zip": "my_app.zip_callback", // After creating the package
"post": "my_app.post_callback", // After command has excuted
},
"cache_cluster_enabled": false, // Use APIGW cache cluster (default False)
"cache_cluster_size": .5, // APIGW Cache Cluster size (default 0.5)
"cloudwatch_log_level": "OFF", // Enables/configures a level of logging for the given staging. Available options: "OFF", "INFO", "ERROR", default "OFF".
"cloudwatch_data_trace": false, // Logs all data about received events.
"cloudwatch_metrics_enabled": false, // Additional metrics for the API Gateway.
"debug": true, // Print Zappa configuration errors tracebacks in the 500
"delete_local_zip": true, // Delete the local zip archive after code updates
"delete_s3_zip": true, // Delete the s3 zip archive
"django_settings": "your_project.production_settings", // The modular path to your Django project's settings. For Django projects only.
"domain": "yourapp.yourdomain.com", // Required if you're using a domain
"environment_variables": {"your_key": "your_value"}, // A dictionary of environment variables that will be available to your deployed app. See also "remote_env_file". Default {}.
"events": [
{ // Recurring events
"function": "your_module.your_recurring_function", // The function to execute
"expression": "rate(1 minute)" // When to execute it (in cron or rate format)
},
{ // AWS Reactive events
"function": "your_module.your_reactive_function", // The function to execute
"event_source": {
"arn": "arn:aws:s3:::my-bucket", // The ARN of this event source
"events": [
"s3:ObjectCreated:*" // The specific event to execute in response to.
]
}
}
],
"exception_handler": "your_module.report_exception", // function that will be invoked in case Zappa sees an unhandled exception raised from your code
"exclude": ["*.gz", "*.rar"], // A list of regex patterns to exclude from the archive
"http_methods": ["GET", "POST"], // HTTP Methods to route,
"integration_response_codes": [200, 301, 404, 500], // Integration response status codes to route
"integration_content_type_aliases": { // For routing requests with non-standard mime types
"application/json": [
"application/vnd.webhooks+json"
]
},
"keep_warm": true, // Create CloudWatch events to keep the server warm.
"keep_warm_expression": "rate(4 minutes)", // How often to execute the keep-warm, in cron and rate format. Default 4 minutes.
"lambda_description": "Your Description", // However you want to describe your project for the AWS console. Default "Zappa Deployment".
"lambda_handler": "your_custom_handler", // The name of Lambda handler. Default: handler.lambda_handler
"lets_encrypt_key": "s3://your-bucket/account.key", // Let's Encrypt account key path. Can either be an S3 path or a local file path.
"lets_encrypt_schedule": "rate(15 days)" // How often to auto-renew Let's Encrypt certificate on the server. Must be set to enable autorenewing, rate or cron syntax.
"log_level": "DEBUG", // Set the Zappa log level. Default INFO, can be one of CRITICAL, ERROR, WARNING, INFO and DEBUG.
"manage_roles": true, // Have Zappa automatically create and define IAM execution roles and policies. Default true. If false, you must define your own IAM Role and role_name setting.
"memory_size": 512, // Lambda function memory in MB
"method_header_types": [ // Which headers to include in the API response. Defaults:
"Content-Type",
"Location",
"Status",
"X-Frame-Options",
"Set-Cookie"
],
"method_response_codes": [200, 301, 404, 500], // Method response status codes to route
"parameter_depth": 10, // Size of URL depth to route. Defaults to 8.
"prebuild_script": "your_module.your_function", // Function to execute before uploading code
"profile_name": "your-profile-name", // AWS profile credentials to use. Default 'default'.
"project_name": "MyProject", // The name of the project as it appears on AWS. Defaults to a slugified `pwd`.
"remote_env_bucket": "my-project-config-files", // optional s3 bucket where remote_env_file can be located.
"remote_env_file": "filename.json", // file in remote_env_bucket containing a flat json object which will be used to set custom environment variables.
"role_name": "MyLambdaRole", // Name of Zappa execution role. Default ZappaExecutionRole. To use a different, pre-existing policy, you must also set manage_roles to false.
"s3_bucket": "dev-bucket", // Zappa zip bucket,
"settings_file": "~/Projects/MyApp/settings/dev_settings.py", // Server side settings file location,
"timeout_seconds": 30, // Maximum lifespan for the Lambda function (default 30, max 300.)
"touch": false, // GET the production URL upon initial deployment (default True)
"use_precompiled_packages": false, // If possible, use C-extension packages which have been pre-compiled for AWS Lambda
"use_apigateway": true, // Set to false if you don't want to create API Gateway resource. Default true
"vpc_config": { // Optional VPC configuration for Lambda function
"SubnetIds": [ "subnet-12345678" ], // Note: not all availability zones support Lambda!
"SecurityGroupIds": [ "sg-12345678" ]
}
}
}
Advanced Usage
==============
Keeping The Server Warm
-----------------------
Zappa will automatically set up a regularly occuring execution of your
application in order to keep the Lambda function warm. This can be
disabled via the 'keep\_warm' setting.
Serving Static Files / Binary Uploads
-------------------------------------
Zappa is for running your application code, not for serving static web
assets. If you plan on serving custom static assets in your web
application (CSS/JavaScript/images/etc.,), you'll likely want to use a
combination of AWS S3 and AWS CloudFront.
Your web application framework will likely be able to handle this for
you automatically. For Flask, there is
`Flask-S3 <https://github.com/e-dard/flask-s3>`__, and for Django, there
is
`Django-Storages <https://django-storages.readthedocs.io/en/latest/>`__.
Similarly, you will not be able to accept binary multi-part uploads
through the API Gateway. Instead, you should design your application so
that binary uploads go `directly to
S3 <http://docs.aws.amazon.com/AWSJavaScriptSDK/guide/browser-examples.html#Uploading_a_local_file_using_the_File_API>`__,
which then triggers an event response defined in your ``events``
setting! That's thinking serverlessly!
Enabling CORS
-------------
To enable Cross-Origin Resource Sharing (CORS) for your application,
follow the `AWS "How to CORS"
Guide <https://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-cors.html>`__
to enable CORS via the API Gateway Console. Don't forget to enable CORS
per parameter and re-deploy your API after making the changes!
You can also simply handle CORS directly in your application. If you do
this, you'll need to add ``Access-Control-Allow-Origin``,
``Access-Control-Allow-Headers``, and ``Access-Control-Allow-Methods``
to the ``method_header_types`` key in your ``zappa_settings.json``. See
further `discussion
here <https://github.com/Miserlou/Zappa/issues/41>`__.
Enabling Secure Endpoints on API Gateway (API Key)
--------------------------------------------------
You can use the ``api_key_required`` setting to generate and assign an
API key to all the routes of your API Gateway. After redeployment, you
can then pass the provided key as a header called ``x-api-key`` to
access the restricted endpoints. Without the ``x-api-key`` header, you
will receive a 403. `More information on API keys in the API
Gateway <http://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-api-keys.html>`__
Enabling Secure Endpoints on API Gateway (IAM Policy)
-----------------------------------------------------
You can enable IAM-based (v4 signing) authorization on an API by setting
the ``authorization_type`` setting to ``AWS_IAM``. Your API will then
require signed requests and access can be controlled via `IAM
policy <https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-iam-policy-examples.html>`__.
Unsigned requests will receive a 403 response, as will requesters who
are not authorized to access the API.
Deploying to a Domain With a Let's Encrypt Certificate (DNS Auth)
-----------------------------------------------------------------
If you want to use Zappa on a domain with a free Let's Encrypt
certificate using automatic Route 53 based DNS Authentication, you can
follow `this handy
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_dns.md>`__.
Deploying to a Domain With a Let's Encrypt Certificate (HTTP Auth)
------------------------------------------------------------------
If you want to use Zappa on a domain with a free Let's Encrypt
certificate using HTTP Authentication, you can follow `this
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_http.md>`__.
However, it's now far easier to use Route 53-based DNS authentication,
which will allow you to use a Let's Encrypt certificate with a single
``$ zappa certify`` command.
Setting Environment Variables
-----------------------------
Local Environment Variables
~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you want to set local remote environment variables for a deployment
stage, you can simply set them in your ``zappa_settings.json``:
.. code:: javascript
{
"dev": {
...
"environment_variables": {
"your_key": "your_value"
}
},
...
}
You can then access these inside your application with:
.. code:: python
import os
your_value = os.environ.get('your_key')
If your project needs to be aware of the type of environment you're
deployed to, you'll also be able to get ``SERVERTYPE`` (AWS Lambda),
``FRAMEWORK`` (Zappa), ``PROJECT`` (your project name) and ``STAGE``
(*dev*, *production*, etc.) variables at any time.
Remote Environment Variables
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you want to use remote environment variables to configure your
application (which is especially useful for things like sensitive
credentials), you can create a file and place it in an S3 bucket to
which your Zappa application has access to. To do this, add the
``remote_env_bucket`` and ``remote_env_file`` keys to zappa\_settings
pointing to a file containing a flat JSON object, so that each key-value
pair on the object will be set as an environment variable and value
whenever a new lambda instance spins up.
For example, to ensure your application has access to the database
credentials without storing them in your version control, you can add a
file to S3 with the connection string and load it into the lambda
environment using the ``remote_env_bucket`` and ``remote_env_file``
configuration settings.
super-secret-config.json (uploaded to my-config-bucket):
.. code:: javascript
{
"DB_CONNECTION_STRING": "super-secret:database"
}
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"remote_env_bucket": "my-config-bucket",
"remote_env_file": "super-secret-config.json"
},
...
}
Now in your application you can use:
.. code:: python
import os
db_string = os.environ('DB_CONNECTION_STRING')
Setting Integration Content-Type Aliases
----------------------------------------
By default, Zappa will only route the following MIME-types that are set
explicitly via ``Content-Type`` header: ``application/json``,
``application/x-www-form-urlencoded``, and ``multipart/form-data`` (if
the Content-Type header isn't set, ``application/json`` will be the
default). If a request comes in with ``Content-Type`` header set to
anything but those 3 values, Amazon will return a 415 status code and a
``MIME type not supported`` message. If there is a need to support
custom MIME-types (e.g. when a third-party making requests to your API)
you can specify aliases for the 3 default types:
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"integration_content_type_aliases": {
"application/json": ["application/vnd.webhooks+json"]
}
},
...
}
Now Zappa will use ``application/json``'s template to route requests
with MIME-type of ``application/vnd.webhooks+json``. You will need to
re-deploy your application for this change to take affect.
Catching Unhandled Exceptions
-----------------------------
By default, if an *unhandled* exception happens in your code, Zappa will
just print the stacktrace into a CloudWatch log. If you wish to use an
external reporting tool to take note of those exceptions, you can use
the ``exception_handler`` configuration option.
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"exception_handler": "your_module.unhandled_exceptions",
},
...
}
The function has to accept three arguments: exception, event, and
context:
your\_module.py
.. code:: python
def unhandled_exception(e, event, context):
send_to_raygun(e, event) # gather data you need and send
return True # Prevent invocation retry
You may still need a similar exception handler inside your application,
this is just a way to catch exception which happen at the Zappa/WSGI
layer (typically event-based invocations, misconfigured settings, bad
Lambda packages, and permissions issues).
By default, AWS Lambda will attempt to retry an event based (non-API
Gateway, e.g. CloudWatch) invocation if an exception has been thrown.
However, you can prevent this by returning True, as in example above, so
Zappa that will not re-raise the uncaught exception, thus preventing AWS
Lambda from retrying the current invocation.
Using Custom AWS IAM Roles and Policies
---------------------------------------
By default, the Zappa client will create and manage the necessary IAM
policies and roles to deploy and execute Zappa applications. However, if
you're using Zappa in a corporate environment or as part of a continuous
integration, you may instead want to manually manage your policies
instead.
To manually define the permissions policy of your Zappa execution role,
you must define the following in your *zappa\_settings.json*:
.. code:: javascript
{
"dev": {
...
"manage_roles": false, // Disable Zappa client managing roles.
"role_name": "MyLambdaRole", // Name of your Zappa execution role. Default ZappaExecutionRole.
...
},
...
}
Ongoing discussion about the minimum policy requirements necessary for a
Zappa deployment `can be found
here <https://github.com/Miserlou/Zappa/issues/244>`__.
Zappa Guides
============
- `Django-Zappa tutorial
screencast <https://www.youtube.com/watch?v=plUrbPN0xc8&feature=youtu.be>`__.
- `Using Django-Zappa, Part
1 <https://serverlesscode.com/post/zappa-wsgi-for-python/>`__.
- `Using Django-Zappa, Part 2:
VPCs <https://serverlesscode.com/post/zappa-wsgi-for-python-pt-2/>`__.
- `Building Serverless Microservices with Zappa and
Flask <https://gun.io/blog/serverless-microservices-with-zappa-and-flask/>`__
- `Zappa で Hello World するまで
(Japanese) <http://qiita.com/satoshi_iwashita/items/505492193317819772c7>`__
- *Your guide here?*
Zappa in the Press
==================
- *`Zappa Serves Python, Minus the
Servers <http://www.infoworld.com/article/3031665/application-development/zappa-serves-python-web-apps-minus-the-servers.html>`__*
- *`Zappa lyfter serverlösa applikationer med
Python <http://computersweden.idg.se/2.2683/1.649895/zappa-lyfter-python>`__*
- *`Interview: Rich Jones on
Zappa <https://serverlesscode.com/post/rich-jones-interview-django-zappa/>`__*
Sites Using Zappa
=================
- `Zappa.io <https://www.zappa.io>`__ - A simple Zappa homepage
- `Mailchimp Signup
Utility <https://github.com/sasha42/Mailchimp-utility>`__ - A
microservice for adding people to a mailing list via API.
- `Zappa Slack
Inviter <https://github.com/Miserlou/zappa-slack-inviter>`__ - A
tiny, server-less service for inviting new users to your Slack
channel.
- `Serverless Image
Host <https://github.com/Miserlou/serverless-imagehost>`__ - A
thumbnailing service with Flask, Zappa and Pillow.
- `Gigger <https://www.gigger.rocks/>`__ - The live music industry's
search engine
- And many more!
Are you using Zappa? Let us know and we'll list your site here!
Related Projects
================
- `lambda-packages <http://github.com/Miserlou/lambda-packages>`__ -
Precompiled C-extention packages for AWS Lambda. Used automatically
by Zappa.
- `zappa-cms <http://github.com/Miserlou/zappa-cms>`__ - A tiny
server-less CMS for busy hackers. Work in progress.
- `flask-ask <https://github.com/johnwheeler/flask-ask>`__ - A
framework for building Amazon Alexa applications. Uses Zappa for
deployments.
- `zappa-file-widget <https://github.com/anush0247/zappa-file-widget>`__
- A Django plugin for supporting binary file uploads in Django on
Zappa.
- `zops <https://github.com/bjinwright/zops>`__ - Utilities for teams
and continuous integrations using Zappa.
Hacks
=====
Zappa goes quite far beyond what Lambda and API Gateway were ever
intended to handle. As a result, there are quite a few hacks in here
that allow it to work. Some of those include, but aren't limited to..
- Using VTL to map body, headers, method, params and query strings into
JSON, and then turning that into valid WSGI.
- Attaching response codes to response bodies, Base64 encoding the
whole thing, using that as a regex to route the response code,
decoding the body in VTL, and mapping the response body to that.
- Packing and *Base58* encoding multiple cookies into a single cookie
because we can only map one kind.
- Turning cookie-setting 301/302 responses into 200 responses with HTML
redirects, because we have no way to set headers on redirects.
Contributing
============
This project is still young, so there is still plenty to be done.
Contributions are more than welcome!
Please file tickets for discussion before submitting patches, and submit
your patches to the "dev" branch if possible. If dev falls behind
master, feel free to rebase.
If you are adding a non-trivial amount of new code, please include a
functioning test in your PR. For AWS calls, we use the placebo library,
which you can learn to use `in the test writing
guide <docs/README.md>`__.
Please also write comments along with your new code, including the URL
of the ticket which you filed along with the PR. This greatly helps for
project maintainability, as it allows us to trace back use cases and
explain decision making.
Using a Local Repo
------------------
To use the git HEAD, you *can't* use ``pip install -e``. Instead, you
should clone the repo to your machine and then
``pip install /path/to/zappa/repo`` or
``ln -s /path/to/zappa/repo/zappa zappa`` in your local project.
Support / Development / Training / Consulting
=============================================
Do you need help with..
- Porting existing Flask and Django applications to Zappa?
- Building new applications and services that scale infinitely?
- Reducing your operations and hosting costs?
- Adding new custom features into Zappa?
- Training your team to use AWS and other server-less paradigms?
Good news! We're currently available for remote and on-site consulting
for small, large and enterprise teams. Please contact miserlou@gmail.com
with your needs and let's work together!
.. raw:: html
<p align="center">
.. raw:: html
</p>
.. |Build Status| image:: https://travis-ci.org/Miserlou/Zappa.svg
:target: https://travis-ci.org/Miserlou/Zappa
.. |Coverage| image:: https://img.shields.io/coveralls/Miserlou/Zappa.svg
:target: https://coveralls.io/github/Miserlou/Zappa
.. |Requirements Status| image:: https://requires.io/github/Miserlou/Zappa/requirements.svg?branch=master
:target: https://requires.io/github/Miserlou/Zappa/requirements/?branch=master
.. |PyPI| image:: https://img.shields.io/pypi/v/Zappa.svg
:target: https://pypi.python.org/pypi/zappa
.. |Slack| image:: https://img.shields.io/badge/chat-slack-ff69b4.svg
:target: https://slack.zappa.io/
<p align="center">
.. raw:: html
</p>
Zappa - Serverless Python Web Services
======================================
|Build Status| |Coverage| |Requirements Status| |PyPI| |Slack|
.. raw:: html
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
.. raw:: html
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
- `About <#about>`__
- `Installation and Configuration <#installation-and-configuration>`__
- `Running the Initial Setup /
Settings <#running-the-initial-setup--settings>`__
- `Basic Usage <#basic-usage>`__
- `Initial Deployments <#initial-deployments>`__
- `Updates <#updates>`__
- `Rollback <#rollback>`__
- `Scheduling <#scheduling>`__
- `Executing in Response to AWS
Events <#executing-in-response-to-aws-events>`__
- `Undeploy <#undeploy>`__
- `Status <#status>`__
- `Tailing Logs <#tailing-logs>`__
- `Remote Function Invocation <#remote-function-invocation>`__
- `Django Management Commands <#django-management-commands>`__
- `Let's Encrypt SSL Domain Certification and
Installation <#lets-encrypt-ssl-domain-certification-and-installation>`__
- `Advanced Settings <#advanced-settings>`__
- `Advanced Usage <#advanced-usage>`__
- `Keeping The Server Warm <#keeping-the-server-warm>`__
- `Serving Static Files / Binary
Uploads <#serving-static-files--binary-uploads>`__
- `Enabling CORS <#enabling-cors>`__
- `Enabling Secure Endpoints on API Gateway (API
Key) <#enabling-secure-endpoints-on-api-gateway-api-key>`__
- `Enabling Secure Endpoints on API Gateway (IAM
Policy) <#enabling-secure-endpoints-on-api-gateway-iam-policy>`__
- `Deploying to a Domain With a Let's Encrypt Certificate (DNS
Auth) <#deploying-to-a-domain-with-a-lets-encrypt-certificate-dns-auth>`__
- `Deploying to a Domain With a Let's Encrypt Certificate (HTTP
Auth) <#deploying-to-a-domain-with-a-lets-encrypt-certificate-http-auth>`__
- `Setting Environment Variables <#setting-environment-variables>`__
- `Local Environment Variables <#local-environment-variables>`__
- `Remote Environment Variables <#remote-environment-variables>`__
- `Setting Integration Content-Type
Aliases <#setting-integration-content-type-aliases>`__
- `Catching Unhandled Exceptions <#catching-unhandled-exceptions>`__
- `Using Custom AWS IAM Roles and
Policies <#using-custom-aws-iam-roles-and-policies>`__
- `Zappa Guides <#zappa-guides>`__
- `Zappa in the Press <#zappa-in-the-press>`__
- `Sites Using Zappa <#sites-using-zappa>`__
- `Related Projects <#related-projects>`__
- `Hacks <#hacks>`__
- `Contributing <#contributing>`__
- `Using a Local Repo <#using-a-local-repo>`__
- `Support / Development / Training /
Consulting <#support--development--training--consulting>`__
.. raw:: html
<!-- END doctoc generated TOC please keep comment here to allow auto update -->
About
=====
.. raw:: html
<p align="center">
.. raw:: html
</p>
.. raw:: html
<p align="center">
In a hurry? Click to see slides from Serverless SF!
.. raw:: html
</p>
**Zappa** makes it super easy to deploy all Python WSGI applications on
AWS Lambda + API Gateway. Think of it as "serverless" web hosting for
your Python web apps. That means **infinite scaling**, **zero
downtime**, **zero maintenance** - and at a fraction of the cost of your
current deployments!
If you've got a Python web app (including Django and Flask apps), it's
as easy as:
::
$ pip install zappa
$ zappa init
$ zappa deploy
and now you're server-less! *Wow!*
What do you mean "serverless"?
Okay, so there still is a server - but it only has a *40 millisecond*
life cycle! Serverless in this case means **"without any permanent
infrastucture."**
With a traditional HTTP server, the server is online 24/7, processing
requests one by one as they come in. If the queue of incoming requests
grows too large, some requests will time out. With Zappa, **each request
is given its own virtual HTTP "server"** by Amazon API Gateway. AWS
handles the horizontal scaling automatically, so no requests ever time
out. Each request then calls your application from a memory cache in AWS
Lambda and returns the response via Python's WSGI interface. After your
app returns, the "server" dies.
Better still, with Zappa you only pay for the milliseconds of server
time that you use, so it's many **orders of magnitude cheaper** than
VPS/PaaS hosts like Linode or Heroku - and in most cases, it's
completely free. Plus, there's no need to worry about load balancing or
keeping servers online ever again.
It's great for deploying serverless microservices with frameworks like
Flask and Bottle, and for hosting larger web apps and CMSes with Django.
Or, you can use any WSGI-compatible app you like! You **probably don't
need to change your existing applications** to use it, and you're not
locked into using it.
And finally, Zappa is **super easy to use**. You can deploy your
application with a single command out of the box.
**Awesome!**
.. raw:: html
<p align="center">
.. raw:: html
</p>
Installation and Configuration
==============================
*Before you begin, make sure you have a valid AWS account and your `AWS
credentials
file <https://blogs.aws.amazon.com/security/post/Tx3D6U6WSFGOK2H/A-New-and-Standardized-Way-to-Manage-Credentials-in-the-AWS-SDKs>`__
is properly installed.*
**Zappa** can easily be installed through pip, like so:
::
$ pip install zappa
Please note that Zappa ***must*** be installed into your project's
`virtual
environment <http://docs.python-guide.org/en/latest/dev/virtualenvs/>`__.
*(If you use `pyenv <https://github.com/yyuu/pyenv>`__ and love to
manage virtualenvs with **pyenv-virtualenv**, you just have to call
``pyenv local [your_venv_name]`` and it's ready.
`Conda <http://conda.pydata.org/docs/>`__ users should comment
`here <https://github.com/Miserlou/Zappa/pull/108>`__.)*
Next, you'll need to define your local and server-side settings.
Running the Initial Setup / Settings
------------------------------------
**Zappa** can automatically set up your deployment settings for you with
the ``init`` command:
::
$ zappa init
This will automatically detect your application type (Flask/Django -
Pyramid users `see
here <https://github.com/Miserlou/Zappa/issues/278#issuecomment-241917956>`__)
and help you define your deployment configuration settings. Once you
finish initialization, you'll have a file named *zappa\_settings.json*
in your project directory defining your basic deployment settings. It
will probably look something like this for most WSGI apps:
.. code:: javascript
{
"dev": { // The name of your environment
"s3_bucket": "lmbda", // The name of your S3 bucket
"app_function": "your_module.app" // The python path to your WSGI application function. In Flask, this is your 'app' object.
}
}
or for Django:
.. code:: javascript
{
"dev": { // The name of your environment
"s3_bucket": "lmbda", // The name of your S3 bucket
"django_settings": "your_project.settings" // The python path to your Django settings.
}
}
You can define as many environments as your like - we recommend having
*dev*, *staging*, and *production*.
Now, you're ready to deploy!
Basic Usage
===========
Initial Deployments
-------------------
Once your settings are configured, you can package and deploy your
application to an environment called "production" with a single command:
::
$ zappa deploy production
Deploying..
Your application is now live at: https://7k6anj0k99.execute-api.us-east-1.amazonaws.com/production
And now your app is **live!** How cool is that?!
To explain what's going on, when you call ``deploy``, Zappa will
automatically package up your application and local virtual environment
into a Lambda-compatible archive, replace any dependencies with versions
`precompiled for
Lambda <https://github.com/Miserlou/lambda-packages>`__, set up the
function handler and necessary WSGI Middleware, upload the archive to
S3, register it as a new Lambda function, create a new API Gateway
resource, create WSGI-compatible routes for it, link it to the new
Lambda function, and finally delete the archive from your S3 bucket.
Handy!
Updates
-------
If your application has already been deployed and you only need to
upload new Python code, but not touch the underlying routes, you can
simply:
::
$ zappa update production
Updating..
Your application is now live at: https://7k6anj0k99.execute-api.us-east-1.amazonaws.com/production
This creates a new archive, uploads it to S3 and updates the Lambda
function to use the new code, but doesn't touch the API Gateway routes.
Rollback
--------
You can also ``rollback`` the deployed code to a previous version by
supplying the number of revisions to return to. For instance, to
rollback to the version deployed 3 versions ago:
::
$ zappa rollback production -n 3
Scheduling
----------
Zappa can be used to easily schedule functions to occur on regular
intervals. This provides a much nicer, maintenance-free alternative to
Celery! These functions will be packaged and deployed along with your
``app_function`` and called from the handler automatically. Just list
your functions and the expression to schedule them using `cron or rate
syntax <http://docs.aws.amazon.com/lambda/latest/dg/tutorial-scheduled-events-schedule-expressions.html>`__
in your *zappa\_settings.json* file:
.. code:: javascript
{
"production": {
...
"events": [{
"function": "your_module.your_function", // The function to execute
"expression": "rate(1 minute)" // When to execute it (in cron or rate format)
}],
...
}
}
And then:
::
$ zappa schedule production
And now your function will execute every minute!
If you want to cancel these, you can simply use the ``unschedule``
command:
::
$ zappa unschedule production
And now your scheduled event rules are deleted.
See the `example <example/>`__ for more details.
Executing in Response to AWS Events
-----------------------------------
Similarly, you can have your functions execute in response to events
that happen in the AWS ecosystem, such as S3 uploads, DynamoDB entries,
Kinesis streams, and SNS messages.
In your *zappa\_settings.json* file, define your `event
sources <http://docs.aws.amazon.com/lambda/latest/dg/invoking-lambda-function.html>`__
and the function you wish to execute. For instance, this will execute
``your_module.your_function`` in response to new objects in your
``my-bucket`` S3 bucket. Note that ``your_function`` must accept
``event`` and ``context`` paramaters.
.. code:: javascript
{
"production": {
...
"events": [{
"function": "your_module.your_function",
"event_source": {
"arn": "arn:aws:s3:::my-bucket",
"events": [
"s3:ObjectCreated:*"
]
}
}],
...
}
}
And then:
::
$ zappa schedule production
And now your function will execute every time a new upload appears in
your bucket!
Similarly, for a `Simple Notification
Service <https://aws.amazon.com/sns/>`__ event:
.. code:: javascript
"events": [
{
"function": "your_module.your_function",
"event_source": {
"arn": "arn:aws:sns:::your-event-topic-arn",
"events": [
"sns:Publish"
]
}
}
]
Undeploy
--------
If you need to remove the API Gateway and Lambda function that you have
previously published, you can simply:
::
$ zappa undeploy production
You will be asked for confirmation before it executes.
If you enabled CloudWatch Logs for your API Gateway service and you
don't want to keep those logs, you can specify the ``--remove-logs``
argument to purge the logs for your API Gateway and your Lambda
function:
::
$ zappa undeploy production --remove-logs
Status
------
If you need to see the status of your deployment and event schedules,
simply use the ``status`` command.
::
$ zappa status production
Tailing Logs
------------
You can watch the logs of a deployment by calling the ``tail``
management command.
::
$ zappa tail production
Remote Function Invocation
--------------------------
You can execute any function in your application directly at any time by
using the ``invoke`` command.
For instance, suppose you have a basic application in a file called
"my\_app.py", and you want to invoke a function in it called
"my\_function". Once your application is deployed, you can invoke that
function at any time by calling:
::
$ zappa invoke production 'my_app.my_function'
Any remote print statements made and the value the function returned
will then be printed to your local console. **Nifty!**
Django Management Commands
--------------------------
As a convenience, Zappa can also invoke remote Django 'manage.py'
commands with the ``manage`` command. For instance, to perform the basic
Django status check:
::
$ zappa manage production check
Obviously, this only works for Django projects which have their settings
properly defined. *(Please note that commands which take over 30 seconds
to execute may time-out. See `this related
issue <https://github.com/Miserlou/Zappa/issues/205#issuecomment-236391248>`__
for a work-around.)*
Let's Encrypt SSL Domain Certification and Installation
-------------------------------------------------------
If you want to use Zappa applications on a custom domain or subdomain,
you'll need to supply a valid SSL certificate. Fortunately for you,
Zappa can automatically create and install free valid SSL certificates
using Let's Encrypt!
If your domain is located within an AWS Route 53 Hosted Zone and you've
defined ``domain`` and ``lets_encrypt_key`` (ex:
``openssl genrsa 2048 > account.key``) settings, all you need to do is:
::
$ zappa certify production
And your domain will be verified, certified and registered!
*(Please note that this can take around 45 minutes to take effect the
first time your run the command, and around 60 seconds every time after
that.)*
More detailed instructions are available `in this handy
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_dns.md>`__.
Advanced Settings
=================
There are other settings that you can define in your local settings to
change Zappa's behavior. Use these at your own risk!
.. code:: javascript
{
"dev": {
"api_key_required": false, // enable securing API Gateway endpoints with x-api-key header (default False)
"api_key": "your_api_key_id" // optional, use an existing API key. The option "api_key_required" must be true to apply
"assume_policy": "my_assume_policy.json", // optional, IAM assume policy JSON file
"attach_policy": "my_attach_policy.json", // optional, IAM attach policy JSON file
"authorization_type": "AWS_IAM", // optional, use IAM to require request signing. Defaults to "NONE".
"aws_region": "us-east-1", // AWS Region (default US East),
"callbacks": { // Call custom functions during the local Zappa deployment/update process
"settings": "my_app.settings_callback", // After loading the settings
"zip": "my_app.zip_callback", // After creating the package
"post": "my_app.post_callback", // After command has excuted
},
"cache_cluster_enabled": false, // Use APIGW cache cluster (default False)
"cache_cluster_size": .5, // APIGW Cache Cluster size (default 0.5)
"cloudwatch_log_level": "OFF", // Enables/configures a level of logging for the given staging. Available options: "OFF", "INFO", "ERROR", default "OFF".
"cloudwatch_data_trace": false, // Logs all data about received events.
"cloudwatch_metrics_enabled": false, // Additional metrics for the API Gateway.
"debug": true, // Print Zappa configuration errors tracebacks in the 500
"delete_local_zip": true, // Delete the local zip archive after code updates
"delete_s3_zip": true, // Delete the s3 zip archive
"django_settings": "your_project.production_settings", // The modular path to your Django project's settings. For Django projects only.
"domain": "yourapp.yourdomain.com", // Required if you're using a domain
"environment_variables": {"your_key": "your_value"}, // A dictionary of environment variables that will be available to your deployed app. See also "remote_env_file". Default {}.
"events": [
{ // Recurring events
"function": "your_module.your_recurring_function", // The function to execute
"expression": "rate(1 minute)" // When to execute it (in cron or rate format)
},
{ // AWS Reactive events
"function": "your_module.your_reactive_function", // The function to execute
"event_source": {
"arn": "arn:aws:s3:::my-bucket", // The ARN of this event source
"events": [
"s3:ObjectCreated:*" // The specific event to execute in response to.
]
}
}
],
"exception_handler": "your_module.report_exception", // function that will be invoked in case Zappa sees an unhandled exception raised from your code
"exclude": ["*.gz", "*.rar"], // A list of regex patterns to exclude from the archive
"http_methods": ["GET", "POST"], // HTTP Methods to route,
"integration_response_codes": [200, 301, 404, 500], // Integration response status codes to route
"integration_content_type_aliases": { // For routing requests with non-standard mime types
"application/json": [
"application/vnd.webhooks+json"
]
},
"keep_warm": true, // Create CloudWatch events to keep the server warm.
"keep_warm_expression": "rate(4 minutes)", // How often to execute the keep-warm, in cron and rate format. Default 4 minutes.
"lambda_description": "Your Description", // However you want to describe your project for the AWS console. Default "Zappa Deployment".
"lambda_handler": "your_custom_handler", // The name of Lambda handler. Default: handler.lambda_handler
"lets_encrypt_key": "s3://your-bucket/account.key", // Let's Encrypt account key path. Can either be an S3 path or a local file path.
"lets_encrypt_schedule": "rate(15 days)" // How often to auto-renew Let's Encrypt certificate on the server. Must be set to enable autorenewing, rate or cron syntax.
"log_level": "DEBUG", // Set the Zappa log level. Default INFO, can be one of CRITICAL, ERROR, WARNING, INFO and DEBUG.
"manage_roles": true, // Have Zappa automatically create and define IAM execution roles and policies. Default true. If false, you must define your own IAM Role and role_name setting.
"memory_size": 512, // Lambda function memory in MB
"method_header_types": [ // Which headers to include in the API response. Defaults:
"Content-Type",
"Location",
"Status",
"X-Frame-Options",
"Set-Cookie"
],
"method_response_codes": [200, 301, 404, 500], // Method response status codes to route
"parameter_depth": 10, // Size of URL depth to route. Defaults to 8.
"prebuild_script": "your_module.your_function", // Function to execute before uploading code
"profile_name": "your-profile-name", // AWS profile credentials to use. Default 'default'.
"project_name": "MyProject", // The name of the project as it appears on AWS. Defaults to a slugified `pwd`.
"remote_env_bucket": "my-project-config-files", // optional s3 bucket where remote_env_file can be located.
"remote_env_file": "filename.json", // file in remote_env_bucket containing a flat json object which will be used to set custom environment variables.
"role_name": "MyLambdaRole", // Name of Zappa execution role. Default ZappaExecutionRole. To use a different, pre-existing policy, you must also set manage_roles to false.
"s3_bucket": "dev-bucket", // Zappa zip bucket,
"settings_file": "~/Projects/MyApp/settings/dev_settings.py", // Server side settings file location,
"timeout_seconds": 30, // Maximum lifespan for the Lambda function (default 30, max 300.)
"touch": false, // GET the production URL upon initial deployment (default True)
"use_precompiled_packages": false, // If possible, use C-extension packages which have been pre-compiled for AWS Lambda
"use_apigateway": true, // Set to false if you don't want to create API Gateway resource. Default true
"vpc_config": { // Optional VPC configuration for Lambda function
"SubnetIds": [ "subnet-12345678" ], // Note: not all availability zones support Lambda!
"SecurityGroupIds": [ "sg-12345678" ]
}
}
}
Advanced Usage
==============
Keeping The Server Warm
-----------------------
Zappa will automatically set up a regularly occuring execution of your
application in order to keep the Lambda function warm. This can be
disabled via the 'keep\_warm' setting.
Serving Static Files / Binary Uploads
-------------------------------------
Zappa is for running your application code, not for serving static web
assets. If you plan on serving custom static assets in your web
application (CSS/JavaScript/images/etc.,), you'll likely want to use a
combination of AWS S3 and AWS CloudFront.
Your web application framework will likely be able to handle this for
you automatically. For Flask, there is
`Flask-S3 <https://github.com/e-dard/flask-s3>`__, and for Django, there
is
`Django-Storages <https://django-storages.readthedocs.io/en/latest/>`__.
Similarly, you will not be able to accept binary multi-part uploads
through the API Gateway. Instead, you should design your application so
that binary uploads go `directly to
S3 <http://docs.aws.amazon.com/AWSJavaScriptSDK/guide/browser-examples.html#Uploading_a_local_file_using_the_File_API>`__,
which then triggers an event response defined in your ``events``
setting! That's thinking serverlessly!
Enabling CORS
-------------
To enable Cross-Origin Resource Sharing (CORS) for your application,
follow the `AWS "How to CORS"
Guide <https://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-cors.html>`__
to enable CORS via the API Gateway Console. Don't forget to enable CORS
per parameter and re-deploy your API after making the changes!
You can also simply handle CORS directly in your application. If you do
this, you'll need to add ``Access-Control-Allow-Origin``,
``Access-Control-Allow-Headers``, and ``Access-Control-Allow-Methods``
to the ``method_header_types`` key in your ``zappa_settings.json``. See
further `discussion
here <https://github.com/Miserlou/Zappa/issues/41>`__.
Enabling Secure Endpoints on API Gateway (API Key)
--------------------------------------------------
You can use the ``api_key_required`` setting to generate and assign an
API key to all the routes of your API Gateway. After redeployment, you
can then pass the provided key as a header called ``x-api-key`` to
access the restricted endpoints. Without the ``x-api-key`` header, you
will receive a 403. `More information on API keys in the API
Gateway <http://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-api-keys.html>`__
Enabling Secure Endpoints on API Gateway (IAM Policy)
-----------------------------------------------------
You can enable IAM-based (v4 signing) authorization on an API by setting
the ``authorization_type`` setting to ``AWS_IAM``. Your API will then
require signed requests and access can be controlled via `IAM
policy <https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-iam-policy-examples.html>`__.
Unsigned requests will receive a 403 response, as will requesters who
are not authorized to access the API.
Deploying to a Domain With a Let's Encrypt Certificate (DNS Auth)
-----------------------------------------------------------------
If you want to use Zappa on a domain with a free Let's Encrypt
certificate using automatic Route 53 based DNS Authentication, you can
follow `this handy
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_dns.md>`__.
Deploying to a Domain With a Let's Encrypt Certificate (HTTP Auth)
------------------------------------------------------------------
If you want to use Zappa on a domain with a free Let's Encrypt
certificate using HTTP Authentication, you can follow `this
guide <https://github.com/Miserlou/Zappa/blob/master/docs/domain_with_free_ssl_http.md>`__.
However, it's now far easier to use Route 53-based DNS authentication,
which will allow you to use a Let's Encrypt certificate with a single
``$ zappa certify`` command.
Setting Environment Variables
-----------------------------
Local Environment Variables
~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you want to set local remote environment variables for a deployment
stage, you can simply set them in your ``zappa_settings.json``:
.. code:: javascript
{
"dev": {
...
"environment_variables": {
"your_key": "your_value"
}
},
...
}
You can then access these inside your application with:
.. code:: python
import os
your_value = os.environ.get('your_key')
If your project needs to be aware of the type of environment you're
deployed to, you'll also be able to get ``SERVERTYPE`` (AWS Lambda),
``FRAMEWORK`` (Zappa), ``PROJECT`` (your project name) and ``STAGE``
(*dev*, *production*, etc.) variables at any time.
Remote Environment Variables
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you want to use remote environment variables to configure your
application (which is especially useful for things like sensitive
credentials), you can create a file and place it in an S3 bucket to
which your Zappa application has access to. To do this, add the
``remote_env_bucket`` and ``remote_env_file`` keys to zappa\_settings
pointing to a file containing a flat JSON object, so that each key-value
pair on the object will be set as an environment variable and value
whenever a new lambda instance spins up.
For example, to ensure your application has access to the database
credentials without storing them in your version control, you can add a
file to S3 with the connection string and load it into the lambda
environment using the ``remote_env_bucket`` and ``remote_env_file``
configuration settings.
super-secret-config.json (uploaded to my-config-bucket):
.. code:: javascript
{
"DB_CONNECTION_STRING": "super-secret:database"
}
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"remote_env_bucket": "my-config-bucket",
"remote_env_file": "super-secret-config.json"
},
...
}
Now in your application you can use:
.. code:: python
import os
db_string = os.environ('DB_CONNECTION_STRING')
Setting Integration Content-Type Aliases
----------------------------------------
By default, Zappa will only route the following MIME-types that are set
explicitly via ``Content-Type`` header: ``application/json``,
``application/x-www-form-urlencoded``, and ``multipart/form-data`` (if
the Content-Type header isn't set, ``application/json`` will be the
default). If a request comes in with ``Content-Type`` header set to
anything but those 3 values, Amazon will return a 415 status code and a
``MIME type not supported`` message. If there is a need to support
custom MIME-types (e.g. when a third-party making requests to your API)
you can specify aliases for the 3 default types:
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"integration_content_type_aliases": {
"application/json": ["application/vnd.webhooks+json"]
}
},
...
}
Now Zappa will use ``application/json``'s template to route requests
with MIME-type of ``application/vnd.webhooks+json``. You will need to
re-deploy your application for this change to take affect.
Catching Unhandled Exceptions
-----------------------------
By default, if an *unhandled* exception happens in your code, Zappa will
just print the stacktrace into a CloudWatch log. If you wish to use an
external reporting tool to take note of those exceptions, you can use
the ``exception_handler`` configuration option.
zappa\_settings.json:
.. code:: javascript
{
"dev": {
...
"exception_handler": "your_module.unhandled_exceptions",
},
...
}
The function has to accept three arguments: exception, event, and
context:
your\_module.py
.. code:: python
def unhandled_exception(e, event, context):
send_to_raygun(e, event) # gather data you need and send
return True # Prevent invocation retry
You may still need a similar exception handler inside your application,
this is just a way to catch exception which happen at the Zappa/WSGI
layer (typically event-based invocations, misconfigured settings, bad
Lambda packages, and permissions issues).
By default, AWS Lambda will attempt to retry an event based (non-API
Gateway, e.g. CloudWatch) invocation if an exception has been thrown.
However, you can prevent this by returning True, as in example above, so
Zappa that will not re-raise the uncaught exception, thus preventing AWS
Lambda from retrying the current invocation.
Using Custom AWS IAM Roles and Policies
---------------------------------------
By default, the Zappa client will create and manage the necessary IAM
policies and roles to deploy and execute Zappa applications. However, if
you're using Zappa in a corporate environment or as part of a continuous
integration, you may instead want to manually manage your policies
instead.
To manually define the permissions policy of your Zappa execution role,
you must define the following in your *zappa\_settings.json*:
.. code:: javascript
{
"dev": {
...
"manage_roles": false, // Disable Zappa client managing roles.
"role_name": "MyLambdaRole", // Name of your Zappa execution role. Default ZappaExecutionRole.
...
},
...
}
Ongoing discussion about the minimum policy requirements necessary for a
Zappa deployment `can be found
here <https://github.com/Miserlou/Zappa/issues/244>`__.
Zappa Guides
============
- `Django-Zappa tutorial
screencast <https://www.youtube.com/watch?v=plUrbPN0xc8&feature=youtu.be>`__.
- `Using Django-Zappa, Part
1 <https://serverlesscode.com/post/zappa-wsgi-for-python/>`__.
- `Using Django-Zappa, Part 2:
VPCs <https://serverlesscode.com/post/zappa-wsgi-for-python-pt-2/>`__.
- `Building Serverless Microservices with Zappa and
Flask <https://gun.io/blog/serverless-microservices-with-zappa-and-flask/>`__
- `Zappa で Hello World するまで
(Japanese) <http://qiita.com/satoshi_iwashita/items/505492193317819772c7>`__
- *Your guide here?*
Zappa in the Press
==================
- *`Zappa Serves Python, Minus the
Servers <http://www.infoworld.com/article/3031665/application-development/zappa-serves-python-web-apps-minus-the-servers.html>`__*
- *`Zappa lyfter serverlösa applikationer med
Python <http://computersweden.idg.se/2.2683/1.649895/zappa-lyfter-python>`__*
- *`Interview: Rich Jones on
Zappa <https://serverlesscode.com/post/rich-jones-interview-django-zappa/>`__*
Sites Using Zappa
=================
- `Zappa.io <https://www.zappa.io>`__ - A simple Zappa homepage
- `Mailchimp Signup
Utility <https://github.com/sasha42/Mailchimp-utility>`__ - A
microservice for adding people to a mailing list via API.
- `Zappa Slack
Inviter <https://github.com/Miserlou/zappa-slack-inviter>`__ - A
tiny, server-less service for inviting new users to your Slack
channel.
- `Serverless Image
Host <https://github.com/Miserlou/serverless-imagehost>`__ - A
thumbnailing service with Flask, Zappa and Pillow.
- `Gigger <https://www.gigger.rocks/>`__ - The live music industry's
search engine
- And many more!
Are you using Zappa? Let us know and we'll list your site here!
Related Projects
================
- `lambda-packages <http://github.com/Miserlou/lambda-packages>`__ -
Precompiled C-extention packages for AWS Lambda. Used automatically
by Zappa.
- `zappa-cms <http://github.com/Miserlou/zappa-cms>`__ - A tiny
server-less CMS for busy hackers. Work in progress.
- `flask-ask <https://github.com/johnwheeler/flask-ask>`__ - A
framework for building Amazon Alexa applications. Uses Zappa for
deployments.
- `zappa-file-widget <https://github.com/anush0247/zappa-file-widget>`__
- A Django plugin for supporting binary file uploads in Django on
Zappa.
- `zops <https://github.com/bjinwright/zops>`__ - Utilities for teams
and continuous integrations using Zappa.
Hacks
=====
Zappa goes quite far beyond what Lambda and API Gateway were ever
intended to handle. As a result, there are quite a few hacks in here
that allow it to work. Some of those include, but aren't limited to..
- Using VTL to map body, headers, method, params and query strings into
JSON, and then turning that into valid WSGI.
- Attaching response codes to response bodies, Base64 encoding the
whole thing, using that as a regex to route the response code,
decoding the body in VTL, and mapping the response body to that.
- Packing and *Base58* encoding multiple cookies into a single cookie
because we can only map one kind.
- Turning cookie-setting 301/302 responses into 200 responses with HTML
redirects, because we have no way to set headers on redirects.
Contributing
============
This project is still young, so there is still plenty to be done.
Contributions are more than welcome!
Please file tickets for discussion before submitting patches, and submit
your patches to the "dev" branch if possible. If dev falls behind
master, feel free to rebase.
If you are adding a non-trivial amount of new code, please include a
functioning test in your PR. For AWS calls, we use the placebo library,
which you can learn to use `in the test writing
guide <docs/README.md>`__.
Please also write comments along with your new code, including the URL
of the ticket which you filed along with the PR. This greatly helps for
project maintainability, as it allows us to trace back use cases and
explain decision making.
Using a Local Repo
------------------
To use the git HEAD, you *can't* use ``pip install -e``. Instead, you
should clone the repo to your machine and then
``pip install /path/to/zappa/repo`` or
``ln -s /path/to/zappa/repo/zappa zappa`` in your local project.
Support / Development / Training / Consulting
=============================================
Do you need help with..
- Porting existing Flask and Django applications to Zappa?
- Building new applications and services that scale infinitely?
- Reducing your operations and hosting costs?
- Adding new custom features into Zappa?
- Training your team to use AWS and other server-less paradigms?
Good news! We're currently available for remote and on-site consulting
for small, large and enterprise teams. Please contact miserlou@gmail.com
with your needs and let's work together!
.. raw:: html
<p align="center">
.. raw:: html
</p>
.. |Build Status| image:: https://travis-ci.org/Miserlou/Zappa.svg
:target: https://travis-ci.org/Miserlou/Zappa
.. |Coverage| image:: https://img.shields.io/coveralls/Miserlou/Zappa.svg
:target: https://coveralls.io/github/Miserlou/Zappa
.. |Requirements Status| image:: https://requires.io/github/Miserlou/Zappa/requirements.svg?branch=master
:target: https://requires.io/github/Miserlou/Zappa/requirements/?branch=master
.. |PyPI| image:: https://img.shields.io/pypi/v/Zappa.svg
:target: https://pypi.python.org/pypi/zappa
.. |Slack| image:: https://img.shields.io/badge/chat-slack-ff69b4.svg
:target: https://slack.zappa.io/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
zappa-0.23.1.tar.gz
(78.3 kB
view details)
Built Distribution
zappa-0.23.1-py2-none-any.whl
(70.8 kB
view details)
File details
Details for the file zappa-0.23.1.tar.gz
.
File metadata
- Download URL: zappa-0.23.1.tar.gz
- Upload date:
- Size: 78.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3269ba4c391b550f81e10132eb3aabdc5b8c49add79032b7de7228c9d08508e5 |
|
MD5 | 83c25aa246bdf372097fc6d9cc3641f4 |
|
BLAKE2b-256 | b94e1905f24554929aa118ba2b2f83e73a20206685e0f1beb9503152ed71ef22 |
File details
Details for the file zappa-0.23.1-py2-none-any.whl
.
File metadata
- Download URL: zappa-0.23.1-py2-none-any.whl
- Upload date:
- Size: 70.8 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c3e90561da079059c2a725230151c588c2fa38f55c2ab187a8d771ec15b12ad |
|
MD5 | efa58f643d95397d2f289fb73e551dac |
|
BLAKE2b-256 | 28badf4606f3298e92bf622f3c85327a8a8e40fd6fc91cc3edb41f169ad4c4de |