Activity worker for performing AWS StepFunctions tasks
Project description
StepFunctions Activity Worker
A worker that listens to a StepFunctions activity and executes a provided function using the inputs from the activity task.
The StepFunctions Activity Worker encapsulates all the parts of communicating with the StepFunctions API so you don't have to worry about task heartbeats or maintaining task tokens and success/failure scenarios; all you have to worry about is executing the task.
Installation
Install from PyPI:
pip install stepfunctions_activity_worker
Usage
from stepfunctions_activity_worker import ActivityWorker
def my_task(**task_input):
"""Perform the task based on this task's input."""
# Perform your task here!
return {"result": "done!"}
if __name__ == "__main__":
activity_arn = "PLACE YOUR ACTIVITY ARN HERE"
worker = ActivityWorker(activity_arn, my_task)
worker.listen()
Warning
The ActivityWorker
class, if not provided with a client
argument on instantiation, will create a properly configured client from your default session.
However, if you are providing an already instantiated client
to the ActivityWorker
class, make sure it is proply configured to make StepFunctions API calls!
The GetActivityTask
API call blocks for 60 seconds which matches the botocore.config.Config
default read_timeout
. This means that if the API response for GetActivityTask
is not punctual (which it often isn't) it will cause unnecessary retry-requests & eventually bubble up an HTTP exception.
import boto3
import botocore
from stepfunctions_activity_worker import ActivityWorker
def my_task(**task_input):
"""Perform the task based on this task's input."""
# Perform your task here!
return {"result": "done!"}
config = botocore.config.Config(
read_timeout=70,
# Insert other custom configuration here
)
stepfunctions = boto3.client('stepfunctions', config=config)
activity_worker = ActivityWorker(activity_arn, my_task, client=stepfunctions)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for stepfunctions_activity_worker-1.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a6f680b85d8253f4bf6c30824c9deb94374cb789791096cd0e661c090796c82 |
|
MD5 | b85d9eab9187877b18c71b95c2342c21 |
|
BLAKE2b-256 | 7e686776e400938595e091e4e0d4457f021e508c948560e433689ff66d278d82 |
Hashes for stepfunctions_activity_worker-1.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d5a3a1bf4f56bb40132d2bd2bbf5a60901f5162d1db76a868545914939b5436 |
|
MD5 | 14940ed3d2c8aa314ec9f468b1421bd6 |
|
BLAKE2b-256 | 1e2610ae740db371d87008f53584a71b7e50c777772fdf48810acce1baceffc8 |