Skip to main content

Deploy configurable unix pipeline jobs serverlessly.

Project description

Build Status Documentation Status

What is it?

handoff (repository) is a single command that let you quickly orchestrate the data pipeline on a serverless platform such as AWS Fargate.

Deploying on a serverless platform saves you from the need for managing servers and paying for idling virtual machines. The serverless configuration could be very complicated, so handoff takes care of it under the hood so you can focus on the pipeline logic.

Features and benefits:

  1. Container orchestration (AWS Elastic Continer Service)
  2. Extended serverless task execution (AWS Fargate, vs. AWS Lambda's 15min limit)
  3. CRON Scheduling (AWS EventBridge)
  4. Configuration and secret management (AWS Systems Manager Parameter Store)
  5. Simple switch between production and devlopment stages
  6. Docker image management (AWS Elastic Container Registry)
  7. Artifacts management (AWS Simple Cloud Storage)
  8. Log management (AWS CloudWatch)
  9. Shared resource management (Virtual Private Cloud, Security Group)
  10. No need to pay and maintain a dedicated virtual instances!

Note: With the unified handoff command, we are planning to support multi-cloud deployment experience (Azure and Google Cloud Platform).

Get started easily

Check out the super quick example and tutorial.

Open Source handoff Recipes!

We will upload more and more recipes that you can use and learn from!

About this project

This project is developed by ANELEN and friends. Please check out the ANELEN's open innovation philosophy and other projects


Copyright © 2020~ Anelen Co., LLC

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for handoff, version 0.3.4
Filename, size File type Python version Upload date Hashes
Filename, size handoff-0.3.4.tar.gz (9.6 MB) File type Source Python version None Upload date Hashes View
Filename, size handoff-0.3.4-py3-none-any.whl (10.6 MB) File type Wheel Python version py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page