Function Flow - workflow management on Google Cloud Functions
Project description
Function Flow
Function Flow is a workflow management framework on top of Google Cloud Functions.
It allows you to write tasks
in Python functions, define their dependencies
and manage the executions for you.
For example, if you want to first transform data from BigQuery, then invoke a job to AI platform to make some predictions, after that load some data from GCS to BigQuery, this can be a helpful tool for you.
Running the Example
To enable all services, and deploy all cloud functions, first create a blank GCP project, then run the following command:
cd example
bash bin/deploy.sh
If you edited example/src/main.py
, you can run bash bin/update-fuctions.sh
for the code to take effect.
To run the example, go to cloud function page and run the function start
. Then
you can view the task statuses in the Firestore UI.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file function-flow-0.0.7.tar.gz
.
File metadata
- Download URL: function-flow-0.0.7.tar.gz
- Upload date:
- Size: 13.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3a023febb8d0a00098a3bad90799e28518b8cd8450513054a473fca26f32dc2e |
|
MD5 | 21eb16a66266f8c6b6b378f2caa16884 |
|
BLAKE2b-256 | 0dae8e8ffccddfef0f8c8cc67cb97386372550d89109981951dc92499e4375bf |
File details
Details for the file function_flow-0.0.7-py3-none-any.whl
.
File metadata
- Download URL: function_flow-0.0.7-py3-none-any.whl
- Upload date:
- Size: 15.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 121bbfd0c434f8e3c08fb98ae846c32ced778ca100237da6938c3d04fe15e6b5 |
|
MD5 | a59451cd002ca11a036e4673eb92fd08 |
|
BLAKE2b-256 | a61488c3e878c3031c073b094d80cee93af8c8ba62de13aacae38bee1760157f |