A Metaflow plugin to execute flows on Argo Workflows
Project description
Metaflow library for SAP AI Core
This Python library is a plugin that lets you generate workflow templates that can be executed in Argo or on SAP AI Core.
Sap-ai-core-metaflow is a Metaflow plugin to execute flows on Argo Workflows.
It adds Argo Workflows capabilities on top of Metaflow's @kubernetes
decorator similar
to step-functions
and @batch
.
Installation
pip install sap-ai-core-metaflow\[kubernetes\]
Documentation
For general information about how to use Metaflow, see the Metaflow documentation https://docs.metaflow.org.
For command-line help, use the command option --help
Configuration
The plugin requires configured Metaflow:
metaflow configure eks
Usage
To see a sub-commands' detailed information, run::
python 00-helloworld/helloworld.py argo [sub-command] --help
An example creating an argo workflow from the Metaflow hello world tutorial.
metaflow tutorials pull
cd metaflow-tutorials
python 00-helloworld/helloworld.py argo create
python 00-helloworld/helloworld.py argo trigger
python 00-helloworld/helloworld.py argo list-runs
Generate Argo Workflows Template
To store a generated template in a file, run the command:
python 00-helloworld/helloworld.py --with=kubernetes:secrets=default-object-store-secret argo create --only-json > helloworld.json
Note
Argo Workflows accepts both YAML and JSON templates. The Argo plugin always creates JSON.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for sap_ai_core_metaflow-1.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c84f0e9534dbef29730335b528228585052678f2a04cdcecfd6f0e7749f00de |
|
MD5 | 6a76c833c60a039dc48c27931bdd3cdc |
|
BLAKE2b-256 | 83bf80bc87432480a370b44f4de3140df510f3a12e8291ef4554c976e32c75b0 |