Skip to main content

Kedro plugin with Kubeflow support

Project description

Kedro Kubeflow Plugin

Python Version License SemVer

About

The main purpose of this plugin is to enable running kedro pipeline on Kubeflow Pipelines. It supports translation from Kedro pipeline DSL to kfp (pipelines SDK) and deployment to a running kubeflow cluster with some convenient commands.

The plugin can be used together with kedro-docker to simplify preparation of docker image for pipeline execution.

Usage guide

Usage: kedro kubeflow [OPTIONS] COMMAND [ARGS]...
 
   Interact with Kubeflow Pipelines
 
 Options:
   -h, --help  Show this message and exit.
 
 Commands:
   compile          Translates Kedro pipeline into YAML file with Kubeflow pipeline definition
   list-pipelines   List deployed pipeline definitions
   run-once         Deploy pipeline as a single run within given experiment.
   schedule         Schedules recurring execution of latest version of the pipeline
   ui               Open Kubeflow Pipelines UI in new browser tab
   upload-pipeline  Uploads pipeline to Kubeflow server

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kedro-kubeflow-0.1.8.tar.gz (5.8 kB view details)

Uploaded Source

File details

Details for the file kedro-kubeflow-0.1.8.tar.gz.

File metadata

  • Download URL: kedro-kubeflow-0.1.8.tar.gz
  • Upload date:
  • Size: 5.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.0 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.7

File hashes

Hashes for kedro-kubeflow-0.1.8.tar.gz
Algorithm Hash digest
SHA256 59e7a4db5bf7eb7b338e0150d1b6e0bd891543418de2524b0b03a8cdd3c3a6c4
MD5 a75de805580ef408dd5db7876ace7191
BLAKE2b-256 0d524eca0c9f7fc34cb03ecc8df2847ae65a22527340d4bf415a8e1b19042578

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page