The CLAIMED component compiler (C3) generates container images, KFP components, and Kubernetes jobs.
Project description
C3 - the CLAIMED Component Compiler
TL;DR
- takes arbitrary assets (Jupyter notebooks, python scripts, R scripts) as input
- automatically creates container images and pushes to container registries
- automatically installs all required dependencies into the container image
- creates KubeFlow Pipeline components (target workflow execution engines are pluggable)
- creates Kubernetes job configs for execution on Kubernetes/Openshift clusters
- can be triggered from CICD pipelines
To learn more on how this library works in practice, please have a look at the following video
Related work
Getting started
Install
pip install claimed
Usage
Just run the following command with your python script or notebook:
c3_create_operator "<your-operator-script>.py" --repository "<registry>/<namespace>"
Your code needs to follow certain requirements which are explained in Getting Started.
Getting Help
c3_create_operator --help
We welcome your questions, ideas, and feedback. Please create an issue or a discussion thread. Please see VULNERABILITIES.md for reporting vulnerabilities.
Contributing to CLAIMED
Interested in helping make CLAIMED better? We encourage you to take a look at our Contributing page.
License
This software is released under Apache License v2.0.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for claimed_c3-0.2.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 170f8e42732903185f641927c35e4c485b03571b05ba8ef70182947c039e8f30 |
|
MD5 | 999224d0b9cadc2f02f02a936f234f9b |
|
BLAKE2b-256 | b298ab393facad35551d6b348184118a9f8a14c8afe3eeaf13d3b8ffa1b4f25a |