The CLAIMED component compiler (C3) generates container images, KFP components, Kubernetes jobs, CWL Tasks, CLI applications
Project description
C3 - the CLAIMED Component Compiler
TL;DR
- takes arbitrary assets (Jupyter notebooks, python scripts, R scripts) as input
- automatically creates container images and pushes to container registries
- automatically installs all required dependencies into the container image
- creates KubeFlow Pipeline components (target workflow execution engines are pluggable)
- creates Kubernetes job configs for execution on Kubernetes/Openshift clusters
- can be triggered from CICD pipelines
To learn more on how this library works in practice, please have a look at the following video
Related work
Getting started
Install
pip install claimed
Usage
Just run the following command with your python script or notebook:
c3_create_operator "<your-operator-script>.py" --repository "<registry>/<namespace>"
Your code needs to follow certain requirements which are explained in Getting Started.
Getting Help
c3_create_operator --help
We welcome your questions, ideas, and feedback. Please create an issue or a discussion thread. Please see VULNERABILITIES.md for reporting vulnerabilities.
Contributing to CLAIMED
Interested in helping make CLAIMED better? We encourage you to take a look at our Contributing page.
License
This software is released under Apache License v2.0.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for claimed_c3-0.3.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 856ee0c5dd838b1aa50b530eaf0314e2795ef143a4ebed5347227f6c824feaff |
|
MD5 | e1929e17d840826fe6df015b76117135 |
|
BLAKE2b-256 | 46ccdec232e24afb90676c3dde03a1f3cc080467f9dfc5cfa713f379cf7e2df5 |