The CLAIMED component compiler (C3) generates container images, KFP components, Kubernetes jobs, CWL Tasks, CLI applications
Project description
C3 - the CLAIMED Component Compiler
TL;DR
- takes arbitrary assets (Jupyter notebooks, python scripts, R scripts) as input
- automatically creates container images and pushes to container registries
- automatically installs all required dependencies into the container image
- creates KubeFlow Pipeline components (target workflow execution engines are pluggable)
- creates Kubernetes job configs for execution on Kubernetes/Openshift clusters
- can be triggered from CICD pipelines
To learn more on how this library works in practice, please have a look at the following video
Related work
Getting started
Install
pip install claimed
Usage
Just run the following command with your python script or notebook:
c3_create_operator "<your-operator-script>.py" --repository "<registry>/<namespace>"
Your code needs to follow certain requirements which are explained in Getting Started.
Getting Help
c3_create_operator --help
We welcome your questions, ideas, and feedback. Please create an issue or a discussion thread. Please see VULNERABILITIES.md for reporting vulnerabilities.
Contributing to CLAIMED
Interested in helping make CLAIMED better? We encourage you to take a look at our Contributing page.
License
This software is released under Apache License v2.0.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for claimed_c3-0.3.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 945bcf499de89d25f8478871517121f04f9782d0ee9f8df19157c76210d19afe |
|
MD5 | 9ad8910c118f3c1a61988f45d8b44c3f |
|
BLAKE2b-256 | 4ae09b030ff2d46a5bc3e36d9d64d00922b398ca09b4e2ff3a856ffb436a5cac |