Skip to main content

The CLAIMED component compiler (C3) generates container images, KFP components, Kubernetes jobs, CWL Tasks, CLI applications

Project description

OpenSSF Best Practices GitHub

C3 - the CLAIMED Component Compiler

TL;DR

  • takes arbitrary assets (Jupyter notebooks, python scripts, R scripts) as input
  • automatically creates container images and pushes to container registries
  • automatically installs all required dependencies into the container image
  • creates KubeFlow Pipeline components (target workflow execution engines are pluggable)
  • creates Kubernetes job configs for execution on Kubernetes/Openshift clusters
  • can be triggered from CICD pipelines

To learn more on how this library works in practice, please have a look at the following video

Related work

Ploomber

Orchest

Getting started

Install

pip install claimed

Usage

Just run the following command with your python script or notebook:

c3_create_operator "<your-operator-script>.py" --repository "<registry>/<namespace>"

Your code needs to follow certain requirements which are explained in Getting Started.

Getting Help

c3_create_operator --help

We welcome your questions, ideas, and feedback. Please create an issue or a discussion thread. Please see VULNERABILITIES.md for reporting vulnerabilities.

Contributing to CLAIMED

Interested in helping make CLAIMED better? We encourage you to take a look at our Contributing page.

License

This software is released under Apache License v2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

claimed_c3-0.3.9.tar.gz (53.9 kB view details)

Uploaded Source

Built Distribution

claimed_c3-0.3.9-py3-none-any.whl (50.4 kB view details)

Uploaded Python 3

File details

Details for the file claimed_c3-0.3.9.tar.gz.

File metadata

  • Download URL: claimed_c3-0.3.9.tar.gz
  • Upload date:
  • Size: 53.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.9.19

File hashes

Hashes for claimed_c3-0.3.9.tar.gz
Algorithm Hash digest
SHA256 17d42cd8b25dccee69cf4a7eba7d108e86bd16a248ad32dce967913a68ebdb67
MD5 dbcd4c4153cf5745e6bd9f47512a02e5
BLAKE2b-256 1b4399eac72d5f81acad6235ffaf56a5bee624461602e56b0caf0c0a13a7ff41

See more details on using hashes here.

File details

Details for the file claimed_c3-0.3.9-py3-none-any.whl.

File metadata

  • Download URL: claimed_c3-0.3.9-py3-none-any.whl
  • Upload date:
  • Size: 50.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.9.19

File hashes

Hashes for claimed_c3-0.3.9-py3-none-any.whl
Algorithm Hash digest
SHA256 e471618b5e2c4ce0b7eb6fc575a65723594525fd7525801597791044a2ff2f2c
MD5 bba0efa15fa0b0a4239b489f1c74a3f2
BLAKE2b-256 6b5f99b980b74e118dd69dd292562b2849bcdc49bc36262928ef28d7b738bd63

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page