Skip to main content

The CLAIMED framework

Project description

OpenSSF Best Practices GitHub

C3 - the CLAIMED Component Compiler

TL;DR

  • takes arbitrary assets (Jupyter notebooks, python scripts, R scripts) as input
  • automatically creates container images and pushes to container registries
  • automatically installs all required dependencies into the container image
  • creates KubeFlow Pipeline components (target workflow execution engines are pluggable)
  • creates Kubernetes job configs for execution on Kubernetes/Openshift clusters
  • can be triggered from CICD pipelines

C3 (CLAIMED Component Compiler) is the central project of the CLAIMED framework. It automates the transformation of arbitrary code assets — such as Jupyter notebooks, Python scripts, or R scripts — into fully portable, executable AI components.

While the component library is now maintained primarily as an example repository, C3 is where active development and innovation take place. The most utilized and powerful feature of C3 is grid compute parallelization, enabling distributed execution of AI workloads across heterogeneous compute environments.

MLX Integration

The Machine Learning eXchange (MLX) is now fully integrated as the backend for C3’s grid computing system, responsible for tracking all assets, including:

  • data

  • models

  • jobs

  • and other related resources

This integration allows C3 to seamlessly manage asset lifecycle, provenance, and discovery within a unified infrastructure.

To learn more on how this library works in practice, please have a look at the following video

Getting started

Install

pip install claimed

Usage

Just run the following command with your python script or notebook:

c3_create_operator "<your-operator-script>.py" --repository "<registry>/<namespace>"

Your code needs to follow certain requirements which are explained in Getting Started.

Getting Help

c3_create_operator --help

We welcome your questions, ideas, and feedback. Please create an issue or a discussion thread. Please see VULNERABILITIES.md for reporting vulnerabilities.

Contributing to CLAIMED

Interested in helping make CLAIMED better? We encourage you to take a look at our Contributing page.

Credits

CLAIMED is supported by the EU’s Horizon Europe program under Grant Agreement number 101131841 and also received funding from the Swiss State Secretariat for Education, Research and Innovation (SERI) and the UK Research and Innovation (UKRI).

Co-Funded by the European Union

License

This software is released under Apache License v2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

claimed-0.2.4.tar.gz (521.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

claimed-0.2.4-py3-none-any.whl (466.3 kB view details)

Uploaded Python 3

File details

Details for the file claimed-0.2.4.tar.gz.

File metadata

  • Download URL: claimed-0.2.4.tar.gz
  • Upload date:
  • Size: 521.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for claimed-0.2.4.tar.gz
Algorithm Hash digest
SHA256 4fe50fbb86ffb670b980ab1acd5ae9f921424529ba93d6494a2952919116a14f
MD5 017a4f439e0f4d90138637d95642161d
BLAKE2b-256 5f1a4ca4f805d43d08b692573dd8894bd1311f9ec037d5036fd4ad491546df82

See more details on using hashes here.

File details

Details for the file claimed-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: claimed-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 466.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for claimed-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 f9b615b813bc9022ae784afbcab5276fe235dce6c7cb095b3b6ba93e69439000
MD5 5a9a3b7a97b4d7f23e2529393040a357
BLAKE2b-256 87adcc545f19b94e9804bd46ecb585a9d92394241d33c13dcd56acec22c01323

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page