Skip to main content

Model registry and ML pipeline orchestration for fAIr

Project description

fAIr-models

codecov

Model registry and ML pipeline orchestration for fAIr.

fair-py-ops is the Python package for building ZenML pipelines, validating STAC items, and testing locally. The models/ directory is the single source of truth for base model contributions.

Quick Start

Prerequisites: Docker, uv, just.

git clone https://github.com/hotosm/fAIr-models.git
cd fAIr-models
just setup
just example

just setup installs Python deps, brings up the full stack via Docker Compose (Postgres + MinIO + STAC + MLflow + ZenML), and registers the ZenML stack. just example runs all three reference pipelines end-to-end.

Service URL Credentials
ZenML dashboard http://localhost:8080 default / (empty)
MLflow http://localhost:5000 none
STAC API http://localhost:8082 none
MinIO console http://localhost:9001 minioadmin / minioadmin

See Getting Started for the full guide. For Kubernetes parity or production deploys, see infra/README.md.

Documentation

Examples

Three reference implementations demonstrate the full workflow for each supported task:

Example Task Model Path
Segmentation Semantic segmentation UNet (torchgeo) examples/segmentation/
Classification Binary classification ResNet18 (torchvision) examples/classification/
Detection Object detection YOLOv11n (ultralytics) examples/detection/

Commands

Run just to see all recipes.

just setup     # install deps + bring up stack + register ZenML stack
just example   # run all 3 example pipelines
just down      # stop the stack (state preserved, fast restart)
just up        # restart after `just down`
just tear      # destroy stack + volumes + local ZenML state
just lint      # ruff + ty
just test      # pytest
just validate  # validate STAC items + model pipelines
just docs      # serve documentation locally
just commit    # run pre-commit hooks + commitizen

Key Concepts

Concept Description
Base model Reusable ML blueprint (weights, code, Docker image, STAC item)
Local model Finetuned model produced by ZenML pipeline on user data
STAC catalog Model/dataset registry with MLM and Version extensions
ZenML pipeline Orchestrated training and inference workflows

Ask DeepWiki

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fair_py_ops-0.3.4.tar.gz (3.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fair_py_ops-0.3.4-py3-none-any.whl (4.1 MB view details)

Uploaded Python 3

File details

Details for the file fair_py_ops-0.3.4.tar.gz.

File metadata

  • Download URL: fair_py_ops-0.3.4.tar.gz
  • Upload date:
  • Size: 3.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fair_py_ops-0.3.4.tar.gz
Algorithm Hash digest
SHA256 62603211b9deeb81651656ba02679678f8119a0a8e42564dd24ed76acf73691e
MD5 f3f5edcede54d6f935b74ca513ff7a50
BLAKE2b-256 dfeaa66bbd5df22d6606ac92cd53fa14fc81b27fe3af8b884dcf5a10285253d5

See more details on using hashes here.

File details

Details for the file fair_py_ops-0.3.4-py3-none-any.whl.

File metadata

  • Download URL: fair_py_ops-0.3.4-py3-none-any.whl
  • Upload date:
  • Size: 4.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fair_py_ops-0.3.4-py3-none-any.whl
Algorithm Hash digest
SHA256 6df2c2c887a0663cb54b88551597f87d8bcb8c4766caedaa2c5f90786f0430e8
MD5 4f00c7f5b3b51eb209fbaec397463d48
BLAKE2b-256 5e60cba68a1c69581259e1b7de868461859dc052556c693449d520072baa95d3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page