Skip to main content

Model registry and ML pipeline orchestration for fAIr

Project description

fAIr-models

codecov

Model registry and ML pipeline orchestration for fAIr.

fair-py-ops is the Python package for building ZenML pipelines, validating STAC items, and testing locally. The models/ directory is the single source of truth for base model contributions.

Quick Start

Prerequisites: Docker, uv, just.

git clone https://github.com/hotosm/fAIr-models.git
cd fAIr-models
just setup
just example

just setup installs Python deps, brings up the full stack via Docker Compose (Postgres + MinIO + STAC + MLflow + ZenML), and registers the ZenML stack. just example runs all three reference pipelines end-to-end.

Service URL Credentials
ZenML dashboard http://localhost:8080 default / (empty)
MLflow http://localhost:5000 none
STAC API http://localhost:8082 none
MinIO console http://localhost:9001 minioadmin / minioadmin

See Getting Started for the full guide. For Kubernetes parity or production deploys, see infra/README.md.

Documentation

Examples

Three reference implementations demonstrate the full workflow for each supported task:

Example Task Model Path
Segmentation Semantic segmentation UNet (torchgeo) examples/segmentation/
Classification Binary classification ResNet18 (torchvision) examples/classification/
Detection Object detection YOLOv11n (ultralytics) examples/detection/

Commands

Run just to see all recipes.

just setup     # install deps + bring up stack + register ZenML stack
just example   # run all 3 example pipelines
just down      # stop the stack (state preserved, fast restart)
just up        # restart after `just down`
just tear      # destroy stack + volumes + local ZenML state
just lint      # ruff + ty
just test      # pytest
just validate  # validate STAC items + model pipelines
just docs      # serve documentation locally
just commit    # run pre-commit hooks + commitizen

Key Concepts

Concept Description
Base model Reusable ML blueprint (weights, code, Docker image, STAC item)
Local model Finetuned model produced by ZenML pipeline on user data
STAC catalog Model/dataset registry with MLM and Version extensions
ZenML pipeline Orchestrated training and inference workflows

Ask DeepWiki

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fair_py_ops-0.3.2.tar.gz (3.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fair_py_ops-0.3.2-py3-none-any.whl (4.1 MB view details)

Uploaded Python 3

File details

Details for the file fair_py_ops-0.3.2.tar.gz.

File metadata

  • Download URL: fair_py_ops-0.3.2.tar.gz
  • Upload date:
  • Size: 3.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fair_py_ops-0.3.2.tar.gz
Algorithm Hash digest
SHA256 a3dcfcfa2f3f33bd02d543d9b9e1b23f0cb5978dc165682cb90d57b549faf8d8
MD5 4dd950fdb9bde610a37eae5d15787fbd
BLAKE2b-256 ca686601800199b89189234886765195402c402d82a0bba5335ffbc2de881753

See more details on using hashes here.

File details

Details for the file fair_py_ops-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: fair_py_ops-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 4.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fair_py_ops-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7741644a316f1d6c16a4cc6ac4b82b290b59b0cd1b2aa816259ea18d8a6ad2c5
MD5 baef8a9c4afd01e8a5f3595052611bb1
BLAKE2b-256 02d0f9983a7f62f0cdc0fb2f19770170f4757622513947fc4e39a7f5e1763b98

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page