Skip to main content

makina-runway

Project description

Software Development Kit

  • support only python

Goal

  • mlflow를 사용하는 사용자들이 import만 변경하여 runway에 logging하는 방식을 제공한다.
  • runway sdk 는 mlflow 의 interface/arguments 를 최대한 맞추는 방향으로 구현해야 한다.
# import mlflow
from runway import mlflow

with mlflow.start_run() as run:
    mlflow.log_param()

mlflow.sklearn.save_model()

Install

  • makina 사내 pypi server에서 install 합니다.
  1. pip install

    # pip install
    pip install --index-url http://pypi.makina.rocks/simple/ --trusted-host pypi.makina.rocks runway
    
    pyproject.toml의 version 수정 후 테스트 시
    pip install --index-url http://pypi.makina.rocks/simple/ --trusted-host pypi.makina.rocks mrx-runway=={{version}}
    
  2. poetry 사용

    1. pyproject.toml에 사내 pypi source 추가

      [[tool.poetry.source]]
      name = "mrx"
      url = "http://pypi.makina.rocks/simple/"
      default = true
      
    2. poetry add & install

      poetry add runway
      poetry install
      

Publish

  • 정식 version은 runway repo의 tag로 관리됨
  • pyproject.toml 파일의 version은 developer의 test를 위한 pseudo-version 임
  • local에서 publish test는 make command 사용
    # version patch, build & publish 한꺼번에 수행
    make publish-dev
    

How to test in local environment

  • sdk 개발시 local 에서 unit test 실행방식은 아래와 같습니다. utest 시에는 다양한 mlframework package 가 설치되니, 별도의 명령어보다는 makefile 의 recipe 를 사용하시기 바랍니다.
make utest
```bash

## How to develop
- sdk 개발을 위한 `python` 환경을 하나  생성합니다.
- edit 모드로 sdk를 설치 합니다.
```bash
pip install -e .
  • /etc/hosts에 minio관련 host를 추가합니다.
  • misc/gw.yaml, misc/vs.yaml을 수정하여 배포합니다.
  • prepare_develop.sh파일에 BACKEND_URL, MLFLOW_URL, MINIO_URL를 환경에 맞게 수정합니다.
  • prepare_develop.sh를 실행합니다.
./prepare_develop.sh
  • 실행
DEPLOY_TARGET=dev python examples/sample_log_model.py

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

mrx_runway-0.0.2410020632-cp39-cp39-win_amd64.whl (55.4 kB view details)

Uploaded CPython 3.9 Windows x86-64

mrx_runway-0.0.2410020632-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

mrx_runway-0.0.2410020632-cp39-cp39-macosx_10_15_x86_64.whl (927.5 kB view details)

Uploaded CPython 3.9 macOS 10.15+ x86-64

File details

Details for the file mrx_runway-0.0.2410020632-cp39-cp39-win_amd64.whl.

File metadata

File hashes

Hashes for mrx_runway-0.0.2410020632-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 077a6be6a43f1af470fa3858123de0930815510691f361773fa495265cc473a8
MD5 2c501e7e045e79c3774ffe24e4502002
BLAKE2b-256 bbd880c2021a7ae89a460dcd313b09072f5a15a0d76899846ff29a4b3bc2202c

See more details on using hashes here.

File details

Details for the file mrx_runway-0.0.2410020632-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for mrx_runway-0.0.2410020632-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0e435078cb7afbfc8d0921d973d94860c8b100080f3373c5ec36daee9303b372
MD5 f9b3049c5650667401442e2c8e94a3e4
BLAKE2b-256 808a213e12f8a5d092ad822101a4a6ebe7c9c8e550b52ba5076457f6a70f7446

See more details on using hashes here.

File details

Details for the file mrx_runway-0.0.2410020632-cp39-cp39-macosx_10_15_x86_64.whl.

File metadata

File hashes

Hashes for mrx_runway-0.0.2410020632-cp39-cp39-macosx_10_15_x86_64.whl
Algorithm Hash digest
SHA256 eb3b9f82fb5b9b62efc166b87652d484b7c478d964cbfa1b7da2cd4c7ad0500e
MD5 58ad5bc958d9e0b78abad083bbd62f09
BLAKE2b-256 6d9fb10afcbd86c5abdd01dbf743209fe87ccd960ff3652675b37f7e88116edf

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page