W-Train Utils for MLflow Triton Plugin
Project description
w-train-utils-mlflow-triton-plugin
가상환경 설정
pyenv install 3.8.18
pyenv virtualenv 3.8.18 wtrainclient3.8
pyenv activate wtrainclient3.8
Triton Inference Server 실행
$ docker run --rm -p8000:8000 -p8001:8001 -p8002:8002 \
-e AWS_ACCESS_KEY_ID=<AccessKey> \
-e AWS_SECRET_ACCESS_KEY=<SecretKey> \
nvcr.io/nvidia/tritonserver:24.01-py3 \
tritonserver --model-repository=s3://https://kitech-minio-api.wimcorp.dev:443/triton \
--model-control-mode=explicit \
--log-verbose=1
환경 변수 설정
프로젝트를 실행하기 전에 아래의 환경 변수들을 설정해야 합니다:
환경변수 | 설명 | 예시 |
---|---|---|
MLFLOW_S3_ENDPOINT_URL | MLflow가 저장소로 사용하고있는 MinIO 엔드포인트 URL | http://localhost:9000 |
MLFLOW_TRACKING_URI | MLflow 트래킹 서버의 URI | http://localhost:5001 |
AWS_ACCESS_KEY_ID | MinIO 서버 접근을 위한 AWS 호환 액세스 키 | minio |
AWS_SECRET_ACCESS_KEY | MinIO 서버 접근을 위한 AWS 호환 시크릿 액세스 키 | miniostorage |
TRITON_URL | Triton Inference Server 의 엔드포인트 URL | http://localhost:8000 |
TRITON_MODEL_REPO | Triton Inference Server 의 모델저장소 URL | s3://http://localhost:9000/triton |
패키지 빌드 및 업로드
# 필요한 의존성 설치
pip install wheel setuptools twine
vi ~/.pypirc
[distutils]
index-servers =
pypi
pypi-repository
[pypi]
username = __token__
password = <token>
[pypi-repository]
repository: https://<domain>/repository/<pypi-hosted>/
username: <username>
password: <password>
sh scripts/build.sh
sh scripts/deploy.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for wtu-mlflow-triton-plugin-0.0.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 57374495b29d1f3b04afd7d1c5f90fca4f1a6e2854216e9a6257987f3804da55 |
|
MD5 | 2aed9b7211fdaafb95adff02ef91a073 |
|
BLAKE2b-256 | 8546bc78492b88fabe64e82272ea2a880c0a8ad35c495907e175611dd9adb193 |
Close
Hashes for wtu_mlflow_triton_plugin-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d23d6fba079dff264c6d75c41a17053204595bdd493150e108e4ff2f753b12a5 |
|
MD5 | c4e27b733bf1295f18e81b7cf8bc5aa6 |
|
BLAKE2b-256 | 8d39cfe69c92a3a4ca9b4e48c3a4af7767751864455238da7b8de9c10a66a17e |