Skip to main content

WeData 3.0 MLflow Header Plugin

一个用于在MLflow请求中自动添加自定义header的插件(WeData 3.0 专用)。

功能

此插件会自动在所有MLflow tracking请求中添加以下header:

  • X-Target-Service-IP: 目标服务的IP地址
  • X-Target-Service-PORT: 目标服务的端口

安装

方式1: 从源码安装

cd wedata3-mlflow-header-plugin
pip install -e .

方式2: 使用pip安装

pip install wedata3-mlflow-header-plugin

配置

插件通过环境变量来配置header的值:

  • MLFLOW_TARGET_SERVICE_IP: 设置目标服务IP(默认: "127.0.0.1")
  • MLFLOW_TARGET_SERVICE_PORT: 设置目标服务端口(默认: "5000")
  • WEDATA_MLFLOW_HEADER_PLUGIN_DEBUG: 开启debug日志输出(默认关闭;可设置为 1/true/on

配置示例

# 设置环境变量
export MLFLOW_TARGET_SERVICE_IP="192.168.1.100"
export MLFLOW_TARGET_SERVICE_PORT="8080"
export WEDATA_MLFLOW_HEADER_PLUGIN_DEBUG="1"

# 运行你的MLflow代码
python your_mlflow_script.py

或者在Python代码中设置:

import os
os.environ["MLFLOW_TARGET_SERVICE_IP"] = "192.168.1.100"
os.environ["MLFLOW_TARGET_SERVICE_PORT"] = "8080"
os.environ["WEDATA_MLFLOW_HEADER_PLUGIN_DEBUG"] = "1"

import mlflow

# 现在所有MLflow请求都会包含这些header
mlflow.set_tracking_uri("http://your-mlflow-server:5000")
mlflow.start_run()
# ... your MLflow code ...
mlflow.end_run()

使用示例

安装插件后,无需额外代码,MLflow会自动使用此插件:

import mlflow

# 插件会自动添加header到所有请求
mlflow.set_tracking_uri("http://your-mlflow-server:5000")

with mlflow.start_run():
    mlflow.log_param("param1", 5)
    mlflow.log_metric("metric1", 0.85)

验证插件

你可以通过以下方式验证插件是否正常工作:

import mlflow
from mlflow.tracking.request_header.registry import resolve_request_headers

# 检查注册的header providers
headers = resolve_request_headers()
print("Request Headers:", headers)

Debug模式说明

当设置 WEDATA_MLFLOW_HEADER_PLUGIN_DEBUG=1(或 true/on)时,插件会在每次 request_headers() 被调用时输出调试日志到 stderr,内容包括:

  • 从哪些环境变量读取 header 值(以及默认值)
  • 最终返回给 MLflow 的 headers(对疑似敏感字段会做基础脱敏)

开发

项目结构

wedata3-mlflow-header-plugin/
├── pyproject.toml                    # 安装配置(uv_build)
├── README.md                         # 文档
└── src/
    └── wedata3_mlflow_header_plugin/
        ├── __init__.py               # 包初始化
        └── plugin.py                 # 插件实现

运行测试

pip install pytest
pytest tests/

工作原理

该插件利用MLflow的插件系统,实现了 RequestHeaderProvider 接口。通过在 pyproject.toml 中注册 mlflow.request_header_provider entry point,MLflow会自动发现并加载此插件。

每次MLflow发送HTTP请求时,都会调用插件的 request_headers() 方法,获取需要添加的header。

依赖

  • Python >= 3.10
  • mlflow >= 2.0.0

许可

MIT License

Release files for wedata3-mlflow-header-plugin 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for wedata3-mlflow-header-plugin 0.0.1
File Size Uploaded
wedata3_mlflow_header_plugin-0.0.1.tar.gz 4.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for wedata3-mlflow-header-plugin 0.0.1
File Interpreter ABI Platform
wedata3_mlflow_header_plugin-0.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 9.5 kB

Release files / wedata3_mlflow_header_plugin-0.0.1.tar.gz

Download URL wedata3_mlflow_header_plugin-0.0.1.tar.gz
Size 4.1 kB
Tags Source
SHA-256 checksum
How to use checksums
17c72993c33225682bc49320c004e1cffbc7187fdce78a3e3a6c6282548bb2c8
BLAKE2b-256 checksum
How to use checksums
f3d284ef7bdfd2c2e5be028f7f72e675518203f7db19249ff92f424049c35303
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.11

Release files / wedata3_mlflow_header_plugin-0.0.1-py3-none-any.whl

Download URL wedata3_mlflow_header_plugin-0.0.1-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0063b39cbf8d30886b0ed9515461d7a3198828c7e4cee995128fa7b6f8348098
BLAKE2b-256 checksum
How to use checksums
1dc73a356168f58762e119239684b39ec197e37b23ada1952091b74718db1db8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.11

Release history Release notifications | RSS feed

This release

0.0.1 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page