Skip to main content

A tool for monitoring model checkpoints and sending notifications

Project description

auto_model_monitor

监视模型训练时生成的权重文件,符合条件时发送QQ邮件通知。

使用场景

当你希望在模型训练过程中,当某个指标(例如验证集上的损失或准确率)低于/高于预设阈值时收到邮件通知。这有助于你及时了解模型的性能表现,以便进行必要的调整。

如何使用

安装依赖

pip install auto_model_monitor

获取QQ授权码

为了给QQ邮箱发送邮件,你需要使用授权码而不是密码。你可以在QQ邮箱的设置中找到它。

https://service.mail.qq.com/detail/0/75

Alt text

示例代码

上述配置后,你就可以使用代码了。

测试代码在tests/test.py

from auto_model_monitor import ModelMonitor, MonitorConfig, CustomParser

# 自定义解析器
parser = CustomParser(pattern=r'val_loss_([0-9.]+)_')

# 配置参数
config = MonitorConfig(
    watch_dir='./quicktest/logs',     # 监控的文件夹路径
    threshold=0.004,                  # 阈值
    sender='2109695291@qq.com',       # 发送邮箱
    receiver='2109695291@qq.com',     # 接收邮箱
    auth_code='xxxx',                 # 邮箱授权码
    check_interval=5,                 # 检查间隔 (秒)
    log_dir='model_monitor_logs',     # 日志文件夹路径
    comparison_mode='lower',          # 比较模式
    parser=parser                     # 使用自定义解析器
)

# 初始化并启动监控器
monitor = ModelMonitor(config)
monitor.start_monitoring()

当你的模型权重文件中的分数低于或高于阈值时,你将收到邮件通知。例如:

Alt text

开发日志

2025-07-04 更新:

  • 最初版本发布。

2025-07-05 更新:

  • 代码重构。如果你需要重构前的代码,在tests/quicktest中查看。
  • 代码打包,上传PyPI。
  • 由于model_monitor这个名字已经被占用,改为auto_model_monitor

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

auto_model_monitor-0.1.1.tar.gz (6.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

auto_model_monitor-0.1.1-py3-none-any.whl (7.4 kB view details)

Uploaded Python 3

File details

Details for the file auto_model_monitor-0.1.1.tar.gz.

File metadata

  • Download URL: auto_model_monitor-0.1.1.tar.gz
  • Upload date:
  • Size: 6.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.8.10

File hashes

Hashes for auto_model_monitor-0.1.1.tar.gz
Algorithm Hash digest
SHA256 46387bde5df2ab1fc3ad64afbeb218f4f47788cd1b7ff4cea1cd8377870c26c9
MD5 0ff3f213f392ded8d2a071650d274663
BLAKE2b-256 5898167d369736b575c16df775f2761e0175c6b134c4776a140fd212c246ff8d

See more details on using hashes here.

File details

Details for the file auto_model_monitor-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for auto_model_monitor-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8766a352dbfd730660f0880ef57194abede5db5c263310de3c1666d29a320002
MD5 980906967d0351bcd0b4cd109018e4b4
BLAKE2b-256 a99af03bf96d4b3cf22fbc5708da84fcb363f00938c60292d1c9829a35d79559

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page