A small example package
Project description
Problem Statement
Data scientists code up a lot of pipelines that can often take a long time due to long pre-processing sequences or massive amounts of time required. And if errors occur, then the pipeline needs to be re-run. This means we usually want to be notified as early as possible if errors occurred.
So what is pipelinenotifier?
Pipeline notifier will send messages to your Slack/Discord/Keybase channel once you set up a webhook. Support can be added for more channels if desired. Feel free to ping me at jacky.wong@vctr.ai. It will send error messages so you can tell what is wrong the moment it happens.
Data Science Bots
As data scientists, you are running a lot of code over a large amount of time. This often means that that you want to be notified about things via mobile while you have applications running in the background.
I ended up re-writing this code across a number of organisations.
from pipelinenotifier import KeyBaseNotifier
with KeyBaseBot(, "<webhook_url>") as bot:
# Insert training loop/reader here.
score = 0.5
bot.send_message(f"Scored {score}.")
If there is an error, it will send the error message to your channel.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pipeline_notifier-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 705630f8389f26d562b48e32548d603df31599089540b96249c1f3769dd9aafe |
|
MD5 | 2b3635076cb1953c2c7d7ba1586b100c |
|
BLAKE2b-256 | 7543a6b142d048d268f3d235cb990c61d7f5a59015fd9020dfee8a59ce3787a7 |