A small example package
Project description
Problem Statement
Data scientists code up a lot of pipelines that can often take a long time due to long pre-processing sequences or massive amounts of time required. And if errors occur, then the pipeline needs to be re-run. This means we usually want to be notified as early as possible if errors occurred.
So what is pipelinenotifier?
Pipeline notifier will send messages to your Slack/Discord/Keybase channel once you set up a webhook. Support can be added for more channels if desired. Feel free to ping me at jacky.wong@vctr.ai. It will send error messages so you can tell what is wrong the moment it happens.
Data Science Bots
As data scientists, you are running a lot of code over a large amount of time. This often means that that you want to be notified about things via mobile while you have applications running in the background.
I ended up re-writing this code across a number of organisations.
from pipelinenotifier import KeyBaseNotifier
with KeyBaseBot(, "<webhook_url>") as bot:
# Insert training loop/reader here.
score = 0.5
bot.send_message(f"Scored {score}.")
If there is an error, it will send the error message to your channel.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file jacky-tools-0.0.1.tar.gz
.
File metadata
- Download URL: jacky-tools-0.0.1.tar.gz
- Upload date:
- Size: 3.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.6.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0b607b1f81cff0ee61b2f79a46764b947861547e94b5355f253fcf13f7c6d61 |
|
MD5 | 5eeb2346c55c11c0ecf2bc5c8f133b8c |
|
BLAKE2b-256 | 48fabbb402d9ee0ac20b44f81623cdc1b26d66d8af9f08c641841b3a2a6debaa |
File details
Details for the file jacky_tools-0.0.1-py3-none-any.whl
.
File metadata
- Download URL: jacky_tools-0.0.1-py3-none-any.whl
- Upload date:
- Size: 5.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.6.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2417e4d06e35320a0f9cee803ee3c558c108534e8f0fa028d20ae78ffe9b0820 |
|
MD5 | df4de2c8132a498d27fc4532dc48eccd |
|
BLAKE2b-256 | 71babe3062f37fbe107631085e9d14b835cb8714b6b484de8f29cff6151efb97 |