Skip to main content

A small example package

Project description

Problem Statement

Data scientists code up a lot of pipelines that can often take a long time due to long pre-processing sequences or massive amounts of time required. And if errors occur, then the pipeline needs to be re-run. This means we usually want to be notified as early as possible if errors occurred.

So what is pipelinenotifier?

Pipeline notifier will send messages to your Slack/Discord/Keybase channel once you set up a webhook. Support can be added for more channels if desired. Feel free to ping me at jacky.wong@vctr.ai. It will send error messages so you can tell what is wrong the moment it happens.

Data Science Bots

As data scientists, you are running a lot of code over a large amount of time. This often means that that you want to be notified about things via mobile while you have applications running in the background.

I ended up re-writing this code across a number of organisations.

from pipelinenotifier import KeyBaseNotifier

with KeyBaseBot(, "<webhook_url>") as bot:
    # Insert training loop/reader here.
    score = 0.5
    bot.send_message(f"Scored {score}.")

If there is an error, it will send the error message to your channel.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jacky-tools-0.0.1.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

jacky_tools-0.0.1-py3-none-any.whl (5.6 kB view details)

Uploaded Python 3

File details

Details for the file jacky-tools-0.0.1.tar.gz.

File metadata

  • Download URL: jacky-tools-0.0.1.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.6.9

File hashes

Hashes for jacky-tools-0.0.1.tar.gz
Algorithm Hash digest
SHA256 d0b607b1f81cff0ee61b2f79a46764b947861547e94b5355f253fcf13f7c6d61
MD5 5eeb2346c55c11c0ecf2bc5c8f133b8c
BLAKE2b-256 48fabbb402d9ee0ac20b44f81623cdc1b26d66d8af9f08c641841b3a2a6debaa

See more details on using hashes here.

File details

Details for the file jacky_tools-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: jacky_tools-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 5.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.6.9

File hashes

Hashes for jacky_tools-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2417e4d06e35320a0f9cee803ee3c558c108534e8f0fa028d20ae78ffe9b0820
MD5 df4de2c8132a498d27fc4532dc48eccd
BLAKE2b-256 71babe3062f37fbe107631085e9d14b835cb8714b6b484de8f29cff6151efb97

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page