No project description provided
Project description
NB Workflows
[]
Description
If SQL is a lingua franca for querying data, Jupyter should be a lingua franca for data explorations, model training, and complex and unique tasks related to data.
This workflow platform allows to run parameterized notebooks programmatically. Notebooks could be scheduled with cron syntax, by intervals, run by n times, only once or in time ranges (from 10am to 18pm).
So, the notebook is the main UI and the workflow job description.
Goal
Empowering different data roles in a project to put code into production, simplifying the time required to do so. It enables people to go from a data exploration instance to an entirely pipeline deployed in production, using the same notebook file made by a data scientist, analyst or whatever role working with data in an iterative way.
How to run
# launch web process
# swagger by default: http://localhost:8000/docs/swagger
make web
# RQ Worker
make rqworker
# RQScheduler (optional)
make rqscheduler
Architecture
References & inspirations
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for nb_workflows-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1f1e5faaff734de68bf35d5dde52ec9b66e6ce5cc464fa62d3ce463d1d1d2c85 |
|
MD5 | 0b807318133a966a444f53c2209dfb87 |
|
BLAKE2b-256 | 2ee5672ad50298ad30e3bc46ac7d37438fd3675fde24aedae34ed845ba28472d |