Skip to main content

Schedule pypyr pipelines with apscheduler

Project description

Logo

Schedule pypyr pipelines with apscheduler and control them via REST. The API interface is provided by connexion.

Travis (.org) Coveralls github Documentation Status GitHub

Documentation status

This documentation is in a very early stage and many things could be missing or wrong. Please rely on the code for now.

Install

Make a new venv, activate it, clone the repo, run pip install. No pypi release yet. We recommend using pipenv, which makes it easy to run commands inside a virtual env without the need to create or activate it:

pip install --user pipenv  # only needed once per python install
pipenv install
pipenv run server

Usage

pypyr-scheduler needs a shared secret between the server and the client. It reads it from the environment variable PYRSCHED_SECRET. If the server does not see a secret it generates it and writes it to its logfile for later use. If there is a secret set in the environment, it is used.

A client needs the same shared secret.

Development / Testing

Run pipenv run server. Now you can connect to the server with a suitable client. Currently available are pypyr-scheduler-cli and pypyr-scheduler-rpc-client with the first one depending on the latter.

Production deployment

TBD.

Documentation

Detailed documentaion is available on ReadTheDocs. It is generated from the docs/source folder in this repository. Feel free to send a PR is you find any typos.

Development

Run tests with pipen run tests.

Quick links

Related projects

pypyr is the workhorse underlying pypyr-scheduler. It runs pipelines defines as .yaml file and has many different pipeline steps included. Check it out, if you need a simple task automation for one-shot execution.

Flask-APScheduler provides a similar way to run job within flask as server. It even provides a REST-API. Try this if you don't need the functionality of pypyr.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pypyr-scheduler-server-2.0.7.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

pypyr_scheduler_server-2.0.7-py3-none-any.whl (10.4 kB view details)

Uploaded Python 3

File details

Details for the file pypyr-scheduler-server-2.0.7.tar.gz.

File metadata

  • Download URL: pypyr-scheduler-server-2.0.7.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.1

File hashes

Hashes for pypyr-scheduler-server-2.0.7.tar.gz
Algorithm Hash digest
SHA256 761027d191d9a245a4aaf0213faa9226a376d484cdcc3f89846543e673482e19
MD5 6d30b377ecab802f1915d49c92e362ce
BLAKE2b-256 f886098c822e6ef6990f277339e1e97bbc884a0b6c7c830a7dff195bcaf1e475

See more details on using hashes here.

File details

Details for the file pypyr_scheduler_server-2.0.7-py3-none-any.whl.

File metadata

  • Download URL: pypyr_scheduler_server-2.0.7-py3-none-any.whl
  • Upload date:
  • Size: 10.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.1

File hashes

Hashes for pypyr_scheduler_server-2.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 f91d2de7aba01eba613eed9433e2a5f57e6cced3c762ee91d57d475151e5e310
MD5 9d74448519fc36f8e3dafd1f5dbc6bd2
BLAKE2b-256 02800b507c9771ad021ee4077ad0bef6309380c3bd6b1f88bfc3be6794fed833

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page