Skip to main content

Schedule pypyr pipelines with apscheduler

Project description

Logo

Schedule pypyr pipelines with apscheduler and control them via REST. The API interface is provided by connexion.

Travis (.org) Coveralls github Documentation Status GitHub

Documentation status

This documentation is in a very early stage and many things could be missing or wrong. Please rely on the code for now.

Install

Make a new venv, activate it, clone the repo, run pip install. No pypi release yet. We recommend using pipenv, which makes it easy to run commands inside a virtual env without the need to create or activate it:

pip install --user pipenv  # only needed once per python install
pipenv install
pipenv run server

Usage

pypyr-scheduler needs a shared secret between the server and the client. It reads it from the environment variable PYRSCHED_SECRET. If the server does not see a secret it generates it and writes it to its logfile for later use. If there is a secret set in the environment, it is used.

A client needs the same shared secret.

Development / Testing

Run pipenv run server. Now you can connect to the server with a suitable client. Currently available are pypyr-scheduler-cli and pypyr-scheduler-rpc-client with the first one depending on the latter.

Production deployment

TBD.

Documentation

Detailed documentaion is available on ReadTheDocs. It is generated from the docs/source folder in this repository. Feel free to send a PR is you find any typos.

Development

Run tests with pipen run tests.

Quick links

Related projects

pypyr is the workhorse underlying pypyr-scheduler. It runs pipelines defines as .yaml file and has many different pipeline steps included. Check it out, if you need a simple task automation for one-shot execution.

Flask-APScheduler provides a similar way to run job within flask as server. It even provides a REST-API. Try this if you don't need the functionality of pypyr.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pypyr-scheduler-server-2.0.5.tar.gz (8.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pypyr_scheduler_server-2.0.5-py3-none-any.whl (10.4 kB view details)

Uploaded Python 3

File details

Details for the file pypyr-scheduler-server-2.0.5.tar.gz.

File metadata

  • Download URL: pypyr-scheduler-server-2.0.5.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.1

File hashes

Hashes for pypyr-scheduler-server-2.0.5.tar.gz
Algorithm Hash digest
SHA256 85cd4f738ac39961d365f6397da10617ba0992c453609613a40d02e9aaeed9ad
MD5 5d90d93968b93c78608e1d52f2ba5a97
BLAKE2b-256 55b8bbaa5f77d089d938b94233fff69aedf3e1bb66941825a2f97af56aee373d

See more details on using hashes here.

File details

Details for the file pypyr_scheduler_server-2.0.5-py3-none-any.whl.

File metadata

  • Download URL: pypyr_scheduler_server-2.0.5-py3-none-any.whl
  • Upload date:
  • Size: 10.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.1

File hashes

Hashes for pypyr_scheduler_server-2.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 c4ee71c1f44db25ff479fac7335c003ecb8c4cdeaa422c77bab2d88a9d2ec0a1
MD5 91c5ef97d6d390b489f2423bcdad7777
BLAKE2b-256 1289e50600f8cfdfa18dc5bd725a7f48d6658dc69cd13468d2964e2dbb40cbe9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page