Skip to main content

The Bitsmiths Monitor Package

Project description

BITSMITHS MONITOR

The monitor is a light weight orchestration package where a system requires batch jobs to be run on a recurring basis. The monitor uses a relational database to track which jobs are to be scheduled, running, and have completed.

The main features are:

  • Create batch schedules on a minute, hour, day, week, month, or yearly cycle.
  • Batch schedules can have dependencies on one another.
  • Limit the amount of concurrent running jobs.
  • Overload the main classes to customize the package for your needs.
  • Supports ad-hoc running of batch jobs.
  • Stores a full run history of all your batch jobs.

This product has a dependency on:

  • Mettle (bitsmiths-mettle)
  • Bitsmiths Library (bitsmiths-lib)

Note that we package the generated Mettle code in this package, which means that the Mettle version required in this module is important.

Tables & Setup

Monitor is designed to use a relational database with a schema/namespace of monitor in your database. You will need to create this schema manually. It requires several other relational database tables.

The package provides the SQL code to create these tables. There are two ways to access the table creation SQL.

  1. You can run bs-monitor -g postgresql at the command line, this will print all the SQL to stdout.
  2. You can import the bs_monitor module and get the SQL as shown below:
import bs_monitor

print(bs_monitor.get_table_sql('postgresql'))

Note! Currently only postgresql SQL is added to the package. If you want us to support another database let us know and we will put it into the development pipeline.

Change History

2.1.4

Type Description
Bug Fixed a crash when using monthly or yearly monitor intervals.

2.1.3

Type Description
Bug Default job and runtime arguement generation was still using old C++ style, has been fixed.

2.1.2

Type Description
Bug Fixed a bug where schedule batch jobs would not set or wait for their parent job.

2.1.1

Type Description
Bug Fixed a typo bug in the job-runner, where any job that had a parent would cause it to raise an exception.
Bug Fixed a bug where the monitor-cli spawn job command would add its arguments to the spawned job.

2.1.0

Type Description
New The python equivalent of the monitor is finally released.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bitsmiths-monitor-2.1.4.tar.gz (97.8 kB view hashes)

Uploaded Source

Built Distribution

bitsmiths_monitor-2.1.4-py3-none-any.whl (316.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page