Skip to main content

The Bitsmiths Monitor Package

Project description

BITSMITHS MONITOR

The monitor is a light weight orchestration package where a system requires batch jobs to be run on a recurring basis. The monitor uses a relational database to track which jobs are to be scheduled, running, and have completed.

The main features are:

  • Create batch schedules on a minute, hour, day, week, month, or yearly cycle.
  • Batch schedules can have dependencies on one another.
  • Limit the amount of concurrent running jobs.
  • Overload the main classes to customize the package for your needs.
  • Supports ad-hoc running of batch jobs.
  • Stores a full run history of all your batch jobs.

This product has a dependency on:

  • Mettle (bitsmiths-mettle)
  • Bitsmiths Library (bitsmiths-lib)

Note that we package the generated Mettle code in this package, which means that the Mettle version required in this module is important.

Tables & Setup

Monitor is designed to use a relational database with a schema/namespace of monitor in your database. You will need to create this schema manually. It requires several other relational database tables.

The package provides the SQL code to create these tables. There are two ways to access the table creation SQL.

  1. You can run bs-monitor -g postgresql at the command line, this will print all the SQL to stdout.
  2. You can import the bs_monitor module and get the SQL as shown below:
import bs_monitor

print(bs_monitor.get_table_sql('postgresql'))

Note! Currently only postgresql SQL is added to the package. If you want us to support another database let us know and we will put it into the development pipeline.

Change History

2.1.5

Type Description
Bug Fixed a monitor manager crash when handling database lock timeouts, introduced by the mettle refactor.

2.1.4

Type Description
Bug Fixed a crash when using monthly or yearly monitor intervals.

2.1.3

Type Description
Bug Default job and runtime arguement generation was still using old C++ style, has been fixed.

2.1.2

Type Description
Bug Fixed a bug where schedule batch jobs would not set or wait for their parent job.

2.1.1

Type Description
Bug Fixed a typo bug in the job-runner, where any job that had a parent would cause it to raise an exception.
Bug Fixed a bug where the monitor-cli spawn job command would add its arguments to the spawned job.

2.1.0

Type Description
New The python equivalent of the monitor is finally released.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bitsmiths-monitor-2.1.5.tar.gz (97.9 kB view details)

Uploaded Source

Built Distribution

bitsmiths_monitor-2.1.5-py3-none-any.whl (316.7 kB view details)

Uploaded Python 3

File details

Details for the file bitsmiths-monitor-2.1.5.tar.gz.

File metadata

  • Download URL: bitsmiths-monitor-2.1.5.tar.gz
  • Upload date:
  • Size: 97.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.7.9

File hashes

Hashes for bitsmiths-monitor-2.1.5.tar.gz
Algorithm Hash digest
SHA256 77a2a9aa4aad4a936efb23f7802897166d9fb811ccdf587ef4034f5d1ff3ca76
MD5 a7cfd681fdaecc1b1aa173ee9d32d7c6
BLAKE2b-256 c45846bd349b31f0514e75da45e20fe1ec620e60fdeacea48c1ce18f2b17cf14

See more details on using hashes here.

File details

Details for the file bitsmiths_monitor-2.1.5-py3-none-any.whl.

File metadata

  • Download URL: bitsmiths_monitor-2.1.5-py3-none-any.whl
  • Upload date:
  • Size: 316.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.7.9

File hashes

Hashes for bitsmiths_monitor-2.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 7fa36c9ad541f6b661550c0b8925e4182c569b7a860fa5dbde078527beae633f
MD5 cd1b00d37b3494e93f9121449615d923
BLAKE2b-256 695a6251bed3e7a7353f86f08fc0a3624d767b7665a56b896ccded81824c5aa1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page