The Bitsmiths Monitor Package
Project description
BITSMITHS MONITOR
The monitor is a light weight orchestration package where a system requires batch jobs to be run on a recurring basis. The monitor uses a relational database to track which jobs are to be scheduled, running, and have completed.
The main features are:
- Create batch schedules on a minute, hour, day, week, month, or yearly cycle.
- Batch schedules can have dependencies on one another.
- Limit the amount of concurrent running jobs.
- Overload the main classes to customize the package for your needs.
- Supports ad-hoc running of batch jobs.
- Stores a full run history of all your batch jobs.
This product has a dependency on:
- Mettle (
bitsmiths-mettle
) - Bitsmiths Library (
bitsmiths-lib
)
Note that we package the generated Mettle code in this package, which means that the Mettle version required in this module is important.
Tables & Setup
Monitor is designed to use a relational database with a schema/namespace of monitor
in your database. You will need to create this schema manually.
It requires several other relational database tables.
The package provides the SQL code to create these tables. There are two ways to access the table creation SQL.
- You can run
bs-monitor -g postgresql
at the command line, this will print all the SQL tostdout
. - You can import the bs_monitor module and get the SQL as shown below:
import bs_monitor
print(bs_monitor.get_table_sql('postgresql'))
Note! Currently only postgresql SQL is added to the package. If you want us to support another database let us know and we will put it into the development pipeline.
Change History
2.1.3
Type | Description |
---|---|
Bug | Default job and runtime arguement generation was still using old C++ style, has been fixed. |
2.1.2
Type | Description |
---|---|
Bug | Fixed a bug where schedule batch jobs would not set or wait for their parent job. |
2.1.1
Type | Description |
---|---|
Bug | Fixed a typo bug in the job-runner, where any job that had a parent would cause it to raise an exception. |
Bug | Fixed a bug where the monitor-cli spawn job command would add its arguments to the spawned job. |
2.1.0
Type | Description |
---|---|
New | The python equivalent of the monitor is finally released. |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file bitsmiths-monitor-2.1.3.tar.gz
.
File metadata
- Download URL: bitsmiths-monitor-2.1.3.tar.gz
- Upload date:
- Size: 97.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.7.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 148d3e6cf3f9143e7edc90af9f3f8eeaea8841aef25e7bcae8fc5d8f47a7815b |
|
MD5 | 4a17e74b65d115bfc2952d292c6dd460 |
|
BLAKE2b-256 | 66ff24f79d90cfad11a163fdb9398ebd1909dd89ee27ca52b286ca776d4eb9b1 |
File details
Details for the file bitsmiths_monitor-2.1.3-py3-none-any.whl
.
File metadata
- Download URL: bitsmiths_monitor-2.1.3-py3-none-any.whl
- Upload date:
- Size: 316.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.7.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbb641137436a4e9e0f5bce4d3977f1e6cb6b4dab886e873ac106126134c6e9f |
|
MD5 | d16010b4057ecbf0aa749140860a770c |
|
BLAKE2b-256 | 6be282a332f98678e0d25a1e457d8467a3822775261cac1bdd6739adf5faf967 |