fletchck 1.0.4

Machine monitor

fletchck

Fletchck is a self-contained network service monitor. It provides a suite of simple internet service checks with flexible scheduling provided by APScheduler. Service checks trigger notification actions as they transition from pass to fail or vice-versa. Configuration is via JSON file or an in-built web user interface.

The following anonymous checks are supported:

• smtp: SMTP with optional starttls
• submit: SMTP-over-SSL/Submissions
• imap: IMAP4-SSL mailbox
• https: HTTP request
• cert: Check TLS certificate validity and/or expiry
• ssh: SSH pre-auth connection with optional hostkey check
• sequence: A sequence of checks, fails if any one check fails

Service checks that use TLS will verify the service certificate and hostname unless the selfsigned option is set. If expiry of a self-signed certificate needs to be checked, use the cert check with selfsigned option.

The following notification actions are supported:

• email: Send an email
• sms: Post SMS via SMS Central API

Installation

Create a python virtual env, and install from pypi using pip:

$ python3 -m venv --system-site-packages venv
$ ./venv/bin/pip3 install fletchck

Setup

Create a new empty site configuration in the current directory with the -init option:

$ ./venv/bin/fletchck -init

Configuration

Configuration is read from a JSON encoded dictionary object with the following keys and values:

key	type	description
base	str	Full path to location of site configuration file
timezone	str	Time zone for notifications, schedules and interface
webui	dict	Web user interface configuration (see Web UI below)
actions	dict	Notification actions (see Actions below)
checks	dict	Service checks (see Checks below)

Notes:

• All toplevel keys are optional
• If webui is not present or null, the web user interface will not be started.
• Action and check names may be any string that can be used as a dictionary key and that can be serialised in JSON.
• Duplicate action and check names will overwrite earlier definitions with the same name.
• Timezone should be a zoneinfo key or null to use host localtime

Actions

Each key in the actions dictionary names a notification action dictionary with the following keys and values:

key	type	description
type	str	Action type, one of 'log', 'email' or 'sms'
options	dict	Dictionary of option names and values

The following action options are recognised:

option	type	description
hostname	str	Email submission hostname
url	str	API Url for SMS sending
port	int	TCP port for email submission
username	str	Username for authentication
password	str	Password for authentication
sender	str	Sender string
timeout	int	TCP timeout for email submission
recipients	list	List of recipient strings
site	str	Site identifier (default is Fletchck)

Checks

Each key in the checks dictionary names a service check with the following keys and values:

key	type	description
type	str	Check type: cert, smtp, submit, imap, https, ssh or sequence
trigger	dict	Trigger definition (see Scheduling below)
threshold	int	Fail state reported after this many failed checks
failAction	bool	Send notification action on transision to fail
passAction	bool	Send notification action on transition to pass
options	dict	Dictionary of option names and values (see below)
actions	list	List of notification action names
depends	list	List of check names this check depends on
data	dict	Runtime data and logs (internal)

Note that only the type is required, all other keys are optional. The following check options are recognised:

option	type	description
hostname	str	Hostname or IP address of target service
port	int	TCP port of target service
timeout	int	Socket timeout in seconds
timezone	str	Timezone for schedule and notification
selfsigned	bool	If set, TLS sessions will not validate service certificate
tls	bool	(smtp) If set, call starttls to initiate TLS
probe	str	(cert) send str probe to service after TLS negotiation
reqType	str	(https) Request method: HEAD, GET, POST, PUT, DELETE, etc
reqPath	str	(https) Request target resource
hostkey	str	(ssh) Target service base64 encoded public key
checks	list	(sequence) List of check names to be run in-turn

Unrecognised options are ignored by checks.

Example:

"checks": {
 "Home Cert": {
  "type": "cert",
  "passAction": false,
  "trigger": { "cron": {"day": 1, "hour": 1} },
  "options": { "hostname": "home.place.com", "port": 443 },
  "actions": [ "Tell Alice" ]
 }
}

Define a single check named "Home Cert" which performs a certificate verification check on port 443 of "home.place.com" at 1:00 am on the first of each month, and notifies using the action named "Tell Alice" on transition to fail.

Example Config

The following complete configuration describes a fletchck site with no web ui that runs a set of checks for a single site with a web site and SMTP, IMAP services behind a router. Router connectivity is checked every 5 minutes while the other services are checked in a sequence once per hour during the day. Failures of the router will trigger an sms, while service failures send an email.

{
 "actions": {
  "sms-admin": {
   "type": "sms",
   "options": { "recipient": "[phone]" }
  },
  "email-all": {
   "type": "email",
   "options": {
    "hostname": "mail.place.com",
    "sender": "[e-mail]",
    "recipients": [ "[e-mail]", "[e-mail]" ]
   }
  }
 },
 "checks": {
  "place-gateway": {
   "type": "ssh",
   "trigger": { "interval": { "minutes": 5 } },
   "options": { "hostname": "gw.place.com" },
   "actions": [ "sms-admin" ]
  },
  "place-svc": {
   "type": "sequence",
   "trigger": { "cron": { "hour": "9-17", "minute": "0" } },
   "options": { "checks": [ "place-email", "place-mbox", "place-web" ] },
   "actions": [ "email-all" ]
  },
  "place-email": {
   "type": "smtp",
   "options": { "hostname": "mail.place.com" },
   "depends": [ "place-gateway" ]
  },
  "place-mbox": {
   "type": "imap",
   "options": { "hostname": "mail.place.com" },
   "depends": [ "place-gateway" ]
  },
  "place-web": {
   "type": "https",
   "options": { "hostname": "place.com" }
  }
 }
}

Scheduling

Job scheduling is managed by APScheduler. Each defined check may have one optional trigger of type interval or cron.

Within the web interface, trigger schedules are entered using a plain text whitespace separated list of value/unit pairs.

An interval trigger with a 20 second jitter time and an explicit start:

interval 1 week 2 day 3 hr 5 min 15 sec 20 jitter 2025-06-15 start

A cron trigger with an explicit timezone:

cron 9-17 hr 20,40 min mon-fri weekday Australia/Adelaide z

Interval

The check is scheduled to be run at a repeating interval of the specified number of weeks, days, hours, minutes and seconds. Optionally provide a start time and jitter to adjust the initial trigger and add a random execution delay.

For example, a trigger that runs every 10 minutes with a 20 second jitter:

"interval": {
 "minutes": 10,
 "jitter": 20
}

Interval reference: apscheduler.triggers.interval

Cron

The configured check is triggered by UNIX cron style time fields (year, month, day, hour, minute, second etc). For example, to define a trigger that is run at 5, 25 and 45 minutes past the hour between 5am and 8pm every day:

"cron": {
 "hour": "5-20",
 "minute": "5,25,45"
}

Cron reference: apscheduler.triggers.cron

Web UI

The web user interface is configured with the webui key of the site config. The keys and values are as follows:

key	type	description
debug	bool	Include debugging information on web interface
cert	str	path to TLS certificate
key	str	path to TLS private key
host	str	hostname to listen on
port	int	port to listen on
name	str	site name displayed on header
base	str	path to configuration file
users	dict	authorised usernames and hashed passwords