Skip to main content

API watchdog

Project description

API Watchdog


api-watchdog discover path/to/test/files

Will output the abbreviated result of the tests to stdout.

api-watchdog discover --email path/to/test/files

Will email the results of the tests to the relevant addresses (as determined by the email_to= field of the test. Test results are grouped so that only one email per address is sent per run.

Whjen using the CLI, these environment variables must be set to email results

api-watchdog discover -o results_file.json path/to/test/files

Will serialize the WatchdogResultGroup object to the path specified by the -o flag.


API watchdog handles validation support through extra requirements. This means that to install it with TRAPI validation you invoke

pip install api-watchdog[TRAPI]

If you are using zsh you will run affoul of bracket globbing and should use

pip install 'api-watchdog[TRAPI]'

See this stackoverflow question for context.

Available extensions are:


If you do not want any validation support you can use the bare pip install api-watchdog command.

WatchdogTest format

The main way you'll interface with API Watchdog is through WatchdogTests. Each WatchdogTest has

  • name (str): The name of the test
  • target (url): The endpoint that the test targets
  • expectations (Array[Expectation]): A list of requirements that the response must meet for the test to pass.
  • payload (object): The json passed to the endpoint.

Expectation format

An Expectation describes where to find a piece of data in the response and what that piece of data should be in order for the test to pass. Each Expectation has

  • selector (jq program): A string describing a jq program that selects the one or more elements to test against
  • value (Any): a value to test equality against
  • validation_type (ValidationType): An API Watchdog validation type used to validate the value/response. The value/response will be implicitly converted to this type. For example, if you specify 'float' and the value is an integer it will be implicitly converted to a float.
  • level (Optional[ExpectationLevel]): How important an expectation is. Defaults to "critical"


One of the strings:

  • critical
  • warning
  • info Only "critical" expectations affect the success or failure of a WatchdogTest.

The selector format is a string that is a jq program. This allows for rich selection capabilities. For example:

      "selector": ".message.knowledge_graph.nodes[\"MONDO:0005148\"].name",
      "value": "type 2 diabetes mellitus",
      "validation_type": "string"

Is an Expectation that checks if a node is present in the knowledge graph of a TRAPI response.

The possible validation types are

  • "string",
  • "int",
  • "float",
  • "object",
  • "bool",
  • "null",
  • "trapi.knowledge_graph",
  • "trapi.node",
  • "trapi.edge",
  • "trapi.query_graph",
  • "trapi.q_node",
  • "trapi.q_edge",
  • "trapi.query_constraint",
  • "trapi.result",
  • "trapi.node_binding",
  • "trapi.edge_binding",
  • "trapi.message",
  • "trapi.query",
  • "trapi.response",
  • "trapi.async_query",
  • "trapi.operation",
  • "trapi.workflow",
  • "trapi.attribute",
  • "trapi.biolink_entity",
  • "trapi.biolink_predicate",
  • "trapi.curie",
  • "trapi.log_entry",
  • "trapi.log_level",
  • "trapi.meta_edge",
  • "trapi.meta_node",
  • "trapi.meta_knowledge_graph",
  • "trapi.meta_attribute"

What it is

An API monitoring utility that aspires to support:

  • Validation
  • Continuous Integration
  • Multiple input and output formats
  • Test discovery / minimal configuration

What it is not

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

api_watchdog-0.6.0.tar.gz (13.4 kB view hashes)

Uploaded source

Built Distribution

api_watchdog-0.6.0-py3-none-any.whl (15.0 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page