Skip to main content

Framework for automating tests involving hardware test fixtures.

Project description

Documentation Status Build status MIT license Supported Python Versions Pypi Release Version Sonarcloud Quality Gate Sonarcloud coverage Sonarcloud bugs

Warning

Nanaimo is evolving rapidly right now. We will signal its readiness for alpha integrations by bumping the version number to 0.1.x. For now we provide this repo to let you follow along and comment but we suggest you hold off relying on any version < 0.1.x.

A delicious Nanaimo bar

A delicious Python treat that makes on-target testing sweet and satisfying.

Nanaimo is a set of utilities and plugins designed to enable integration of hardware test apparatuses with pytest. This can allow on-target tests to run as part of continuous integration pipelines like Buildkite, Bamboo, or Jenkins.

S32K evaluation boards attached to Raspberry PIs.

Example of S32K dev boards attached to Raspberry PI CI workers running the Buildkite agent and using Nanaimo.

Nanaimo is designed to enable testing of software-defined, physical components in isolation to provide pre-integration verification of software interfaces and behavioral contracts. It adapts asynchronous control and monitoring of these components to fit familiar testing idioms (e.g. x-unit testing) using the popular python test framework, pytest.

Block diagram of Nanaimo's relationship to other components of a typical software build and test pipeline.

Block diagram of Nanaimo’s relationship to other components of a typical software build and test pipeline.

Nanaimo is not a simulation framework and is not designed to support the complexity of a full hardware-in-the-loop platform. Instead it’s focused on testing small integrations with a few hardware components and instruments using concepts, syntax, and frameworks familiar to software engineers. Examples of these small integrations might include verifying a SPI driver for a microcontroller or ensuring the upload time for a serial bootloader meets expected Key-Performance-Indicators (KPIs). To do this Nanaimo abstractions provide async interfaces to hardware either directly using available communication protocols (e.g. serial or IP networks) or by invoking a CLI provided by the instrument vendor. Because of this latter use case some instruments will require additional programs be available in a test environment.

Example scenario using Nanaimo to test an I2C driver for a microcontroller.

Example scenario using Nanaimo to test an I2C driver for a microcontroller.

This design is an amalgam of the TLYF (Test Like You Fly) methodology and the Swiss cheese model of failure analysis. Specifically; Nanaimo facilitates testing on actual or representative hardware for the first integration of software into a part or subassembly. Traditionally software engineers were responsible only for unit-testing and Software-In-the-Loop (SIL) simulation of their code. Nanaimo encourages software engineers to also provide hardware integration tests by enabling Hardware-In-the-Loop continuous-integration (HIL-CI, perhaps?).

Hierarchy of system testing.

Hierarchy of system testing. Nanaimo focuses on part and subassembly testing.

Note

Nanaimo is named after Nanaimo bars which are about the best things humans have ever invented.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for nanaimo, version 0.0.15
Filename, size File type Python version Upload date Hashes
Filename, size nanaimo-0.0.15-16-py3-none-any.whl (29.7 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size nanaimo-0.0.15.tar.gz (26.3 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page