Skip to main content

A pytest plugin to test Arduino projects using pytest-embedded and arduino-cli

Project description

pytest-embedded-arduino-cli

日本語版 README

A pytest plugin to test Arduino projects using pytest-embedded and arduino-cli.

Overview

pytest-embedded-arduino-cli is a small plugin that keeps pytest-embedded's generic DUT / serial / expect flow and replaces Arduino-specific build and upload with arduino-cli.

This package does not depend on pytest-embedded-arduino. It is intended to stay generic enough to work well for Arduino projects beyond ESP32-specific assumptions.

Design

  • Build with arduino-cli compile
  • Upload with arduino-cli upload
  • Use pytest-embedded as the runtime foundation
  • Avoid EspSerial and ESP-specific flashing services
  • Resolve sketch settings from sketch.yaml and --profile
  • Treat the test file directory as the sketch directory

Setup

uv init
uv add pytest-embedded-arduino-cli
uv sync

Runtime dependencies include:

  • pytest
  • pytest-embedded
  • pytest-embedded-serial
  • PyYAML

Requirements

  • arduino-cli available in PATH
  • Installed Arduino board core(s)
  • A serial port accessible from the host when running hardware tests

Project Layout

The expected layout is one sketch directory per test app.

tests/
  my_app/
    sketch.yaml
    my_app.ino
    test_my_app.py

When pytest runs a specific .py file, this plugin treats that file's directory as the sketch directory. Build settings are resolved from the nearest sketch.yaml.

Usage

Build, upload, and run tests:

uv run pytest tests/my_app --port /dev/ttyACM0

Select an Arduino CLI profile from sketch.yaml:

uv run pytest tests/my_app --profile esp32s3 --port /dev/ttyACM0

Build only:

uv run pytest tests/my_app --run-mode=build

Upload and test against an already-built image:

uv run pytest tests/my_app --run-mode=test --port /dev/ttyACM0

--run-mode=test skips compile, reuses the existing build output, uploads it, and then runs the test.

Run this package's own tests:

uv run pytest

Main Options

  • --run-mode=all|build|test
  • --profile

Use pytest-embedded standard options for runtime control, such as:

  • --port
  • --flash-port
  • --baud
  • --embedded-services

pytest-embedded-serial is installed as a normal dependency so hardware tests can use the serial service without extra package installation. If --embedded-services is not specified, this plugin enables serial by default.

For profile-specific serial ports, the plugin resolves ports in this order:

  1. --flash-port
  2. --port
  3. TEST_SERIAL_PORT_<PROFILE>
  4. TEST_SERIAL_PORT

Example:

export TEST_SERIAL_PORT_ESP32S3=/dev/ttyUSB1
uv run pytest tests/my_app --profile esp32s3

If --profile is omitted, the plugin uses the resolved profile from sketch.yaml, including default_profile.

For compile-time defines, place a build_config.toml in the sketch directory:

[defines]
TEST_WIFI_SSID = "WIFI_SSID"
TEST_WIFI_PASSWORD = "WIFI_PASSWORD"

Here, the left side is the environment variable name and the right side is the C/C++ define name. For example, TEST_WIFI_SSID becomes -DWIFI_SSID="..." at compile time.

Set values before running pytest:

export TEST_WIFI_SSID=my-ssid
export TEST_WIFI_PASSWORD=my-password
uv run pytest tests/my_app

If an environment variable is missing, the plugin still passes the define with an empty string value. This allows the test or sketch code to decide how to handle missing settings.

For command visibility, follow pytest's standard verbosity:

  • -v shows the arduino-cli compile / arduino-cli upload command line
  • -vv also shows execution context such as cwd, sketch_dir, build_path, profile, and port

Example

def test_hello(dut):
    dut.expect_exact("hello from arduino")
void setup() {
  Serial.begin(115200);
  delay(1000);
  Serial.println("hello from arduino");
}

void loop() {}

Additional sample:

  • examples/wifi
    • Connects to Wi-Fi on ESP32/ESP32-S3
    • Includes uno as a skip example for a non-Wi-Fi profile
    • Expects TEST_WIFI_SSID and TEST_WIFI_PASSWORD
    • Verifies that the board prints WIFI_OK <ip-address>

What This Plugin Does Not Try To Be

  • A drop-in replacement for pytest-embedded-arduino
  • An ESP-specific flashing layer
  • A board auto-discovery tool

Future Extensions

  • Board-family-specific upload strategies
  • Smarter artifact discovery
  • Serial reset / monitor helpers
  • Multi-device support
  • Optional fqbn or sketch path overrides

Release

This repository uses GitHub Actions for releases.

Before triggering a release:

  • Update the ## Unreleased section in CHANGELOG.md
  • Make sure uv run pytest tests passes locally if needed

Release flow:

  1. Open GitHub Actions
  2. Run the Release workflow manually
  3. Enter the release version such as 0.1.0
  4. Choose whether to publish to PyPI

The workflow will:

  • Update versions in pyproject.toml and src/pytest_embedded_arduino_cli/__init__.py
  • Move CHANGELOG.md unreleased entries into ## <version>
  • Run tests and build the package
  • Commit the release changes and create tag v<version>
  • Create a GitHub Release
  • Publish to PyPI when enabled

PyPI publishing is configured for Trusted Publishing via GitHub Actions.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest_embedded_arduino_cli-0.2.0.tar.gz (21.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pytest_embedded_arduino_cli-0.2.0-py3-none-any.whl (10.1 kB view details)

Uploaded Python 3

File details

Details for the file pytest_embedded_arduino_cli-0.2.0.tar.gz.

File metadata

File hashes

Hashes for pytest_embedded_arduino_cli-0.2.0.tar.gz
Algorithm Hash digest
SHA256 395b6209856f1f29c1ab06c74cf1a0aeec3601c74d6ac389d5dfa5ba1a40feaf
MD5 cedf26c938ed2a2b76e3c3eeba08854b
BLAKE2b-256 59bf2c50939e968ac009d004ce3acc7a94c74b63a7df29981a1d458642ed515e

See more details on using hashes here.

Provenance

The following attestation bundles were made for pytest_embedded_arduino_cli-0.2.0.tar.gz:

Publisher: release.yml on tanakamasayuki/pytest-embedded-arduino-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pytest_embedded_arduino_cli-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for pytest_embedded_arduino_cli-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 585a9b2cc34a0fc6a70b7629a4843ec9ed4fc11e0dad23e03a99930a89c009b7
MD5 7ed88b3331355f210763975848720cc9
BLAKE2b-256 a43034e8a67d70a427f2316c382bf826e6f51461ceb23f68443ab65e73a79012

See more details on using hashes here.

Provenance

The following attestation bundles were made for pytest_embedded_arduino_cli-0.2.0-py3-none-any.whl:

Publisher: release.yml on tanakamasayuki/pytest-embedded-arduino-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page