pytest-f3ts

Use your pytest test plans with the FixturFab Test Executor!

Manage, Execute, and Support your Hardware Test Plan Deployments

Leverage the amazingness that is pytest and all of the community support to implement hardware tests for circuit boards, sub-assemblies and more!

Simply add the pytest-f3ts plugin and a config.yml test plan to your project and start executing your tests using the FixturFab Test Executor.

Installation

Install from PyPI with pip:

pip install pytest-f3ts

Or add it to a project managed with poetry:

poetry add pytest-f3ts

Documentation

See the docs for more information.

Development

Environment Setup

poetry is used for dependency management and pre-commit is used to identify simple issues before submission for code review. Once installed, run the following commands to setup your development environment:

poetry install
pre-commit install

Making changes

Use the following process when making changes to the module:

1. Create new test cases
2. Write new feature code and/or bugfixes
3. Write documentation for new features
4. Run pre-commit checks and tests prior to committing

To run the pre-commit checks, simply run the following:

poetry run pre-commit run --all-files

Git Commit Message Format

We use Conventional Commits for our commit messages. This allows us to automatically generate changelogs and version numbers.

Brief Overview:

• fix: - Fixes a bug
• feat: - Adds a new feature
• docs: - Updates documentation
• style: - Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
• refactor: - A code change that neither fixes a bug nor adds a feature
• perf: - A code change that improves performance
• test: - Adding missing tests or correcting existing tests
• chore: - Changes to the build process or auxiliary tools and libraries such as documentation generation
• ci: - Changes to our CI configuration files and scripts
• BREAKING CHANGE: - A commit that has a footer BREAKING CHANGE:, or appends a ! after the type/scope, introduces a breaking API change (correlating with MAJOR in semantic versioning).

Code Quality Tools

black

black is used for code formatting, this is configured within pyproject.toml

To run black manually, run:

poetry run black .

flake8

flake8 is used to enforce additional style guidelines.

To run flake8 manually, run:

poetry run flake8 ./pytest_f3ts

isort

isort is used to automatically reformat python module import statements.

To run isort manually, run:

poetry run isort .

pre-commit

To automatically check if code is ready to be committed and pushed to Gitlab pre-commit is used. This is configured via the .pre-commit-config.yml file.

To run pre-commit manually, run:

poetry run pre-commit run --all-files

Documentation Generation

mkdocs is utilized along with mkdocs-material to generate documentation for this project.

The docs directory contains the general structure for the documentation in the form of markdown files. To autogenerate additional documentation from docstrings, the mkdocstrings module is used.

Developing documentation with the live server

When creating additional documentation it's useful to run the mkdocs server which will live-reload the webpages as you make changes. To start this server, run the following in a terminal:

poetry run mkdocs serve

Adding a new file for autodocumentation

To add a new python file to the autodocumentation, open the docs/reference.md file. Add a new header to the file, and then add the line ::: pytest_f3ts.{new_file_name}, this will signal to mkdocstrings to process the new file when building the documentation

Manually building and uploading a wheel

poetry config repositories.pytest-f3ts https://us-west1-python.pkg.dev/test-runner-404519/pytest-f3ts/

# On windows you will need to run the following command as two separate commands
# and paste the token into the password prompt for the second command.
gcloud auth print-access-token | poetry config http-basic.pytest-f3ts oauth2accesstoken

poetry publish --repository pytest-f3ts --build

Pipeline Setup

The pipeline is configured via the .gitlab-ci.yml file. The pipeline is configured to run the following stages:

• linting: Runs the black and isort checks (flake8 runs locally via pre-commit)
  • Occurs on all merge requests and is required to pass before a merge request can be merged
• version: Runs the gen-semver.py command to update the version number
  • Occurs on the main branch after a merge request is accepted, and creates a new tag
• build: Builds the wheel and publishes it to both the Google Cloud Artifact Registry and PyPI
  • Triggered by new tags, which are created by the version stage