Skip to main content

Custom GitHub Action Workflow Linter

Project description

Bitwarden Workflow Linter

Bitwarden's Workflow Linter is an extensible linter to apply opinionated organization-specific GitHub Action standards. It was designed to be used alongside yamllint to enforce specific YAML standards.

To see an example of Workflow Linter in practice in GitHub Action, see the composite Action.

Prerequisites

  • Python 3.13
  • pipenv
  • Windows systems: Chocolatey package manager
  • Mac OS systems: Homebrew package manager
  • pipx

[!NOTE] Python 3.12 is compatible but Python 3.13 is encouraged.

Setup

  1. Create the virtual environment:

    python3.13 -m venv /Users/$USER/bitwarden_workflow_linter_venv
    
  2. Activate the virtual environment:

    source /Users/$USER/bitwarden_workflow_linter_venv/bin/activate
    

Installation

From PyPI

This is the recommended method for most users. Installing from PyPI ensures you get the latest stable release and is the easiest way to install and update the package.

  1. Install Bitwarden Workflow Linter:

    pip install --upgrade bitwarden_workflow_linter
    
  2. Deactivate the virtual environment (optional):

    deactivate
    

Using pipx

Alternatively, you can install bwwl globally using pipx to keep it isolated:

  1. Install Bitwarden Workflow Linter:
    pipx install bitwarden_workflow_linter --python python3.13
    

This method is ideal for running bwwl as a standalone CLI tool without managing a virtual environment manually.

From GitHub Release

Use this method if you need a specific version of the package that is not yet available on PyPI, or if you want to access pre-release versions.

  1. Download the release tarball or zip file from GitHub:

    wget https://github.com/bitwarden/workflow-linter/archive/refs/tags/vX.Y.Z.tar.gz
    tar -xzf vX.Y.Z.tar.gz
    cd workflow-linter-X.Y.Z
    
  2. Install the package:

    pip install .
    
  3. Deactivate the virtual environment (optional):

    deactivate
    

Locally

This method is useful for developers who want to contribute to the project or need to make local modifications to the source code. Make sure to follow the virtual environment prerequisite setup

  1. Clone the repository:

    git clone git@github.com:bitwarden/workflow-linter.git
    cd workflow-linter
    
  2. Install the package:

    pip install -e .
    
  3. Deactivate the virtual environment (optional):

    deactivate
    

Usage

Setup settings.yaml

If a non-default configuration is desired (different than src/bitwarden_workflow_linter/default_settings.yaml), copy the below and create a settings.yaml in the directory that bwwl will be running from ( generally will be the root directory in CI).

enabled_rules:
    - id: bitwarden_workflow_linter.rules.name_exists.RuleNameExists
      level: error
    - id: bitwarden_workflow_linter.rules.name_capitalized.RuleNameCapitalized
      level: error
    - id: bitwarden_workflow_linter.rules.pinned_job_runner.RuleJobRunnerVersionPinned
      level: error
    - id: bitwarden_workflow_linter.rules.job_environment_prefix.RuleJobEnvironmentPrefix
      level: error
    - id: bitwarden_workflow_linter.rules.step_approved.RuleStepUsesApproved
      level: error
    - id: bitwarden_workflow_linter.rules.step_pinned.RuleStepUsesPinned
      level: error
    - id: bitwarden_workflow_linter.rules.underscore_outputs.RuleUnderscoreOutputs
      level: warning
    - id: bitwarden_workflow_linter.rules.run_actionlint.RunActionlint
      level: warning
    - id: bitwarden_workflow_linter.rules.check_pr_target.RuleCheckPrTarget
      level: error
    - id: bitwarden_workflow_linter.rules.permissions_exist.RulePermissionsExist
      level: warning

approved_actions_path: default_actions.json
default_branch: main

Command Line Usage

usage: bwwl [-h] [-v] {lint,actions} ...

positional arguments:
  {lint,actions}
    lint          Verify that a GitHub Action Workflow follows all of the Rules.
    actions       Add or Update Actions in the pre-approved list.

options:
  -h, --help      show this help message and exit
  -v, --verbose

Pre-commit Hook Setup

Navigate to the .git/hooks directory in the repository you wish to lint:

cd .git/hooks

Create the pre-commit file (if it does not already exist):

touch pre-commit

Make the script executable:

chmod +x pre-commit

Edit the pre-commit script:

Open the pre-commit file with your favorite text editor and add the following content, replacing /Users/$USER/bitwarden_workflow_linter_venv/bin/activate with the actual path to your virtual environment:

#!/bin/bash
set -e
# Activate the virtual environment
source "/Users/$USER/bitwarden_workflow_linter_venv/bin/activate"
# Get the repository root directory
repo_root=$(git rev-parse --show-toplevel)
# Run your Python script
bwwl lint -f "$repo_root/.github/workflows"
# Deactivate the virtual environment (optional)
deactivate

Test the Hook:

Try committing a change to the repository. The pre-commit hook should run the workflow linter.

Development

Setup

Refer to the Locally instructions above to clone the repository and install the package.

Testing

All built-in src/bitwarden_workflow_linter/rules should have 100% code coverage and we should shoot for an overall coverage of 80%+. We are lax on the imperative shell (code interacting with other systems; ie. disk, network, etc), but we strive to maintain a high coverage over the functional core (objects and models).

pipenv shell
pytest tests --cov=src

Code Reformatting

We adhere to PEP8 and use black to maintain this adherence. black should be run on any change being merged to main.

pipenv shell
black .

Linting

We loosely use Google's Python style guide, but yield to black when there is a conflict.

pipenv shell
pylint --rcfile pylintrc src/ tests/

Add a new Rule

A new Rule is created by extending the Rule base class and overriding the fn(obj: Union[Workflow, Job, Step]) method. Available attributes of Workflows, Jobs and Steps can be found in their definitions under src/models.

For a simple example, we'll take a look at enforcing the existence of the name key in a Job. This is already done by default with the src.rules.name_exists.RuleNameExists, but provides a simple enough example to walk through.

from typing import Union, Tuple

from ..rule import Rule
from ..models.job import Job
from ..models.workflow import Workflow
from ..models.step import Step
from ..utils import LintLevels, Settings


class RuleJobNameExists(Rule):
    def __init__(self, settings: Settings = None, lint_level: Optional[LintLevels] = LintLevels.ERROR) -> None:
        self.message = "name must exist"
        self.on_fail: LintLevels = lint_level
        self.compatibility: List[Union[Workflow, Job, Step]] = [Job]
        self.settings: Settings = settings

    def fn(self, obj: Job) -> Tuple[bool, str]:
        """<doc block goes here> """
        if obj.name is not None:
            return True, ""
        return False, self.message

By default, a new Rule needs five things:

  • self.message: The message to return to the user on a lint failure
  • self.on_fail: The level of failure on a lint failure (NONE, WARNING, ERROR). NONE and WARNING will exit with a code of 0 (unless using strict mode for WARNING). ERROR will exit with a non-zero exit code
  • self.compatibility: The list of objects this rule is compatible with. This is used to create separate instances of the Rule for each object in the Rules collection.
  • self.settings: In general, this should default to what is shown here, but allows for overrides
  • self.fn: The function doing the actual work to check the object and enforce the standard.

fn can be as simple or as complex as it needs to be to run a check on a single object. This linter currently does not support Rules that check against multiple objects at a time OR file level formatting (one empty between each step or two empty lines between each job).

IMPORTANT: A rule must be implemented and tested then merged into main before it can be activated. This is because the released version of bwwl will use the current settings.yaml file, but it will not have the new rule functionality yet and cause an error in the workflow linting of this repository.

To activate a rule after implementing and releasing it, add it to settings.yaml in the project's base folder and src/bitwarden_workflow_linter/default_settings.yaml to make the rule default.

Before creating a new rule please read the Workflow linter rule rollout process document in which you'll find the process for rolling out new workflow linter rules.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bitwarden_workflow_linter-2.1.4.tar.gz (116.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bitwarden_workflow_linter-2.1.4-py3-none-any.whl (56.0 kB view details)

Uploaded Python 3

File details

Details for the file bitwarden_workflow_linter-2.1.4.tar.gz.

File metadata

File hashes

Hashes for bitwarden_workflow_linter-2.1.4.tar.gz
Algorithm Hash digest
SHA256 060386c3c620930823b953c7e00d5c23cefeb7081eb17c7c2fa80da15b87a69a
MD5 baf08b872c0bd9644d71f21a5f784a12
BLAKE2b-256 45f8d02b984fd71027b527aaf382ff468b17910e365229b73e34a0906fe9c81a

See more details on using hashes here.

Provenance

The following attestation bundles were made for bitwarden_workflow_linter-2.1.4.tar.gz:

Publisher: cd.yml on bitwarden/workflow-linter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file bitwarden_workflow_linter-2.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for bitwarden_workflow_linter-2.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 fc5dd35747f8b73ce4506900c6158247441c81f24cf8109de125ca8912c60cba
MD5 e7cea1b4c607459edb383bece90fb52e
BLAKE2b-256 a285a777a7954e91801649e3fc8573e895ed04b4d14deff47fef1e0d37d37734

See more details on using hashes here.

Provenance

The following attestation bundles were made for bitwarden_workflow_linter-2.1.4-py3-none-any.whl:

Publisher: cd.yml on bitwarden/workflow-linter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page