Skip to main content

Automatic retry for failed Behave scenarios — tag overrides, exception filtering, flakiness stats

Project description

behave-retry

CI PyPI Python License Coverage

Automatic retry for failed Behave scenarios — real re-execution, tag overrides, exception filtering, and flakiness stats.

Why?

Behave has no built-in retry. When a scenario fails due to flakiness (timing, network, race conditions), there's no way to re-run it automatically. Cucumber has --retry natively. Behave doesn't.

behave-retry fills that gap by patching Behave's Scenario.run to re-execute failed scenarios automatically — with tag overrides, exception filtering, and flakiness stats.

Table of contents

Install

pip install behave-retry

For development:

pip install -e ".[dev]"

Quick start

# environment.py
from behave_retry import setup_retry, after_scenario_hook, retry_report

def before_all(context):
    setup_retry(context, max_retries=3)

def after_scenario(context, scenario):
    after_scenario_hook(context, scenario)

def after_all(context):
    print(retry_report(context))

That's it. Failed scenarios will now be re-executed up to 3 times automatically.

Features

Global retry

setup_retry(context, max_retries=3)

Retry every failed scenario up to 3 times.

Tag-filtered retry

setup_retry(context, max_retries=3, retry_tags=["@flaky"])

Only retry scenarios tagged with @flaky.

@flaky
Scenario: Login with slow network
  Given the server is slow
  ...

Exception-filtered retry

setup_retry(
    context,
    max_retries=3,
    retry_on=[AssertionError, TimeoutError],
)

Only retry when the scenario fails with specific exception types. Subclasses of the listed exceptions also match.

Per-scenario override

Override the global retry count per scenario using the @retry:N tag:

@retry:5
Scenario: Very flaky test
  ...

@retry:0
Scenario: Never retry this
  ...

The first @retry:N tag wins. @retry:0 disables retry for that scenario.

Retry stats

from behave_retry import retry_report

def after_all(context):
    report = retry_report(context)
    print(report)

Output:

Retry Summary:
  Total retries: 5
  Scenarios retried: 3
  Passed on retry: 2
  Failed after retry: 1

  - "Login with invalid credentials" — 3 attempts, failed (AssertionError)
  - "Search products" — 2 attempts, passed
  - "Checkout flow" — 2 attempts, passed

API reference

setup_retry(context, max_retries=0, retry_tags=None, retry_on=None)

Configure retry on the behave context. Call this in before_all. This patches behave.model.Scenario.run to re-execute failed scenarios automatically.

Parameter Type Default Description
context Any Behave context object
max_retries int 0 Maximum retries per scenario (0 = no retry)
retry_tags list[str] | None None Only retry scenarios with these tags
retry_on list[type[Exception]] | None None Only retry on these exception types

after_scenario_hook(context, scenario)

Track retry attempts. Call this in after_scenario. The actual retry loop is handled automatically by the Scenario.run patch installed by setup_retry.

retry_report(context) -> str

Get a human-readable retry summary. Call this in after_all.

RetryConfig

Frozen dataclass for configuration.

Attribute Type Default Description
max_retries int 0 Maximum retries per scenario (must be >= 0)
retry_tags list[str] [] Tag filter (empty = retry all)
retry_on list[type[Exception]] [] Exception filter (empty = retry on any)

Methods:

  • should_retry_tag(tags) -> bool — Check if scenario tags allow retry
  • should_retry_exception(exc) -> bool — Check if exception type allows retry
  • get_scenario_retries(tags) -> int — Get max retries for a scenario, checking @retry:N override

RetryStats

Aggregate retry statistics.

Property Type Description
total_retries int Total retry attempts across all scenarios
scenarios_retried list[ScenarioRetry] Per-scenario retry records
scenarios_passed_on_retry int Scenarios that passed after retry
scenarios_failed_after_retry int Scenarios that still failed after retry

Methods:

  • add_retry(scenario, attempts, final_status, exceptions) -> None — Record a new retry
  • update_retry(scenario, attempts, final_status, exceptions) -> None — Update existing or create new
  • summary() -> str — Human-readable summary
  • to_dict() -> dict — Serialize to a dictionary for CI/CD reporting

ScenarioRetry

Record of retry attempts for a single scenario.

Attribute Type Description
scenario str Scenario name
attempts int Total attempts (including first run)
final_status str "passed" or "failed"
exceptions list[str] Exception types encountered
Property Description
was_retried True if retried at least once
passed_on_retry True if passed after retry

Methods:

  • to_dict() -> dict — Serialize to a dictionary for CI/CD reporting

parse_retry_tag(tags) -> int | None

Parse @retry:N tag from scenario tags. Returns N if found, None otherwise. Also available as behave_retry.parse_retry_tag.

Configuration

Python version

behave-retry requires Python 3.11+.

Dependencies

Zero required dependencies. behave is only needed as a dev dependency for running tests.

Linting and formatting

The project uses Ruff with the following rule sets: E, F, W, I, N, UP, B, SIM.

ruff check .

Testing

pytest tests/ -v --cov

Coverage threshold is 90%.

Examples

Full environment.py

from behave_retry import setup_retry, after_scenario_hook, retry_report

def before_all(context):
    setup_retry(
        context,
        max_retries=3,
        retry_tags=["@flaky"],
        retry_on=[AssertionError, TimeoutError],
    )

def after_scenario(context, scenario):
    after_scenario_hook(context, scenario)

def after_all(context):
    print(retry_report(context))

Feature file with retry tags

@flaky
@retry:5
Feature: Flaky scenarios

  @retry:0
  Scenario: Never retry this
    Given a stable condition
    Then it should pass

  Scenario: Retry up to 5 times
    Given a flaky condition
    Then it might fail

Contributing

Contributions are welcome! See CONTRIBUTING.md for guidelines.

License

MIT — Copyright (c) 2026 Mathias Paulenko

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

behave_retry-1.1.0.tar.gz (18.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

behave_retry-1.1.0-py3-none-any.whl (9.9 kB view details)

Uploaded Python 3

File details

Details for the file behave_retry-1.1.0.tar.gz.

File metadata

  • Download URL: behave_retry-1.1.0.tar.gz
  • Upload date:
  • Size: 18.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for behave_retry-1.1.0.tar.gz
Algorithm Hash digest
SHA256 6c1754e0ff170eef54f9df82bb1748b28196bd93e5af2ca8d36d0a645b79f5d1
MD5 f3ce364a8aa9a72f689b6bbf7954e880
BLAKE2b-256 6706916c3efaede3f5ad3b87f048b92864d965ccdf1cbeaef06eb65750601fa3

See more details on using hashes here.

Provenance

The following attestation bundles were made for behave_retry-1.1.0.tar.gz:

Publisher: release.yml on MathiasPaulenko/behave-retry

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file behave_retry-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: behave_retry-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 9.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for behave_retry-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 82f01e28904aea0892754cfa38d2bf793cbb8f899e1f47de35c93bd1cdeaaf26
MD5 24519c66ed0ad3ee88f4ba898428010c
BLAKE2b-256 f795b210162f96601ddb634afaca99a5795e1c2f7aed18de279d8204686997b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for behave_retry-1.1.0-py3-none-any.whl:

Publisher: release.yml on MathiasPaulenko/behave-retry

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page