Skip to main content

ignore failures from flaky tests (pytest plugin)

Project description

pytest-ignore-flaky

ignore failures from flaky tests (pytest plugin)

A “flaky” test is a test that usually pass but sometimes it fails. You should always avoid flaky tests but not always possible.

This plugin can be used to optionally ignore failures from flaky tests.

First “mark” your tests with the flaky marker:

import random
import pytest

@pytest.mark.flaky
def test_mf():
    assert 0 == random.randint(0, 1)

By default this mark is just ignored, unless the plugin is activated from the command line (or py.test config file):

py.test --ignore-flaky

If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a xfail.

Project Details

license

The MIT License Copyright (c) 2015 Eduardo Naufel Schettino

see LICENSE file

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest-ignore-flaky-0.1.0.tar.gz (3.7 kB view details)

Uploaded Source

File details

Details for the file pytest-ignore-flaky-0.1.0.tar.gz.

File metadata

File hashes

Hashes for pytest-ignore-flaky-0.1.0.tar.gz
Algorithm Hash digest
SHA256 7d2d534cd1b63486fc3f30f544c8ecaad7f52c92c3e0867cf3057fa29c44b5f2
MD5 bbf5c32b1a93ff5c47fec2020740cc51
BLAKE2b-256 238ed909ff59b70a6fecdf54e4dfc1a5eeedb71e3a96d212c180f545e3523856

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page