xfail 1.1.0

Skip expected failures and raise error if unexpectedly passed

XFail provides a decorator function xfail to skip expected exceptions. Similar to unittest.skipIf, but xfail can specify which exception should be skipped, and raise if the decorated function is unexpectedly passed (only if strict is True).

Install

Supported python versions are: 2.7, 3.4, 3.5

Can be installed from PyPI by pip:

pip install xfail

Usage

xfail decorator

xfail accepts two arguments, exceptions and strict.

The first argument (exceptions) should be an Exception class to skip (Ex. Exception, AssertionError, and so on). If you want to skip multiple exceptions, use tuple of them, for example, @xfail((AssertionError, ValueError)).

The second argument strict should be a boolean. If strict is False (by default) and passed unexpectedly, raise unittest.SkipTest exception, which will mark the test is skipped. This case is very similar to the function is decorated by uniteest.skip function and the test will be counted as skipped.

If it is True and the decorated function did not raise (any of) the expected exception(s), XPassFailure exception would be raised. In this case, the test will be counted as fail.

from xfail import xfail

@xfail(IndexError)
def get(l, index):
    return l[index]

l = [1, 2, 3]
get(4)  # no error

Also supports multiple exceptions:

@xfail((IndexError, ValueError))
def a():
    '''This function passes IndexError and ValueError
    ...

In test script, similar to unittest.TestCase.assertRaises:

from unittest import TestCase
from xfail import xfail

class MyTest(TestCase):
    def test_1(self):
        @xfail(AssertionError)
        def should_raise_error():
            assert False
        a()  # test passes

    def test_2(self):
        @xfail(AssertionError, strict=True)
        def should_raise_error():
            assert True
        a()  # test failes, since this function should raise AssertionError

    # Can be used for test function
    @xfail(AssertionError, strict=True)
    def test_3(self)
        assert False

    # This test will fail
    @xfail(AssertionError, strict=True)
    def test_3(self)
        assert True

For more exapmles, see test_xfail.py.