Skip to main content

Too many faillure, less tests.

Project description

Pytest covid.

When you do testing to that extent, you're going to find more people, you're going to find more cases. So I said to my people, slow the testing down — please.

The more failures you get, the more tests it will skip.

# pytest.ini
[pytest]
[covid]
enabled = True
fake_news = False

Or if you like Fox News set fake_news = True and test failures will be reported as success.

test failure contamination

For each test failure, 4% of the remaining tests will randomly fail (they get contaminated), and 1% will be skipped. The effect compounds, so a contaminated test, will contaminate more tests and skip even more. Even with fake_news=True, except a failing test will appear to be passing.

Example:

Running 500 test with a 1% change of failing:

tests/test_covid.py ...........F.........s...............F.....s..sF...s....FsF..F.sFFs....sFs...s..F [ 16%]
FFsFFFssFsFss.s..sFFsFssssFFssssFs.sFssssss.sFss.sssss.sss.sss.sFsFssssssssFsssFssssss.sssssFssFsssss [ 36%]
ssssssssssssssssssssssssssss.sss.sssss.ss.ssssssFsFssssssFsssssssFsssssssssssssFFsssFssssssssFsFsFsFs [ 56%]
sssssFsssFssssFssssssssssssFssssssssssssFFsssssssssssssssFsssssssssssFssssssssssssssssssssssss.ssssss [ 76%]
ssssssFssssssssssssssssssssssFssssssFsssssssssssFssssssssssssssssFsssssssssssssssssssFssssssssssssFs. [ 97%]
sssssssssssssss

Same while watching Fox News, or if you believe you'll safe in church:

tests/test_covid.py .....................s....ss..........sssssss.s..s......ss.....s...sss.sss...ss.s [ 16%]
s.s.s..s.ss.s...s..s.s.ss.ss..ssss.s..sssssssssss.ss..sss.sss..s.s.sssssss.s.ss.ss.ssssss.ssss...s..s [ 36%]
ss.ss.ssss.ss...s.sssssss.sssssssssssssssssssssssss.ssss.ssssssssssssssssssssss.ssssssssssssssss.ssss [ 56%]
sssssssssssssssss.ssssssssssssssss.sssssssss.ssssssssssssssssssssssss.s.sssssssssssssssssssssssssss.s [ 76%]
sssssss.ssssssssssssssss.sssss.sssss.sssssssssssssssssssssssssssssssssssssssssss.sssssss.ssssss.sssss [ 97%]
ssssssssssssss

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest_covid-0.0.5.tar.gz (3.2 kB view hashes)

Uploaded Source

Built Distribution

pytest_covid-0.0.5-py3-none-any.whl (3.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page