Skip to main content

Too many faillure, less tests.

Project description

Pytest covid.

When you do testing to that extent, you're going to find more people, you're going to find more cases. So I said to my people, slow the testing down — please.

The more failures you get, the more tests it will skip.

# pytest.ini
[pytest]
[covid]
enabled = True
fake_news = False

Or if you like Fox News set fake_news = True and test failures will be reported as success.

test failure contamination

For each test failure, 4% of the remaining tests will randomly fail (they get contaminated), and 1% will be skipped. The effect compounds, so a contaminated test, will contaminate more tests and skip even more. Even with fake_news=True, except a failing test will appear to be passing.

Example:

Running 500 test with a 1% change of failing:

tests/test_covid.py ...........F.........s...............F.....s..sF...s....FsF..F.sFFs....sFs...s..F [ 16%]
FFsFFFssFsFss.s..sFFsFssssFFssssFs.sFssssss.sFss.sssss.sss.sss.sFsFssssssssFsssFssssss.sssssFssFsssss [ 36%]
ssssssssssssssssssssssssssss.sss.sssss.ss.ssssssFsFssssssFsssssssFsssssssssssssFFsssFssssssssFsFsFsFs [ 56%]
sssssFsssFssssFssssssssssssFssssssssssssFFsssssssssssssssFsssssssssssFssssssssssssssssssssssss.ssssss [ 76%]
ssssssFssssssssssssssssssssssFssssssFsssssssssssFssssssssssssssssFsssssssssssssssssssFssssssssssssFs. [ 97%]
sssssssssssssss

Same while watching Fox News, or if you believe you'll safe in church:

tests/test_covid.py .....................s....ss..........sssssss.s..s......ss.....s...sss.sss...ss.s [ 16%]
s.s.s..s.ss.s...s..s.s.ss.ss..ssss.s..sssssssssss.ss..sss.sss..s.s.sssssss.s.ss.ss.ssssss.ssss...s..s [ 36%]
ss.ss.ssss.ss...s.sssssss.sssssssssssssssssssssssss.ssss.ssssssssssssssssssssss.ssssssssssssssss.ssss [ 56%]
sssssssssssssssss.ssssssssssssssss.sssssssss.ssssssssssssssssssssssss.s.sssssssssssssssssssssssssss.s [ 76%]
sssssss.ssssssssssssssss.sssss.sssss.sssssssssssssssssssssssssssssssssssssssssss.sssssss.ssssss.sssss [ 97%]
ssssssssssssss

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest_covid-0.0.5.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

pytest_covid-0.0.5-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file pytest_covid-0.0.5.tar.gz.

File metadata

  • Download URL: pytest_covid-0.0.5.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.23.0

File hashes

Hashes for pytest_covid-0.0.5.tar.gz
Algorithm Hash digest
SHA256 d414c3fbb2084ba9823accdc4879d1ab154cff7ec1f2b0ad7675ee9cba43b219
MD5 abbd46a3bb3f8d750656a57275d45b47
BLAKE2b-256 f5ed4511cf3ad3ffc0dc230a2b7839d3231bb6eb22c47e36a07d0e2002194f57

See more details on using hashes here.

File details

Details for the file pytest_covid-0.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for pytest_covid-0.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 80f0f0a94e8cf92eae3eb0e52331b01047da29490ea86c85cead658d10066b9b
MD5 b817e485d3befdcc0fde6222353a5fb2
BLAKE2b-256 d89b35756db9ba63e689d36fac67b6ad5fd81e25420d558ecf67115949c79ae7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page