Skip to main content

Easy declaration of optional tests (i.e., that are not run by default)

Project description

PyPI version Python versions See Build Status on Travis CI

Provides easy declaration of optional tests using pytest markers. Optional tests are run only on request via the config file or command line.


Motivation

Some classes of tests should not be run with every test invocation. It is often useful to define tests that be run only when specifically requested, such as tests that are slow, require network access, or work only in certain environments.

Pytest provides mechanisms to run tests based on test names (-k) and to filter tests based on markers (-m). Neither mechanism makes it easy to surpress certain tests by default. For example, one might decorate tests with @pytest.mark.network, but disabling it by default requires a marker expression like -m “not network” with every invocation. Markers and marker expressions become unwieldy when there are many markers.

This plugin enables users to declare that certain markers are “optional markers”. When tests are decorated with an optional marker, the test is skipped by default. Tests may be decorated with multiple markers, including multiple optional markers. Optional tests may be enabled in the pytest ini file or the command line.

Installation

You can install “pytest-optional-tests” via pip from PyPI:

$ pip install pytest-optional-tests

Usage

Optional markers must be declared in inicfg using the same syntax as the markers option. For example:

[pytest]
optional_tests:
  slow: slow tests
  network: network tests
  bug: regression tests against previous bugs

Optional markers should NOT be declared using the markers attribute, even when using pytest’s strict mode.

Optional test decorators are pytest markers, and the semantics are identical.

If a test is decorated with multiple optional markers, the test will be executed when any of the markers is requested. For example:

@pytest.mark.network
@pytest.mark.slow
def test_slow_network_function(): ...

will be tested if either or both of the optional slow or network tests are requested.

Optional tests may be requested in the inicfg:

[pytest]
optional_tests:
  slow: slow tests
  network: network tests
  bug: regression tests against previous bugs
run_optional_tests=network,slow

or on the command line:

pytest --run-option-tests=network,slow

Contributing

Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.

License

Distributed under the terms of the MIT license.

Issues

If you encounter any problems, please file an issue along with a detailed description.

This pytest plugin was generated with Cookiecutter along with @hackebrot’s cookiecutter-pytest-plugin template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pytest-optional-tests, version 0.1.1
Filename, size File type Python version Upload date Hashes
Filename, size pytest_optional_tests-0.1.1-py3-none-any.whl (5.5 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size pytest-optional-tests-0.1.1.tar.gz (7.6 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page