Skip to main content

Pytest plugin to display test reports as a plaintext spec, inspired by Rspec: https://github.com/mattduck/pytest-it.

Project description

PyPI Travis

Decorate your pytest suite with RSpec-inspired markers describe, context and it. Then run pytest --it to see a plaintext, org-mode compatible spec of the test structure.

img/output-example.png

Install

pytest-it is available on PyPi: pip install pytest-it.

Examples

A basic example that uses pytest.mark.describe, pytest.mark.context and pytest.mark.it:

from pytest import mark as m

@m.describe("The test function report format")
class TestPytestItExample(object):

    @m.context("When @pytest.mark.it is used")
    @m.it("Displays an '- It: ' block matching the decorator")
    def test_it_decorator(self, testdir):
        pass

This produces:

- Describe: The test function report format...

  - Context: When @pytest.mark.it is used...
    - ✓ It: Displays an '- It: ' block matching the decorator

Describe and Context blocks can be nested arbitrarily by using multiple markers, eg:

from pytest import mark as m

@m.describe("The test function report format")
class TestPytestItExample(object):

    @m.context("When @pytest.mark.it is not used")
    @m.it("Displays the test function name")
    def test_no_argument(self, testdir):
        pass

    @m.context("When @pytest.mark.it is not used")
    @m.context("but the test name starts with 'test_it_'")
    @m.it("Prettifies the test name into the 'It: ' value")
    def test_populates_the_it_marker_using_function_name(self, testdir):
        pass

This produces:

- Describe: The test function report format...

  - Context: When @pytest.mark.it is not used...
    - ✓ It: Displays the test function name

    - ...but the test name starts with 'test_it_'...
      - ✓ It: Prettifies the test name into the 'It: ' value

Behaviour

  • Pytest markers are used to specify the Describe:, Context: and It: sections. You can set these in all the usual ways that you specify pytest markers.

  • Describe and Context can be nested arbitrarily.

  • If --collect-only is used, it displays the same pytest-it spec as usual, but without the test result (✓/F/s).

  • If -v is higher than 0, the full path to the test function is include in the test name.

  • If pytest.mark.it is not used on a test, the test name is displayed instead of the It: does something output.

  • If pytest.mark.it is not used but the test name starts with test_it, pytest-it will prettify the test name into an It: does something value.

  • The test output should be able to be copied directly into an org-mode file.

Background

Pytest provides a lot of useful features for testing in Python, but when testing complex systems, it can be hard to clearly communicate the intent of a test using the standard test_module.py::TestClass::test_function structure.

One way to improve clarity is to use a BDD testing framework (eg. Behave, Mamba, Rspec), but it’s not always desirable to restructure existing test and program code.

There are some pytest plugins that attempt to bridge this gap, by providing alternative ways to structure the tests (eg. pytest-describe, pytest-bdd), or altering the test report output (eg. pytest-testdox, pytest-pspec).

pytest-it takes a similar approach to pytest-testdox, by providing pytest markers that can describe the test output. pytest-it supports a few other features, such as:

  • A plaintext test structure that can easily be copied to markdown/org-mode documents.

  • Arbitrary nesting of describe and context markers.

  • Supporting the --collect-only pytest flag to display test structure.

  • Displaying the full path to each test if -v is used.

  • Neatly integrating tests in the output if they don’t use the pytest-it markers.

Although pytest-it does not change the behaviour of pytest tests, you may find it a useful tool for thinking about test structure, and communicating the intention of both the test code and the system under test.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest-it-0.1.5.tar.gz (9.6 kB view details)

Uploaded Source

File details

Details for the file pytest-it-0.1.5.tar.gz.

File metadata

  • Download URL: pytest-it-0.1.5.tar.gz
  • Upload date:
  • Size: 9.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for pytest-it-0.1.5.tar.gz
Algorithm Hash digest
SHA256 d2d21e9dd371a423b357e955ebe4afd5cd848508e448e6476f21eb034733e2f1
MD5 9a87c450d3ce618de6571a6287334593
BLAKE2b-256 4336e0d0efe8b75b7a2ce4f10f3b0bce57d8ed03d6b44972c96b32095fbf58cf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page