pytest-cover 1.0.0

Pytest plugin for measuring coverage. Forked from `pytest-cov`.

Pytest plugin for measuring coverage. Forked from pytest-cov.

• Free software: MIT license

This plugin produces coverage reports. It supports centralised testing and distributed testing in both load and each modes. It also supports coverage of subprocesses.

All features offered by the coverage package should be available, either through pytest-cover or through coverage’s config file.

Installation

Install with pip:

pip install pytest-cover

For distributed testing support install pytest-xdist:

pip install pytest-xdist

Note

Ensure you use pip instead of easy_install as the latter does not correctly install the init_cov_core.pth file needed for subprocess measurement.

Uninstallation

Uninstall with pip:

pip uninstall pytest-cover

Usage

Centralised Testing

Centralised testing will report on the combined coverage of the main process and all of it’s subprocesses.

Running centralised testing:

py.test --cov=myproj tests/

Shows a terminal report:

-------------------- coverage: platform linux2, python 2.6.4-final-0 ---------------------
Name                 Stmts   Miss  Cover
----------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%
myproj/feature4286      94      7    92%
----------------------------------------
TOTAL                  353     20    94%

Distributed Testing: Load

Distributed testing with dist mode set to load will report on the combined coverage of all slaves. The slaves may be spread out over any number of hosts and each slave may be located anywhere on the file system. Each slave will have it’s subprocesses measured.

Running distributed testing with dist mode set to load:

py.test --cov=myproj -n 2 tests/

Shows a terminal report:

-------------------- coverage: platform linux2, python 2.6.4-final-0 ---------------------
Name                 Stmts   Miss  Cover
----------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%
myproj/feature4286      94      7    92%
----------------------------------------
TOTAL                  353     20    94%

Again but spread over different hosts and different directories:

py.test --cov=myproj --dist load
        --tx ssh=memedough@host1//chdir=testenv1
        --tx ssh=memedough@host2//chdir=/tmp/testenv2//python=/tmp/env1/bin/python
        --rsyncdir myproj --rsyncdir tests --rsync examples
        tests/

Shows a terminal report:

-------------------- coverage: platform linux2, python 2.6.4-final-0 ---------------------
Name                 Stmts   Miss  Cover
----------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%
myproj/feature4286      94      7    92%
----------------------------------------
TOTAL                  353     20    94%

Distributed Testing: Each

Distributed testing with dist mode set to each will report on the combined coverage of all slaves. Since each slave is running all tests this allows generating a combined coverage report for multiple environments.

Running distributed testing with dist mode set to each:

py.test --cov=myproj --dist each
        --tx popen//chdir=/tmp/testenv3//python=/usr/local/python27/bin/python
        --tx ssh=memedough@host2//chdir=/tmp/testenv4//python=/tmp/env2/bin/python
        --rsyncdir myproj --rsyncdir tests --rsync examples
        tests/

Shows a terminal report:

---------------------------------------- coverage ----------------------------------------
                          platform linux2, python 2.6.5-final-0
                          platform linux2, python 2.7.0-final-0
Name                 Stmts   Miss  Cover
----------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%
myproj/feature4286      94      7    92%
----------------------------------------
TOTAL                  353     20    94%

Reporting

It is possible to generate any combination of the reports for a single test run.

The available reports are terminal (with or without missing line numbers shown), HTML, XML and annotated source code.

The terminal report without line numbers (default):

py.test --cov-report term --cov=myproj tests/

-------------------- coverage: platform linux2, python 2.6.4-final-0 ---------------------
Name                 Stmts   Miss  Cover
----------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%
myproj/feature4286      94      7    92%
----------------------------------------
TOTAL                  353     20    94%

The terminal report with line numbers:

py.test --cov-report term-missing --cov=myproj tests/

-------------------- coverage: platform linux2, python 2.6.4-final-0 ---------------------
Name                 Stmts   Miss  Cover   Missing
--------------------------------------------------
myproj/__init__          2      0   100%
myproj/myproj          257     13    94%   24-26, 99, 149, 233-236, 297-298, 369-370
myproj/feature4286      94      7    92%   183-188, 197
--------------------------------------------------
TOTAL                  353     20    94%

These three report options output to files without showing anything on the terminal:

py.test --cov-report html
        --cov-report xml
        --cov-report annotate
        --cov=myproj tests/

The final report option can also suppress printing to the terminal:

py.test --cov-report= --cov=myproj tests/

This mode can be especially useful on continuous integration servers, where a coverage file is needed for subsequent processing, but no local report needs to be viewed. For example, tests run on Travis-CI could produce a .coverage file for use with Coveralls.

Coverage Data File

The data file is erased at the beginning of testing to ensure clean data for each test run.

The data file is left at the end of testing so that it is possible to use normal coverage tools to examine it.

Coverage Config File

This plugin provides a clean minimal set of command line options that are added to pytest. For further control of coverage use a coverage config file.

For example if tests are contained within the directory tree being measured the tests may be excluded if desired by using a .coveragerc file with the omit option set:

py.test --cov-config .coveragerc
        --cov=myproj
        myproj/tests/

Where the .coveragerc file contains file globs:

[run]
omit = tests/*

For full details refer to the coverage config file documentation.

Note that this plugin controls some options and setting the option in the config file will have no effect. These include specifying source to be measured (source option) and all data file handling (data_file and parallel options).

Limitations

For distributed testing the slaves must have the pytest-cover package installed. This is needed since the plugin must be registered through setuptools for pytest to start the plugin on the slave.

For subprocess measurement environment variables must make it from the main process to the subprocess. The python used by the subprocess must have pytest-cover installed. The subprocess must do normal site initialisation so that the environment variables can be detected and coverage started.

Acknowledgements

Marc Schlaich and everyone else for contributing and creating pytest-cov (and cov-core). This plugin is a merge of those two packages with other fixes.

Changelog

1.0.0 (2015-06-05)

• Fixed .pth installation to work in all cases (install, easy_install, wheels, develop etc).

• Fixed .pth uninstallation to work for wheel installs.

• Reverted the unreleased --cov=path deprecation.

• Removed the unreleased addition of --cov-source=path.

---

• Forked from the 2.0 branch of https://github.com/schlamar/pytest-cov/ - fixes include:

  • No need to specify the source anymore via --cov. The source settings from .coveragerc will be used instead.

  • Support for --cov-min.