Pytest plugin for measuring coverage.
This plugin produces coverage reports. Compared to just using coverage run this plugin does some extras:
- Subprocess support: you can fork or run stuff in a subprocess and will get covered without any fuss.
- Xdist support: you can use all of pytest-xdist’s features and still get coverage.
- Consistent pytest behavior. If you run coverage run -m pytest you will have slightly different sys.path (CWD will be in it, unlike when running pytest).
All features offered by the coverage package should work, either through pytest-cov’s command line options or through coverage’s config file.
- Free software: MIT license
Install with pip:
pip install pytest-cov
For distributed testing support install pytest-xdist:
pip install pytest-xdist
Upgrading from ancient pytest-cov
pytest-cov 2.0 is using a new .pth file (pytest-cov.pth). You may want to manually remove the older init_cov_core.pth from site-packages as it’s not automatically removed.
Uninstall with pip:
pip uninstall pytest-cov
Under certain scenarios a stray .pth file may be left around in site-packages.
- pytest-cov 2.0 may leave a pytest-cov.pth if you installed without wheels (easy_install, setup.py install etc).
- pytest-cov 1.8 or older will leave a init_cov_core.pth.
pytest --cov=myproj tests/
Would produce a report like:
-------------------- coverage: ... --------------------- Name Stmts Miss Cover ---------------------------------------- myproj/__init__ 2 0 100% myproj/myproj 257 13 94% myproj/feature4286 94 7 92% ---------------------------------------- TOTAL 353 20 94%
Coverage Data File
The data file is erased at the beginning of testing to ensure clean data for each test run. If you need to combine the coverage of several test runs you can use the --cov-append option to append this coverage data to coverage data from previous test runs.
The data file is left at the end of testing so that it is possible to use normal coverage tools to examine it.
For distributed testing the workers must have the pytest-cov package installed. This is needed since the plugin must be registered through setuptools for pytest to start the plugin on the worker.
For subprocess measurement environment variables must make it from the main process to the subprocess. The python used by the subprocess must have pytest-cov installed. The subprocess must do normal site initialisation so that the environment variables can be detected and coverage started.
Whilst this plugin has been built fresh from the ground up it has been influenced by the work done on pytest-coverage (Ross Lawley, James Mills, Holger Krekel) and nose-cover (Jason Pellerin) which are other coverage plugins.
Ned Batchelder for coverage and its ability to combine the coverage results of parallel runs.
Holger Krekel for pytest with its distributed testing support.
Jason Pellerin for nose.
Michael Foord for unittest2.
No doubt others have contributed to these tools as well.
Note that this release drops support for Python 2.7 and Python 3.5.
- Added support for Python 3.10 and updated various test dependencies. Contributed by Hugo van Kemenade in #500.
- Switched from Travis CI to GitHub Actions. Contributed by Hugo van Kemenade in #494 and #495.
- Add a --cov-reset CLI option. Contributed by Danilo Šegan in #459.
- Improved validation of --cov-fail-under CLI option. Contributed by … Ronny Pfannschmidt’s desire for skark in #480.
- Dropped Python 2.7 support. Contributed by Thomas Grainger in #488.
- Updated trove classifiers. Contributed by Michał Bielawski in #481.
- Added coverage’s toml extra to install requirements in setup.py. Contributed by Christian Riedel in #410.
- Fixed pytest_cov.__version__ to have the right value (string with version instead of a string including __version__ =).
- Fixed license classifier in setup.py. Contributed by Chris Sreesangkom in #467.
- Fixed commits since badge. Contributed by Terence Honles in #470.
- Fixed support for newer setuptools (v42+). Contributed by Michał Górny in #451.
- Bumped minimum coverage requirement to 5.2.1. This prevents reporting issues. Contributed by Mateus Berardo de Souza Terra in #433.
- Improved sample projects (from the examples directory) to support running tox -e pyXY. Now the example configures a suffixed coverage data file, and that makes the cleanup environment unnecessary. Contributed by Ganden Schaffner in #435.
- Removed the empty console_scripts entrypoint that confused some Gentoo build script. I didn’t ask why it was so broken cause I didn’t want to ruin my day. Contributed by Michał Górny in #434.
- Fixed the missing coverage context when using subprocesses. Contributed by Bernát Gábor in #443.
- Updated the config section in the docs. Contributed by Pamela McA’Nulty in #429.
- Migrated CI to travis-ci.com (from .org).
- Support for pytest-xdist 2.0, which breaks compatibility with pytest-xdist before 1.22.3 (from 2017). Contributed by Zac Hatfield-Dodds in #412.
- Fixed the LocalPath has no attribute startswith failure that occurred when using the pytester plugin in inline mode.
- Improved the --no-cov warning. Now it’s only shown if --no-cov is present before --cov.
- Removed legacy pytest support. Changed setup.py so that pytest>=4.6 is required.
- Fixed RemovedInPytest4Warning when using Pytest 3.10. Contributed by Michael Manganiello in #354.
- Made pytest startup faster when plugin not active by lazy-importing. Contributed by Anders Hovmöller in #339.
- Various CI improvements. Contributed by Daniel Hahler in #363 and #364.
- Various Python support updates (drop EOL 3.4, test against 3.8 final). Contributed by Hugo van Kemenade in #336 and #367.
- Changed --cov-append to always enable data_suffix (a coverage setting). Contributed by Harm Geerts in #387.
- Changed --cov-append to handle loading previous data better (fixes various path aliasing issues).
- Various other testing improvements, github issue templates, example updates.
- Fixed internal failures that are caused by tests that change the current working directory by ensuring a consistent working directory when coverage is called. See #306 and coveragepy#881
- Fixed #348 - regression when only certain reports (html or xml) are used then --cov-fail-under always fails.
- Fixed RecursionError that can occur when using cleanup_on_signal or cleanup_on_sigterm. See: #294. The 2.7.x releases of pytest-cov should be considered broken regarding aforementioned cleanup API.
- Added compatibility with future xdist release that deprecates some internals (match pytest-xdist master/worker terminology). Contributed by Thomas Grainger in #321
- Fixed breakage that occurs when multiple reporting options are used. Contributed by Thomas Grainger in #338.
- Changed internals to use a stub instead of os.devnull. Contributed by Thomas Grainger in #332.
- Added support for Coverage 5.0. Contributed by Ned Batchelder in #319.
- Added support for float values in --cov-fail-under. Contributed by Martín Gaitán in #311.
- Various documentation fixes. Contributed by Juanjo Bazán, Andrew Murray and Albert Tugushev in #298, #299 and #307.
- Various testing improvements. Contributed by Ned Batchelder, Daniel Hahler, Ionel Cristian Mărieș and Hugo van Kemenade in #313, #314, #315, #316, #325, #326, #334 and #335.
- Added the --cov-context CLI options that enables coverage contexts. Only works with coverage 5.0+. Contributed by Ned Batchelder in #345.
- Fixed source distribution manifest so that garbage ain’t included in the tarball.
- Fixed AttributeError: 'NoneType' object has no attribute 'configure_node' error when --no-cov is used. Contributed by Alexander Shadchin in #263.
- Various testing and CI improvements. Contributed by Daniel Hahler in #255, #266, #272, #271 and #269.
- Improved documentation regarding subprocess and multiprocessing. Contributed in #265.
- Improved pytest_cov.embed.cleanup_on_sigterm to be reentrant (signal deliveries while signal handling is running won’t break stuff).
- Added pytest_cov.embed.cleanup_on_signal for customized cleanup.
- Improved cleanup code and fixed various issues with leftover data files. All contributed in #265 or #262.
- Improved examples. Now there are two examples for the common project layouts, complete with working coverage configuration. The examples have CI testing. Contributed in #267.
- Improved help text for CLI options.
- Dropped support for Python 3 < 3.4, Pytest < 3.5 and Coverage < 4.4.
- Fixed some documentation formatting. Contributed by Jean Jordaan and Julian.
- Added an example with addopts in documentation. Contributed by Samuel Giffard in #195.
- Fixed TypeError: 'NoneType' object is not iterable in certain xdist configurations. Contributed by Jeremy Bowman in #213.
- Added a no_cover marker and fixture. Fixes #78.
- Fixed broken no_cover check when running doctests. Contributed by Terence Honles in #200.
- Fixed various issues with path normalization in reports (when combining coverage data from parallel mode). Fixes #130. Contributed by Ryan Hiebert & Ionel Cristian Mărieș in #178.
- Report generation failures don’t raise exceptions anymore. A warning will be logged instead. Fixes #161.
- Fixed multiprocessing issue on Windows (empty env vars are not passed). Fixes #165.
Added a “disarm” option: --no-cov. It will disable coverage measurements. Contributed by Zoltan Kozma in PR#135.
WARNING: Do not put this in your configuration files, it’s meant to be an one-off for situations where you want to disable coverage from command line.
Fixed broken exception handling on .pth file. See #136.
- Add support for specifying output location for html, xml, and annotate report. Contributed by Patrick Lannigan in PR#113.
- Fix bug hiding test failure when cov-fail-under failed.
- For coverage >= 4.0, match the default behaviour of coverage report and error if coverage fails to find the source instead of just printing a warning. Contributed by David Szotten in PR#116.
- Fixed bug occurred when bare --cov parameter was used with xdist. Contributed by Michael Elovskikh in PR#120.
- Add support for skip_covered and added --cov-report=term-skip-covered command line options. Contributed by Saurabh Kumar in PR#115.
- Fixed incorrect merging of coverage data when xdist was used and coverage was >= 4.0.
- Added support for changing working directory in tests. Previously changing working directory would disable coverage measurements in suprocesses.
- Fixed broken handling for --cov-report=annotate.
- Added support for coverage 4.0b2.
- Added the --cov-append command line options. Contributed by Christian Ledermann in PR#80.
- Added --cov-fail-under, akin to the new fail_under option in coverage-4.0 (automatically activated if there’s a [report] fail_under = ... in .coveragerc).
- Changed --cov-report=term to automatically upgrade to --cov-report=term-missing if there’s [run] show_missing = True in .coveragerc.
- Changed --cov so it can be used with no path argument (in which case the source settings from .coveragerc will be used instead).
- Fixed .pth installation to work in all cases (install, easy_install, wheels, develop etc).
- Fixed .pth uninstallation to work for wheel installs.
- Support for coverage 4.0.
- Data file suffixing changed to use coverage’s data_suffix=True option (instead of the custom suffixing).
- Avoid warning about missing coverage data (just like coverage.control.process_startup).
- Fixed a race condition when running with xdist (all the workers tried to combine the files). It’s possible that this issue is not present in pytest-cov 1.8.X.
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Hashes for pytest_cov-3.0.0-py3-none-any.whl