Skip to main content

A simple plugin to first execute tests that historically failed more

Project description

============= pytest-sorter

.. image:: http://img.shields.io/pypi/v/pytest-sorter.svg :target: https://pypi.python.org/pypi/pytest-sorter

.. image:: https://travis-ci.org/AndreMicheletti/pytest-sorter.svg?branch=master :target: https://travis-ci.org/AndreMicheletti/pytest-sorter :alt: See Build Status on Travis CI

A simple plugin to first execute tests that historically failed more

This pytest_ plugin was generated with cookiecutter_ along with @hackebrot's cookiecutter-pytest-plugin template.

Description

This plugin will save a history of your tests executions in a file .test_history. For each test it will have how many times it was executed, and how many times it failed.

Using that information it will calculate the percentage of failure of tests, and order them to first execute the higher failure ratio

Requirements

  • Python>=3

Installation

You can install "pytest-sorter" via pip_ from PyPI_::

$ pip install pytest-sorter

Usage

After installed, your tests will automatically create and update the .test_history file, and order tests by their failure ratio.

You can tell pytest to ignore this plugin by passing:

pytest --no-sorted

Contributing

Contributions are very welcome. Tests can be run with tox_, please ensure the coverage at least stays the same before you submit a pull request.

License

Distributed under the terms of the MIT_ license, "pytest-sorter" is free and open source software

Issues

If you encounter any problems, please file an issue_ along with a detailed description.

.. _Cookiecutter: https://github.com/audreyr/cookiecutter .. _@hackebrot: https://github.com/hackebrot .. _MIT: http://opensource.org/licenses/MIT .. _BSD-3: http://opensource.org/licenses/BSD-3-Clause .. _GNU GPL v3.0: http://www.gnu.org/licenses/gpl-3.0.txt .. _Apache Software License 2.0: http://www.apache.org/licenses/LICENSE-2.0 .. _cookiecutter-pytest-plugin: https://github.com/pytest-dev/cookiecutter-pytest-plugin .. _file an issue: https://github.com/AndreMicheletti/pytest-sorter/issues .. _pytest: https://github.com/pytest-dev/pytest .. _tox: https://tox.readthedocs.io/en/latest/ .. _pip: https://pypi.python.org/pypi/pip/ .. _PyPI: https://pypi.python.org/pypi

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest-sorter-0.3.1.tar.gz (6.0 kB view hashes)

Uploaded source

Built Distribution

pytest_sorter-0.3.1-py2.py3-none-any.whl (8.1 kB view hashes)

Uploaded py2 py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page