Skip to main content

Fetch a list of flaky tests from a CircleCI project.

Project description

# circleci-flaky

[![PyPI version](https://img.shields.io/pypi/v/circleci-flaky.svg)](https://pypi.org/project/circleci-flaky) [![Python versions](https://img.shields.io/pypi/pyversions/circleci-flaky.svg)](https://pypi.org/project/circleci-flaky)

A command line utility to fetch a list of flaky tests from a CircleCI project.

---

## Features

CircleCI provides an "Insights" section for your workflows, but it's limited in how far back the data goes. `circleci-flaky` allows you to specify up to 100 of the previous failed builds to check for recurring failed tests. It defaults to checking the master branch and displaying all failed tests, but both of these can be customized.

```sh
$ circleci-flaky -h
usage: circleci-flaky [-h] [--branch BRANCH] [--builds N] [--top N] project

Check a CircleCI project for flaky tests

positional arguments:
project the project to check

optional arguments:
-h, --help show this help message and exit
--branch BRANCH branch to check for failures (default: master)
--builds N number of failed builds to check (default: 30)
--top N limit results to the top N (default: all)
```

## Installation

You can install `circleci-flaky` via pip from [PyPI][pypi].

```sh
# If you run both Python 2 and 3 on your system, use pip3
sudo pip3 install circleci-flaky

# If you only run Python 3, you can just use pip
sudo pip install circleci-flaky
```

## Contributing

Contributors welcome!

## License

Distributed under the terms of the [MIT](/LICENSE) license, `circleci-flaky` is free and open source software.

## Issues

If you encounter any problems, please [file an issue](new-issue) along with a detailed description.

[pypi]: https://pypi.org/project/circleci-flaky/
[new-issue]: https://github.com/ryanwilsonperkin/circleci-flaky/issues/new

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

circleci-flaky-1.0.1.tar.gz (3.3 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page