pytest-test-radar

pytest-test-radar is a pytest plugin designed to send test execution statistics to a centralized server. This allows teams to monitor flaky tests, track performance, and identify redundant or overly stable tests that might not be adding value to the test suite.

Features

• Collects test execution statistics, including:
  • Test name
  • Outcome (passed, failed, skipped)
  • Execution duration
• Sends data to a configured HTTP endpoint.
• Easy integration with any centralized monitoring system.

Installation

You can install it to your project dependencies:

pip install pytest-test-radar

Usage

Run pytest with --radar-endpoint and --radar-token options to specify the server URL and agent token:

pytest --radar-endpoint="http://your-server.com" --radar-token="ci_your_token_here"

You can also configure both via pyproject.toml:

[tool.pytest.ini_options]
radar_endpoint = "http://your-server.com"
radar_token = "ci_your_token_here"

The token is obtained from the Test Radar web UI when creating or regenerating an agent for a project. It is sent as an Authorization: Token <token> header with every request.

Example

Create a sample test file:

# test_sample.py
def test_pass():
    assert 1 == 1

def test_fail():
    assert 1 == 2

Run the tests with the plugin:

pytest test_sample.py --radar-endpoint="http://localhost:8000" --radar-token="ci_your_token_here"

Each test result is sent individually to /api/v1/test_record/create/:

{
  "label": "test_sample.py::test_pass",
  "timestamp": "2024-01-01T12:00:00+00:00",
  "logs": "",
  "success": true
}