pytest-analyzer 1.0.7

this plugin allows to analyze tests in pytest project, collect test metadata and sync it with testomat.io TCM system

Testomat.io plugin for pytest

uses Testomat.io API:

• https://testomatio.github.io/check-tests/
• https://testomatio.github.io/reporter/

Installation

pip install pytest-analyzer

configuration

create pytest.ini file in your project root directory. Set next parameters:

[pytest]
testomatio_url = https://app.testomat.io ; this one is OPTIONAL
testomatio_project = 70t3da349fte ; project key is mandatory to assing tests to particular project
testomatio_email = [e-mail] ; your login in testomat.io
testomatio_password = secure_password ; your password in testimat.io

Usage

Run pytest with analyzer add parameter to analyze your tests, send them to testomat.io and get back test id. Tests will not be executed

pytest --analyzer add

Run pytest with analyzer remove parameter to remove all test ids from your tests. Tests will not be executed

pytest --analyzer remove

Run pytest with analyzer sync parameter to execute tests and send the execution status to testomat.io

pytest --analyzer sync

Run pytest with analyzer debug parameter to get test data collected in metadata.json file

pytest --analyzer debug

Advanced usage

to configure additional test run parameters call analyzer_test_config fixture.
This fixture return TestRunConfig object with next parameters:

• test_run_id - do not modify. this parameter is set automatically
• title - test run title. Leave empty to have generic run title like "pytest run at 2020-01-01 00:00:00"
• environment - test environment. Empty by default. Set any suitable: "staging", "production", "test", "Winddows 11", "Chrome 115", etc
• group_title - Empty by default. Creates folder in testomat.io for test runs with specified name
• parallel - False by default. Set to True if you run tests in parallel

Example:

import pytest


@pytest.fixture(scope="session")
def get_web_browser(playwright_fixture, analyzer_test_config):
    browser = playwright_fixture.chromium.launch()
    analyzer_test_config.environment = 'chromium'
    yield browser
    browser.close()

Clarifications

• tests can be synced even without @mark.testomatio('@T96c700e6') decorator.
• test title in testomat.io == test name in pytest
• test suit title in testomat.io == test file name in pytest

Example of test

To make analyzer experience more consistent, it uses standard pytest markers.
Testomat.io test id is a string value that starts with @T and has 8 symbols after.

from pytest import mark


@mark.testomatio('@T96c700e6')
def test_example():
    assert 2 + 2 == 4

Roadmap

• handle REST API exceptions
• support screenshot attachments