pytest plugin for creating TestRail runs and adding results
Project description
Pytest to TestRail Plugin
Create and update testplans and/or testruns in TestRail based on pytest results. Test functions marked with a TestRail case ID will have their results sent to TestRail.
This project preserves the functionality of the deprecated pytest-testrail project. This plugin facilitates the transfer of Pytest results to TestRail, a test case management tool. It is implemented in Python and utilizes pip for package management.
Features
Transfers Pytest results to TestRail seamlessly.
Compatible with all major operating systems.
Easy integration with your existing Pytest suite.
Proper handling of tests marked with xfail:
Sends test as FAILED to the TestRail if test fail as expected.
Sends test as PASSED to the TestRail if test unexpectedly pass.
Sends test as FAILED to the TestRail if test has argument of run=false
Example
import pytest
@pytest.mark.case_id('C1950')
def test_all_the_things():
doit = True
assert doit
Installation
Getting Started
Installation
Via pip:
pip install pytest-testrail-results
Plugin Configuration
The following values are required:
A valid TestRail instance URL.
A valid email address for a user on the instance.
A valid API key for the user.
They can be set on the command line via the follow flags:
--tr-url=<your_url>
--tr-email=<your_email>
--tr-password=<your_password>
Alternatively, they can be set via a pytest configuration file:
[pytest]
tr_url=<your_url>
tr_email=<your_email>
tr_password=<your_password>
Marking Tests
case_id
The case_id marker takes a string which must match an existing TestRail testcase. Only tests with this marker will be added to the TestRail testrun.
import pytest
# This test's results will be uploaded.
@pytest.mark.case_id('C1950')
def test_all_the_things():
...
# This test's results will not be uploaded.
def test_all_the_other_things():
...
defect_ids
The ‘defect_ids’ marker takes a list of strings. These will be used in the defect field in TestRail. This is useful for tests with known failures.
Typically, these are IDs for your bug tracking software.
import pytest
@pytest.mark.case_id('C1950')
@pytest.mark.defect_ids(['JS-7001', 'JS-9001'])
def test_all_the_things():
...
Running Pytest
The --testrail command-line flag must be present to upload results:
pytest --testrail
Options
Setup
--testrail Activate the TestRail plugin.
--tr-url Web address used to access a TestRail instance.
--tr-email E-mail address for an account on the TestRail instance.
--tr-password Password for an account on the TestRail instance.
--tr-timeout Timeout for connecting to a TestRail server.
--tr-no-ssl-cert-check Do not check for valid SSL certificate on TestRail host.
Testrun
--tr-run-id ID of an existing testrun in TestRail. If specified, the testrun matching the ID will be used instead of creating a new testrun. If given, --tr-testrun-name will be ignored.
--tr-testrun-name Name used for a new testrun in TestRail.
--tr-testrun-description Description used for a new testrun in TestRail.
--tr-testrun-assignedto-id ID of the user to be assigned to the testrun.
--tr-testrun-project-id ID of the project the testrun will be created in.
--tr-testrun-suite-id ID of the suite the testrun will be created in.
--tr-testrun-suite-include-all Include all test cases in the specified testsuite for a new testrun.
--tr-milestone-id ID of a milestone used in testrun creation.
--tr-skip-missing Skip pytest test functions with marks that are not present in a specified testrun.
Testplan
--tr-plan-id ID of an existing testplan to use. If given, --tr-testrun-name will be ignored.
Publishing
--tr-version Specify a version in testcase results.
--tr-close-on-complete On pytest completion, close the testrun.
--tr-dont-publish-blocked Do not publish results of “blocked” testcases (in TestRail).
--tr-custom-comment Custom text appended to comment for all testcase results.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pytest_testrail_results-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | e1b2e0cd54b88ffea1b07ac529953592f10a720760a3470bfbca19e50dc1eb8b |
|
MD5 | ab0aadfd886e94d853d68f8de0aa75f4 |
|
BLAKE2b-256 | 675c2cfa24067d9d4517c18c5228203f0b140ae9e39541c342e48b07a81d7843 |
Hashes for pytest_testrail_results-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 893cd5725fb47135ce77aedeb40e5cfff72c52a08fe4b74912919f985d9555c1 |
|
MD5 | 4b98b697b7ea36871628c80f00d33efb |
|
BLAKE2b-256 | 151eadc4bb7849cf4a665698f8dc095ef308a748b6fdb095bc7ba9fbc254cc91 |