pytest-data-extractor 0.1.6

A pytest plugin to extract relevant metadata about tests into an external file (currently only json support)

pytest-data-extractor

Pytest plugin intended for extracting test data and metadata and serializing it into a file. The plugin currently support json files.

This is a completely open source project so everyone are more than welcome to join and extended it.

Version 0.1.6

Use case

pip install the package to your project's virtual environment. Directly from plugin folder:

pip install -e .

Go to a test file and now simply add upload_manager fixture in order to save a variable (except callable), Like so:

# test_foo.py

def test_bar(upload_manager):
    expected_value = upload_manager(1000)
    assert expected_value == 1000, "assert failed"

Activate the plugin with the pytest cli with the command:

pytest --output_test_data True

Now the data passed to upload_manager, as well as the test data that is specified at the TestData container will be stored in an external file. For a json file output:

[
  {
    "test_input": 1000,
    "expected": 1000,
    "actual": 1000,
    "operator": "==",
    "test_func": "test_bar",
    "test_status": 1,
    "test_duration": 0.010749192908406258
  }
]

There are specific input types that instead of being serialized to the main json file, will be stored as cache files. Currently pandas dataframes are supported, so if upload_manager is invoked on it, it will be stored in cache folder.
There's no garbage collection so be mindful how and where the files are stored.

Miscellaneous

For order sakes, the plugin will use a test comparison convention of:

* left- actual result.
* right- expected result.

conftest.py hooks and fixtures

In order to change the folder for either cache or output files, use conftest.py with the correct fixtures. example:

# conftest.py
import pytest


@pytest.fixture
def session_output_dir():
    return "my_files.output"


@pytest.fixture
def session_temp_dir():
    return "my_files.temp"

The default directories will be at the root where the pytest is called.