Skip to main content

A small unittest-based tool for generating single page html reports in Python.

Project description

:page_facing_up: unitreport PyPI

UnitReport is a small unittest-based tool for generating single page html reports in Python. The reports can include matplotlib figures and html tables. It is designed to be minimal and fit into the unittesting framework, allowing users to make assertions about their data (e.g. data quality) before generating figures.


Getting Started

You can install the library using,

pip3 install unitreport

There are usage examples in and You need to create test cases using the unittest Python library, and utilise unitreport's decorators:

import unittest
import unitreport

import seaborn as sns
import pandas as pd

class TestExample(unittest.TestCase):
    """Example test suite producing plots and tables in a report using unitreport."""

    dataset: pd.DataFrame = None

    def setUpClass(cls):
        """Load dataset on setup."""
        cls.dataset = sns.load_dataset("fmri")

    def test_timepoint_vs_signal_by_event(self):
        """*fMRI data:* timepoint versus signal for stim and cue events."""
        # you can still run assertions to check data quality before plotting
        self.assertEqual(self.dataset.shape, (1064, 5))

        # plotting decorator will call plt.savefig() to generate the plot
        # could also return a figure & .savefig() will be called on returned object

    def test_region_counts(self):
        """*fMRI data:* table summary description of timepoints and signals."""
        # you can still run assertions to check data quality before making table
        self.assertEqual(self.dataset.shape, (1064, 5))

        return self.dataset.describe().to_html()

You can run the tests using,

python3 -m unitreport

This will discover and run the tests (which could be across multiple test files), generate the report and save it to the current directory.

For extra parameters you can run the following,

python3 -m unitreport -h

usage: [-h] [--tests_dir TESTS_DIR] [--pattern PATTERN]
                   [--templates_dir TEMPLATES_DIR] [--output_file OUTPUT_FILE]

optional arguments:
  -h, --help            show this help message and exit
  --tests_dir TESTS_DIR
                        Path to test files. (default: .)
  --pattern PATTERN     File patterns to discover test cases in. (default:
  --templates_dir TEMPLATES_DIR
                        Path to jinja2 templates directory including
                        index.html and main.css. (default: (unitreport) templates)
  --output_file OUTPUT_FILE
                        Output path including name. (default: report.html)

There are template index.html and main.css files which will be used by default to generate the style of the report. You can also specify a path to your own templates using --templates_dir, where the html Jinja2 template can expect to receive date (today's date), and figures, a dictionary with test function names as keys mapped to values of type (table or plot), content (svg or html table) and description (test function's docstring).

You can also invoke unitreport from a Python script using the library's main() (runs tests and generates report), discover_and_run() (only run tests) and generate_report() (only generate report) functions. These utilise the default values for the above parameters if not specified by the user, and generate_report() uses the global FIGURES dictionary generated from the tests if not passed. For more details on what they do, you can check the source code.

import unitreport

# result is a unittest.TestResult which you can access things such as result.errors
result, figs = unitreport.discover_and_run()
print(result) # <unittest.runner.TextTestResult run=3 errors=0 failures=0>
print(figs) # Dict with test function names as keys mapped to 'type', 'content', and 'description'
# html_report is a string containing the generated report
html_report = unitreport.generate_report()

# same as above, raises assertion error if there are errors in tests or no tests found
result, figs, html_report = unitreport.main()

Built With

  • unittest - underlying testing framework
  • Jinja2 - rendering and generating the report
  • matplotlib - plotting library
  • Markdown - Python markdown library for markdown captions

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for unitreport, version 0.0.8
Filename, size File type Python version Upload date Hashes
Filename, size unitreport-0.0.8-py3-none-any.whl (8.8 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size unitreport-0.0.8.tar.gz (6.6 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page