pytest-markdown-report 0.1.0

Token-efficient markdown test reports for LLM-based TDD agents

pytest-markdown-report

Token-efficient markdown test reports for LLM-based TDD agents. Replaces pytest's default console output with markdown-formatted results.

Installation

Add to the development dependencies of your project.

pip install pytest-markdown-report

uv add --dev pytest-markdown-report

poetry add --group dev pytest

Usage

Once installed, the plugin automatically replaces pytest's console output with markdown format:

# Markdown output to console (default behavior)
pytest

# Also save to file
pytest --markdown-report=report.md

Verbosity Modes

Default: Summary + failures

pytest

Verbose (-v): Add passed test list

pytest -v

Quiet (-q): Summary + rerun suggestion only

pytest -q

Options

Save to file:

pytest --markdown-report=report.md

Custom rerun command:

pytest --markdown-rerun-cmd="just test --lf"

Disable rerun suggestion:

pytest --markdown-rerun-cmd=""

Output Format

Default Mode

# Test Report

**Summary:** 2/5 passed, 3 failed

## Failures

### test_validation.py::test_invalid_input[empty] FAILED

```python
test_validation.py:42: in test_invalid_input
    assert validate(input) == expected
E   AssertionError: assert False == True
```

### test_database.py::test_with_db FAILED in setup

```python
conftest.py:15: in db_connection
    raise ConnectionError("Database unavailable")
E   ConnectionError: Database unavailable
```

Note: Setup and teardown failures show phase notation (e.g., FAILED in setup) to distinguish fixture issues from test assertion failures.

Verbose Mode (-v)

Adds passed test list after failures:

## Passes

- test_feature.py::test_critical_path
- test_basic.py::test_simple

Quiet Mode (-q)

**Summary:** 2/5 passed, 3 failed

**Re-run failed:** `pytest --lf`

Design Goals

• Token efficiency: ~40% reduction vs verbose markdown
• Agent-friendly: Full tracebacks with assertion introspection
• TDD workflow: Minimal noise during green phase, detailed failures for debugging
• Configurable: Adapt rerun commands to your workflow (just, custom recipes)

Edge Cases

Parametrized tests: Parameter values shown in test name [empty]

Skipped tests: Labeled SKIPPED with skip reason in separate section

Expected failures: XFAIL label for expected failures, XPASS for unexpected passes

Setup/teardown failures: Phase notation shows context (e.g., FAILED in setup, FAILED in teardown)

Captured output: Included under failures when present

Integration

The plugin automatically formats all pytest output as markdown. Use with role-specific agents:

# Implementation agent sees failures only (console)
pytest

# Review agent sees all passes (console + file)
pytest -v --markdown-report=review.md --markdown-rerun-cmd="just role-review"

# Minimal output for CI/CD pipelines
pytest -q

Note: Use pytest --durations=N separately for performance analysis (this will also be in markdown format).

License

MIT