Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Tests & Lint PyPI PyPI - Downloads License

Introduction

Pytest plugin to repeat tests and pass if the test passes a number of times out of a total.

Purpose

I want to leverage pytest for model evaluation in a way that can be readily incorporated into CI/CD flows.

Installation

pip install pytest-repeated

🚀 Usage Example

@pytest.mark.repeated(times=4, threshold=2)
def test_example_fail_once():
    import random
    assert random.choice([True, False])  # may pass or fail

This test will run four times and pass if we get True in at least two of the four iterations.

🛠️ Development

The only requirement is 🐳 Docker. (The .devcontainer and tasks.json are prepared assuming a *nix system, but if you know the commands, this will work on Windows, too.)

  1. Clone the repo.
  2. Branch out.
  3. Open in "devcontainer" on VS Code and start developing. Run pytest under tests to test.
  4. Akternatively, if you are a fan of Test-Driven Development like me, you can run the tests without getting on a container. .vscode/tasks.json has the command to do so, but it's also listed here:
docker compose -f tests/docker-compose.yaml up --build --abort-on-container-exit --exit-code-from test
  1. When satisfied, push and open a PR. The pipeline will publish automatically when your PR is merged.

Future Plans

  • Better statistical measures
  • Optimized testing - stop conditions.
  • Sequential testing.
  • Ability to set the seed.
  • Report and fail on speed

Metadata

Release files for pytest-repeated 0.2.2.dev202511260048

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pytest-repeated 0.2.2.dev202511260048
File Size Uploaded Provenance Actions
pytest_repeated-0.2.2.dev202511260048.tar.gz 6.4 kB With provenance Details for pytest_repeated-0.2.2.dev202511260048.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for pytest-repeated 0.2.2.dev202511260048
File Interpreter ABI Platform Actions
pytest_repeated-0.2.2.dev202511260048-py3-none-any.whl Python 3 none any Details for pytest_repeated-0.2.2.dev202511260048-py3-none-any.whl

Total release size: 12.2 kB

Release files / pytest_repeated-0.2.2.dev202511260048.tar.gz

Download URL pytest_repeated-0.2.2.dev202511260048.tar.gz
Size 6.4 kB
Tags Source
SHA-256 checksum
How to use checksums
ab76062737be29592d5484906f5ef9933a8900e512f338c5ce0e66a8e5493d5d
BLAKE2b-256 checksum
How to use checksums
07ba5c84ca8e848430c4fb568f9c6afe926982c9f3b725be0718057a833ebb65
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 26, 2025.

Transparency log

Release files / pytest_repeated-0.2.2.dev202511260048-py3-none-any.whl

Download URL pytest_repeated-0.2.2.dev202511260048-py3-none-any.whl
Size 5.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f29266ce4ab0b2b74df3f420558d98aa01397a7bd13e4f7494bb9f2ffc18994c
BLAKE2b-256 checksum
How to use checksums
19967d7490fd14bea476051a49f7248913bbd42a30f23fe78cdb7a3670d33e2e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 26, 2025.

Transparency log

Security for pytest-repeated 0.2.2.dev202511260048

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for pytest_repeated-0.2.2.dev202511260048.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 26, 2025.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page