pytest-mergify
Pytest plugin for Mergify Test Engine.
More information at https://mergify.com
Features
- Test tracing — Sends OpenTelemetry traces for every test to Mergify's API
- Flaky test detection — Intelligently reruns tests to detect flakiness with budget constraints
- Test quarantine — Quarantines failing tests so they don't block CI
- Test selection — Runs first the tests a merge-queue bisection step failed in the step above, and stops as soon as one fails again
Installation
Install the package alongside pytest (>= 6.0.0):
pip install pytest-mergify
The plugin is auto-discovered by pytest — no manual registration required.
Configuration
Set the MERGIFY_TOKEN environment variable with your Mergify API token.
The plugin activates automatically when running in CI (detected via the CI environment variable). To enable outside CI, set MERGIFY_CI_ENABLE=true.
Environment Variables
| Variable | Description | Default |
|---|---|---|
MERGIFY_TOKEN |
Mergify API authentication token | (required) |
MERGIFY_API_URL |
Mergify API endpoint | https://api.mergify.com |
MERGIFY_CI_ENABLE |
Force-enable outside CI | false |
MERGIFY_CI_DEBUG |
Print spans to console instead of uploading | false |
MERGIFY_TRACEPARENT |
W3C distributed trace context | — |
MERGIFY_TEST_JOB_NAME |
Mergify test job name | — |
MERGIFY_FAIL_FIRST_ENABLE |
Set to false to never run first what a merge-queue bisection step of this job failed before |
true |
MERGIFY_TEST_RETRY_ENABLE |
Set to false to have this job retry no failing test, whatever the repository sets |
true |
The names these replace, PYTEST_MERGIFY_ENABLE and PYTEST_MERGIFY_DEBUG,
are deprecated: they still work when the new name is not set, and the plugin
says which one to switch to at the end of the session.
For detailed documentation, see the official guide.
Bisection steps: failures first
When Mergify's merge queue splits a failed batch, each bisection step only needs to tell whether it is red. The plugin asks Mergify whether the current run is such a step and, if so, runs first the tests this job failed in the run the step was split from (Fail First). They run before every other test; if one of them fails again, the step is red whatever the rest does, so the run stops there (exit code 1, the remaining tests not run) and the queue can split again without waiting for the suite. If they all pass, the rest of the suite runs as usual. No test is ever skipped, so a green step still comes from a full suite. A test a retry rescued, or a quarantined failure, does not stop the run.
It is on by default: there is nothing to configure, the plugin uses the token and job identity it already has, and Mergify decides. A job that must always run its suite in its usual order turns it off:
- name: Run tests
run: pytest
env:
MERGIFY_TOKEN: ${{ secrets.MERGIFY_TOKEN }}
MERGIFY_FAIL_FIRST_ENABLE: "false"
Such a job never queries the endpoint; everything else the plugin does — test
tracing, flaky detection, quarantine — is unaffected either way. Only a
recognised no (false, no, off, 0) turns it off.
MERGIFY_TEST_SELECTION_ENABLE, its former name, is still read while the new
one is unset or empty, and the summary at the end of the run says to switch.
It only ever asks in a build of a merge-queue batch, the only builds a
bisection step can be: on GitHub Actions, the event of the draft pull request
the queue opened; on any other build, the queue's git note on the branch, one
git ls-remote against origin that runs while the tests are being collected.
Every other build asks nothing and sends nothing. Of a batch's builds, only
those below a failed batch, and not retrying their own checks, ask: the
others cannot be a bisection step, and send their results only when the
batch holds two pull requests or more, so a bisection step may read them, or
when they failed. A build where git cannot answer (no origin, credentials
the test step does not hold) asks, as it would without this.
Every other situation — a run that is not a bisection step, an unreachable API, an answer from a newer Mergify this plugin does not understand — runs the full suite in its usual order. It is also enabled per organization on Mergify's side: until yours has it, every run is served the full suite, says nothing about it, and still sends its results, which show what Fail First would do there.
Under pytest-xdist this works with the load (the default with -n) and
worksteal schedulers; with loadgroup, tests marked xdist_group still run
before them. With loadscope and loadfile, xdist
schedules whole modules or classes by size, so those tests do not run first:
the run still stops once they have all run and one failed again. Workers on a
remote gateway (--tx ssh=…) run to the end.
An opted-in job also tells Mergify what it concluded when its session ends — which tests failed, how many ran — in one small request sent before the test results are uploaded. That is what the next bisection step of the job is answered from, seconds after this one finished, without waiting for the results to be processed. If that request fails, the run's own result is untouched: the terminal says so, and the next step simply runs its full suite in its usual order.
Development
Prerequisites
- Python >= 3.10
- uv
Setup
uv sync
Running Tests
uv run poe test
uv run poe build builds the wheel into dist/; when one is there,
poe test runs against it rather than the project's own install, which is
how CI builds the extension once for every Python version. Every uv-driven
build of the extension uses Cargo's dev profile.
Linting
uv run poe lint
License
Proprietary. Use is governed by the Mergify Terms of Service.
Metadata
Release files for pytest-mergify 2026.10.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| pytest_mergify-2026.10.10-cp310-abi3-win_amd64.whl | CPython 3.10 | abi3 | Windows x86-64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_x86_64.whl | CPython 3.10 | abi3 | Linux musl 1.2+ x86-64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_aarch64.whl | CPython 3.10 | abi3 | Linux musl 1.2+ ARM64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_x86_64.whl | CPython 3.10 | abi3 | Linux glibc 2.28+ x86-64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_aarch64.whl | CPython 3.10 | abi3 | Linux glibc 2.28+ ARM64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-macosx_11_0_arm64.whl | CPython 3.10 | abi3 | macOS 11.0+ ARM64 | Details |
| pytest_mergify-2026.10.10-cp310-abi3-macosx_10_12_x86_64.whl | CPython 3.10 | abi3 | macOS 10.12+ x86-64 | Details |
Total release size: 28.0 MB
Release files / pytest_mergify-2026.10.10-cp310-abi3-win_amd64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-win_amd64.whl |
|---|---|
| Size | 3.8 MB |
| Tags | CPython 3.10 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
d98970a8e16b0f1ae4273150898b682dc120c055251b8f5a6d6e0d055f14b1cc
|
|
BLAKE2b-256 checksum How to use checksums |
e244d98a25f51a487b69cf4dbc345cfeaa5456aaf975f780378a7269447e9bbf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_x86_64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 4.2 MB |
| Tags | CPython 3.10 Linux musl 1.2+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
b8b2a6270cfccdf1d933f2c7c78a1bbca8558231e47390d16fb0177a22fd8586
|
|
BLAKE2b-256 checksum How to use checksums |
a37d14ce5734181e45427cac241b74c582a742fe4ba0ca0dff85076ba17aed2c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_aarch64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-musllinux_1_2_aarch64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.10 Linux musl 1.2+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
ab5c8da7f903cc1d64d4bbf880e1406567f634cfe9b43d5f92739650bfffed0b
|
|
BLAKE2b-256 checksum How to use checksums |
db959806ee817ee35a5df74d28967bbfa45792277227bd80061d9790e5547eed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_x86_64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 4.2 MB |
| Tags | CPython 3.10 Linux glibc 2.28+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
44f74fabaef70d40e061c78b0e487b091416f8c8a27fcc7e9449951ddac24cea
|
|
BLAKE2b-256 checksum How to use checksums |
0a50bd9e5745ac04ab10a5d9b2b1422e8d02d44e82230a0d23a6ea916a3f1287
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_aarch64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.10 Linux glibc 2.28+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
53765fd95589eda5a9ef309fd9f01e15711e1d966ab7af19dc12cd47add3e1b2
|
|
BLAKE2b-256 checksum How to use checksums |
0ecf9b4b914f66c857827f87f45af08ab6161f76ad6fa1b4d4b583fe6c04f826
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-macosx_11_0_arm64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 3.8 MB |
| Tags | CPython 3.10 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
53dadb316c47cf5e7be3e6b0d654b8ec0a2e47924d05b81ba88f5aed9f4f4818
|
|
BLAKE2b-256 checksum How to use checksums |
771a9a289d20433a1091d23a547f4f86b73253b2631bbbdbe30be5c57724ce7a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logRelease files / pytest_mergify-2026.10.10-cp310-abi3-macosx_10_12_x86_64.whl
| Download URL | pytest_mergify-2026.10.10-cp310-abi3-macosx_10_12_x86_64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.10 abi3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
3ce645d88f531f1a32170330a8b3f549a75fd5a31c6f98826db149d6971e744f
|
|
BLAKE2b-256 checksum How to use checksums |
cfe82da53215a8fdd83fef448bb309b7bdcc9fb7de8b436cf8108ea942ca7647
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logSecurity for pytest-mergify 2026.10.10
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 7 files in this release have been uploaded with provenance metadata.
Attestation for pytest_mergify-2026.10.10-cp310-abi3-win_amd64.whl
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 27, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
