ci-flake-quarantine 🛡️
Automated test-runner wrapper and GitHub Action that intercepts non-deterministic flaky test failures in CI, isolates them with deterministic clock sandboxing, and prevents costly 40-minute matrix rebuilds.
💥 The Friction & Dollar Cost
Flaky tests are the #1 source of developer fatigue and CI cloud waste:
- A single race condition or timezone-dependent test fails in a 10-node matrix run.
- The entire build turns red, wasting $50–$300 per day in GitHub Actions compute hours.
- Engineers are forced to re-trigger builds manually, destroying velocity.
ci-flake-quarantine wraps your test runner (pytest, vitest, jest, cargo test). When a failure occurs:
- It automatically intercepts the specific failing test identifier.
- Re-runs it under an isolated deterministic sandbox (
FAKETIME,PYTHONHASHSEED, fixed timezone, mock clock). - If it passes in isolation, it logs the test into
.flake-quarantine.json, reports the flake, and returns exit code0so your PR doesn't fail. - Generates a quarantine health report and audit trail.
🚀 Quick Start
Installation
pip install ci-flake-quarantine
CLI Usage
# Wrap your existing pytest command
ci-flake-quarantine run --cmd "pytest tests/"
# Enforce quarantine with max 3 deterministic retries
ci-flake-quarantine run --cmd "pytest -v" --max-retries 3
# View all quarantined tests and their pass/flake ratio
ci-flake-quarantine list
# View quarantine statistics
ci-flake-quarantine stats
# Remove fixed test from quarantine
ci-flake-quarantine remove --test-id "tests/test_api.py::test_race_condition"
# Check license & direct wallet addresses
ci-flake-quarantine license
🤖 GitHub Action Integration
Add this step to your GitHub Actions workflow (.github/workflows/ci.yml):
- name: Run Tests with Flake Quarantine
uses: OrderStream/ci-flake-quarantine@v1
with:
command: "pytest tests/"
quarantine_file: ".flake-quarantine.json"
max_retries: 2
fail_on_quarantine: false
💰 Direct Web3 Wallet Monetization & Polar Integration
We believe in open-source sustainability with 0 platform fees. Support this project or purchase enterprise support directly:
- Polar Subscription & Sponsorship: https://polar.sh/orderstream
- Stellar Network (Native XLM / USDC):
- Public Key:
GABFQIK63R2NETJM7T673EAMZN4RJLLGP3OFUEJU5ZVTGWUKULZJNL6 - Memo (Required):
400566831
- Public Key:
- EVM (Base / Arbitrum / Ethereum USDT & USDC):
- Address:
0x5de2b62434754bfd39ef350a3a867ed3eced5074
- Address:
Set your license key via environment variable:
export ORDERSTREAM_LICENSE_KEY="ord_ent_your_license_key"
Metadata
Release files for orderstream-ci-flake-quarantine 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| orderstream_ci_flake_quarantine-1.0.0.tar.gz | 9.6 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 18.5 kB
Release files / orderstream_ci_flake_quarantine-1.0.0.tar.gz
| Download URL | orderstream_ci_flake_quarantine-1.0.0.tar.gz |
|---|---|
| Size | 9.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b8869920e9860804660939c96aef2fc26c0a2ee7b2b4b9d7313565e54b425e8d
|
|
BLAKE2b-256 checksum How to use checksums |
7b6f54e4eab93a3596cb280f072995c2ef35408f0d1863c9ca7f00aa5c77a725
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl
| Download URL | orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl |
|---|---|
| Size | 8.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
952468f25180f72817c4b85b6855f57fff6c8aadd955c77a497aafc438596856
|
|
BLAKE2b-256 checksum How to use checksums |
2ac53bc3fb9ee5ef62fef2984c618ae83c5d651659c72c82fd5421176be5523a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Security for orderstream-ci-flake-quarantine 1.0.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.