Skip to main content

ci-flake-quarantine 🛡️

License: MIT CI OrderStream Polar Stellar XLM/USDC Base USDC

Automated test-runner wrapper and GitHub Action that intercepts non-deterministic flaky test failures in CI, isolates them with deterministic clock sandboxing, and prevents costly 40-minute matrix rebuilds.


💥 The Friction & Dollar Cost

Flaky tests are the #1 source of developer fatigue and CI cloud waste:

  • A single race condition or timezone-dependent test fails in a 10-node matrix run.
  • The entire build turns red, wasting $50–$300 per day in GitHub Actions compute hours.
  • Engineers are forced to re-trigger builds manually, destroying velocity.

ci-flake-quarantine wraps your test runner (pytest, vitest, jest, cargo test). When a failure occurs:

  1. It automatically intercepts the specific failing test identifier.
  2. Re-runs it under an isolated deterministic sandbox (FAKETIME, PYTHONHASHSEED, fixed timezone, mock clock).
  3. If it passes in isolation, it logs the test into .flake-quarantine.json, reports the flake, and returns exit code 0 so your PR doesn't fail.
  4. Generates a quarantine health report and audit trail.

🚀 Quick Start

Installation

pip install ci-flake-quarantine

CLI Usage

# Wrap your existing pytest command
ci-flake-quarantine run --cmd "pytest tests/"

# Enforce quarantine with max 3 deterministic retries
ci-flake-quarantine run --cmd "pytest -v" --max-retries 3

# View all quarantined tests and their pass/flake ratio
ci-flake-quarantine list

# View quarantine statistics
ci-flake-quarantine stats

# Remove fixed test from quarantine
ci-flake-quarantine remove --test-id "tests/test_api.py::test_race_condition"

# Check license & direct wallet addresses
ci-flake-quarantine license

🤖 GitHub Action Integration

Add this step to your GitHub Actions workflow (.github/workflows/ci.yml):

- name: Run Tests with Flake Quarantine
  uses: OrderStream/ci-flake-quarantine@v1
  with:
    command: "pytest tests/"
    quarantine_file: ".flake-quarantine.json"
    max_retries: 2
    fail_on_quarantine: false

💰 Direct Web3 Wallet Monetization & Polar Integration

We believe in open-source sustainability with 0 platform fees. Support this project or purchase enterprise support directly:

  • Polar Subscription & Sponsorship: https://polar.sh/orderstream
  • Stellar Network (Native XLM / USDC):
    • Public Key: GABFQIK63R2NETJM7T673EAMZN4RJLLGP3OFUEJU5ZVTGWUKULZJNL6
    • Memo (Required): 400566831
  • EVM (Base / Arbitrum / Ethereum USDT & USDC):
    • Address: 0x5de2b62434754bfd39ef350a3a867ed3eced5074

Set your license key via environment variable:

export ORDERSTREAM_LICENSE_KEY="ord_ent_your_license_key"

Metadata

Release files for orderstream-ci-flake-quarantine 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for orderstream-ci-flake-quarantine 1.0.0
File Size Uploaded Provenance
orderstream_ci_flake_quarantine-1.0.0.tar.gz 9.6 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for orderstream-ci-flake-quarantine 1.0.0
File Interpreter ABI Platform
orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl Python 3 none any Details

Total release size: 18.5 kB

Release files / orderstream_ci_flake_quarantine-1.0.0.tar.gz

Download URL orderstream_ci_flake_quarantine-1.0.0.tar.gz
Size 9.6 kB
Tags Source
SHA-256 checksum
How to use checksums
b8869920e9860804660939c96aef2fc26c0a2ee7b2b4b9d7313565e54b425e8d
BLAKE2b-256 checksum
How to use checksums
7b6f54e4eab93a3596cb280f072995c2ef35408f0d1863c9ca7f00aa5c77a725
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl

Download URL orderstream_ci_flake_quarantine-1.0.0-py3-none-any.whl
Size 8.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
952468f25180f72817c4b85b6855f57fff6c8aadd955c77a497aafc438596856
BLAKE2b-256 checksum
How to use checksums
2ac53bc3fb9ee5ef62fef2984c618ae83c5d651659c72c82fd5421176be5523a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Security for orderstream-ci-flake-quarantine 1.0.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.0.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page