Pytest resource guard infrastructure for enforcing test marks on external resource usage
Project description
resource-guards
Pytest infrastructure for enforcing that tests declare their external resource usage via marks.
Resource guards catch two classes of bugs:
- Missing marks: a test calls an external resource without the corresponding
@pytest.mark.<resource>. The guard fails the test with a clear message. - Superfluous marks: a test carries a resource mark but never actually invokes the resource. The guard fails the test so the mark doesn't rot.
How it works
There are two guard mechanisms, covering CLI binaries and Python SDKs respectively.
Binary guards create wrapper scripts that shadow the real binary on PATH. During a test, the wrapper checks environment variables to decide whether the test is allowed to use the binary. If not, it records a tracking file and exits 127. If yes, it records a tracking file and delegates to the real binary.
SDK guards monkeypatch a chokepoint in a Python SDK. The monkeypatched function calls enforce_sdk_guard(), which checks the same environment variables and either raises ResourceGuardViolation or records a tracking file.
Both mechanisms use per-test tracking files so the makereport hook can detect violations even when the test swallows errors or handles non-zero exit codes.
Built-in guards
mngr provides Docker guards out of the box (in imbue.mngr.register_guards_docker), and the mngr_modal plugin provides Modal guards (in imbue.mngr_modal.register_guards). These are registered automatically in each project's conftest.py.
Setup
In your conftest.py, register each resource you want to guard with register_resource_guard(), then add pytest_configure, pytest_sessionstart, and pytest_sessionfinish hooks as shown below. register_guarded_resource_markers registers the pytest marks for all guarded resources in one call.
# conftest.py
from imbue.resource_guards.resource_guards import (
register_guarded_resource_markers,
register_resource_guard,
start_resource_guards,
stop_resource_guards,
)
register_resource_guard("tmux")
register_resource_guard("rsync")
def pytest_configure(config):
register_guarded_resource_markers(config)
def pytest_sessionstart(session):
start_resource_guards(session)
def pytest_sessionfinish(session, exitstatus):
stop_resource_guards()
Then mark your tests:
import pytest
@pytest.mark.tmux
def test_agent_creates_tmux_session():
...
Writing a custom SDK guard
You can guard any Python SDK by registering an install/cleanup pair:
from imbue.resource_guards.resource_guards import enforce_sdk_guard
from imbue.resource_guards.resource_guards import register_sdk_guard
_originals = {}
def _install():
_originals["send"] = SomeClient.send
SomeClient.send = _guarded_send
def _cleanup():
if "send" in _originals:
SomeClient.send = _originals["send"]
_originals.clear()
def _guarded_send(self, *args, **kwargs):
enforce_sdk_guard("my_sdk")
return _originals["send"](self, *args, **kwargs)
register_sdk_guard("my_sdk", _install, _cleanup)
The key requirement is that your monkeypatch calls enforce_sdk_guard("my_sdk") at the SDK's chokepoint -- the single method through which all external calls flow.
Compatibility with pytest-xdist
Binary guards work transparently with xdist. The controller process creates the wrapper scripts and modifies PATH; workers inherit both via environment variables. SDK guards are installed independently in each process (controller and workers), since monkeypatches are process-local.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file resource_guards-0.1.4.tar.gz.
File metadata
- Download URL: resource_guards-0.1.4.tar.gz
- Upload date:
- Size: 17.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bc903411059cad8b3b8004b54dfc4949b548d19e13007e95f4bdd37211c94183
|
|
| MD5 |
b789f1b1bba82a22ec6d05b185577986
|
|
| BLAKE2b-256 |
4daf11d6bc89cd3a14eeef42b0e2b5c10e05c6243c3696d9618211544a5d5529
|
Provenance
The following attestation bundles were made for resource_guards-0.1.4.tar.gz:
Publisher:
publish.yml on imbue-ai/mngr
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
resource_guards-0.1.4.tar.gz -
Subject digest:
bc903411059cad8b3b8004b54dfc4949b548d19e13007e95f4bdd37211c94183 - Sigstore transparency entry: 1343432615
- Sigstore integration time:
-
Permalink:
imbue-ai/mngr@86371056a9fa4d52a710bb614e952d7f4c51bd1a -
Branch / Tag:
refs/tags/v0.2.5 - Owner: https://github.com/imbue-ai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@86371056a9fa4d52a710bb614e952d7f4c51bd1a -
Trigger Event:
push
-
Statement type:
File details
Details for the file resource_guards-0.1.4-py3-none-any.whl.
File metadata
- Download URL: resource_guards-0.1.4-py3-none-any.whl
- Upload date:
- Size: 9.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d8fff74006866cb966148a39fd605761a4c7af9d2f423ac621f61700e03fafda
|
|
| MD5 |
b32a6095fc9f91cd7a7bbe2b8d2c494b
|
|
| BLAKE2b-256 |
4ef9892f5aa418935ffec77702f8788a1bcd43841642216d049485419f541f2e
|
Provenance
The following attestation bundles were made for resource_guards-0.1.4-py3-none-any.whl:
Publisher:
publish.yml on imbue-ai/mngr
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
resource_guards-0.1.4-py3-none-any.whl -
Subject digest:
d8fff74006866cb966148a39fd605761a4c7af9d2f423ac621f61700e03fafda - Sigstore transparency entry: 1343433534
- Sigstore integration time:
-
Permalink:
imbue-ai/mngr@86371056a9fa4d52a710bb614e952d7f4c51bd1a -
Branch / Tag:
refs/tags/v0.2.5 - Owner: https://github.com/imbue-ai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@86371056a9fa4d52a710bb614e952d7f4c51bd1a -
Trigger Event:
push
-
Statement type: