py.test plugin to store test expectations and mark tests based on them
A py.test plugin that stores test expectations by saving the set of failing tests, allowing them to be marked as xfail when running them in future. The tests expectations are stored such that they can be distributed alongside the tests. However, note that test expectations can only be reliably shared between Python 2 and Python 3 if they only use ASCII characters in their node ids: this likely isn’t a limitation if tests are using the normal Python format, as Python 2 only allows ASCII characters in identifiers.
We follow semver. Our public API is defined by the expectation file and the command line parameters.
In other words: for a given major release (e.g., 1.y.z), expectation files and command line parameters will remain compatible. Across major versions, we’ll try to break as little as possible. All pre-release (0.y.z) versions should be compatible with each other, but are unlikely to be compatible with 1.0.0.