Train and use expectation detector in Robot Framework tests.
Project description
NOTE: This is currently an alpha version! Use with CURIOSITY and caution :D
Library to train computers to validate expected results based on examples. Validate something big and volatile with ease. Make your testing smarter with applying machine learning.
This library exposes only one robot framework keyword: Should be as expected ${VALUE}. It checks expectations of what a ${VALUE} should be against generated expectations json file. Expectation file is in human readable format and can be edited manually. System will generate expectations automatically.
How to use this:
- Install from PyPI pip install robotframework-expects
- Add library to RF test suite in training mode Library Expects TRAINING
- Catch a value ${VALUE}= .. from your SUT in your test
- Add expect block to the test Should be as expected ${VALUE}
- Run your test robot yoursuite.robot -> generates a file yoursuite_expects.json
- Change library to normal mode Library Expects (remove TRAINING)
- Run your tests
Improving expectations
There are three ways to improve expectations:
- Run a test multiple times in TRAINING mode to gain better validation model from multiple example runs.
- Run a test in INTERACTIVE mode to stop execution on failing Should be as expected. Then explore and make a better validation model.
- Modifying _expects.json by hand.
When expectations change
If your system changes in a way that old expectations should not be used, just remove _expects.json file and switch library to TRAINING mode. Then run your test to record new expectations.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size | File type | Python version | Upload date | Hashes |
---|---|---|---|---|
Filename, size robotframework_expects-0.4.0-py3-none-any.whl (13.9 kB) | File type Wheel | Python version py3 | Upload date | Hashes View |
Filename, size robotframework-expects-0.4.0.tar.gz (13.7 kB) | File type Source | Python version None | Upload date | Hashes View |
Hashes for robotframework_expects-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 70c95bf067ea2133ed72bcd059c8f25ff8c653626840b93663618a85569b1dfa |
|
MD5 | c85b93c82540f485827a3d4ff5da77d2 |
|
BLAKE2-256 | ab32ed4354074719f10b654f0fbcb818d5f0c8463b95c850ff3643f86454535a |
Hashes for robotframework-expects-0.4.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea92b8aedb0df7eb4a7dca6e0fdaebffd70b66878c136ec4304f7c27ca61bae6 |
|
MD5 | c7205863b56058d415c39f2fc4258769 |
|
BLAKE2-256 | 2f57d27f9768ff9d35cc20a1ca85288e5b42fecf4559077cc152baa8973b8a59 |