Translator UI Test Runner
Project description
Translator UI Test Runner
This testing framework performs UI Pass/Fail analysis on queries it receives from the Translator Test Harness.
Installation
pip install ui-test-runner
Usage
from ui_test_runner import run_ui_test
report = run_ui_test(<env>, <query_type>, <expected_output>, <input_curie>, <output_curie>)
Arguements:
- env: the environment to run the queries against. (dev, ci, test, prod)
- query_type: type of query to test. (treats(creative), upregulates, downregulates)
- expected_output: whether the output curie is good or bad. (TopAnswer, Acceptable, BadButForgivable, NeverShow)
- input_curie: curie used in the initial query.
- output_curie: curie checked for in the results
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ui-test-runner-0.0.2.tar.gz
(3.1 kB
view hashes)
Built Distribution
Close
Hashes for ui_test_runner-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f433c611c5e15fc80a1591453af7880920cb3bb462feb7cce941626f67a37541 |
|
MD5 | 17262114d6e5425b2247974407921d9c |
|
BLAKE2b-256 | 78e66d11c47c93fc9f44e1702332ced30edeab1b07d0ee7aa85d7ec48d11d774 |