Python package for ARS pass/fail test
Project description
Translator ARS Pass/Fail Testing
This testing framework performs single level pass/Fail analysis on queries it receives from the Test Runner.
ARS_Test Implementation
pip install ARS_Test_Runner
CLI
The command-line interface is the easiest way to run the ARS_Test_Runner After installation, simply type ARS_Test_Runner --help to see required input arguments & options
-
ARS_Test_Runner
- env : the environment to run the queries against (dev|ci|test|prod)
- query_type: treats(creative)
- expected_output: TopAnswer|Acceptable|BadButForgivable|NeverShow
- input_curie: normalized curie taken from assest.csv
- output_curie: target output curie to do analysis on
-
example:
- for single output
- ARS_Test_Runner --env 'test' --query_type 'treats_creative' --expected_output 'TopAnswer' 'MONDO:0015564' 'PUBCHEM.COMPOUND:5284616'
- for multi outputs
- ARS_Test_Runner --env 'ci' --query_type 'treats_creative' --expected_output '["TopAnswer","TopAnswer"]' --input_curie 'MONDO:0005301' --output_curie '["PUBCHEM.COMPOUND:107970","UNII:3JB47N2Q2P"]'
- for single output
python
from ARS_Test_Runner.semantic_test import run_semantic_test
report = run_semantic_test(env, query_type, expected_output, input_curie, output_curie)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ARS_Test_Runner-0.0.5.tar.gz
(7.6 kB
view hashes)
Built Distribution
Close
Hashes for ARS_Test_Runner-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc92b5723966375bd1ee7b4cb6819ee0d85b0cf16d9124b3f2b73eac0fb2b049 |
|
MD5 | 074c1a7a1c2b90de6dfcc717cca7acca |
|
BLAKE2b-256 | 2b334a1da69b723b5fcd50145e82ec95080897ae70e39fa0d8eb8a540cd1c253 |