Python package for ARS pass/fail test
Project description
Translator ARS Pass/Fail Testing
This testing framework performs single level pass/Fail analysis on queries it receives from the Test Runner.
ARS_Test Implementation
pip install ARS_Test_Runner
CLI
The command-line interface is the easiest way to run the ARS_Test_Runner After installation, simply type ARS_Test_Runner --help to see required input arguments & options
-
ARS_Test_Runner
- env : the environment to run the queries against (dev|ci|test|prod)
- predicate: treats
- runner_setting: creative mode inidicator (inferred)
- expected_output: TopAnswer|Acceptable|BadButForgivable|NeverShow
- input_curie: normalized curie taken from assest.csv
- output_curie: target output curie to do analysis on
-
example:
- for single output
- ARS_Test_Runner --env 'test' --predicate 'treats' --runner_setting '["inferred"]' --expected_output '["TopAnswer"]' --input_curie 'MONDO:0015564' --output_curie '["PUBCHEM.COMPOUND:5284616"]'
- for multi outputs
- ARS_Test_Runner --env 'ci' --predicate 'treats' --runner_setting '["inferred"]' --expected_output '["TopAnswer","TopAnswer"]' --input_curie 'MONDO:0005301' --output_curie '["PUBCHEM.COMPOUND:107970","UNII:3JB47N2Q2P"]'
- for single output
python
import asyncio
from ARS_Test_Runner.semantic_test import run_semantic_test
asyncio.run(run_semantic_test('ci','treats',['inferred'], ['TopAnswer','TopAnswer'],'MONDO:0005301',['PUBCHEM.COMPOUND:107970','UNII:3JB47N2Q2P']))
OR
python semantic_test.py --env 'ci' --predicate 'treats' --runner_setting 'inferred' --expected_output 'TopAnswer' 'TopAnswer' --input_curie 'MONDO:0005301' --output_curie 'PUBCHEM.COMPOUND:107970' 'UNI:3JB47N2Q2P'
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ARS_Test_Runner-0.0.9.tar.gz
(8.6 kB
view hashes)
Built Distribution
Close
Hashes for ARS_Test_Runner-0.0.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d68459593f52255af13d52b2bd83900f07e3a71510b885484720a1183a060d4a |
|
MD5 | cd107392880a6008bbb86bede6fb4801 |
|
BLAKE2b-256 | 98cddf0092d6c3e01f39135812b377162fb2578920bf2265f48fe2e050980c81 |