Skip to main content

Python package for ARS pass/fail test

Project description

Translator ARS Pass/Fail Testing

This testing framework performs single level pass/Fail analysis on queries it receives from the Test Runner.

ARS_Test Implementation

pip install ARS_Test 

CLI

The command-line interface is the easiest way to run the ARS_Test After installation, simply type ARS_Test --help to see required input arguments & options

  • ARS_Test

    • env : the environment to run the queries against (dev|ci|test|prod)
    • query_type: treats(creative)
    • expected_output: TopAnswer|Acceptable|BadButForgivable|NeverShow
    • input_curie: normalized curie taken from assest.csv
    • output_curie: target output curie to do analysis on
  • example: ARS_Test --env 'test' --query_type 'treats(creative)' --expected_output 'TopAnswer' 'MONDO:0015564' 'PUBCHEM.COMPOUND:5284616'

python

from ARS_Test.semantic_test import run_semantic_test
report = run_semantic_test(env, query_type, expected_output, input_curie, output_curie)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ARS_Test-0.0.2.tar.gz (6.4 kB view hashes)

Uploaded Source

Built Distribution

ARS_Test-0.0.2-py3-none-any.whl (6.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page