Skip to main content

Translator ARS Pass/Fail Testing

This testing framework performs single level pass/Fail analysis on queries it receives from the Test Runner.

ARS_Test Implementation

pip install ARS_Test 

CLI

The command-line interface is the easiest way to run the ARS_Test After installation, simply type ARS_Test --help to see required input arguments & options

  • ARS_Test

    • env : the environment to run the queries against (dev|ci|test|prod)
    • query_type: treats(creative)
    • expected_output: TopAnswer|Acceptable|BadButForgivable|NeverShow
    • input_curie: normalized curie taken from assest.csv
    • output_curie: target output curie to do analysis on
  • example: ARS_Test --env 'test' --query_type 'treats(creative)' --expected_output 'TopAnswer' 'MONDO:0015564' 'PUBCHEM.COMPOUND:5284616'

python

from ARS_Test.semantic_test import run_semantic_test
report = run_semantic_test(env, query_type, expected_output, input_curie, output_curie)

Metadata

Release files for ARS-Test 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ARS-Test 0.0.2
File Size Uploaded
ARS_Test-0.0.2.tar.gz 6.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for ARS-Test 0.0.2
File Interpreter ABI Platform
ARS_Test-0.0.2-py3-none-any.whl Python 3 none any Details

Total release size: 13.3 kB

Release files / ARS_Test-0.0.2.tar.gz

Download URL ARS_Test-0.0.2.tar.gz
Size 6.4 kB
Tags Source
SHA-256 checksum
How to use checksums
01b60692be46c1ac2c90a2c373ade05592f4b24786ac1a7c549a0899bbae1af9
BLAKE2b-256 checksum
How to use checksums
fa12db4b2f90a1aa81e22350a98ff2349c9fb179b73475815ee5b9b671ea24e9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.7

Release files / ARS_Test-0.0.2-py3-none-any.whl

Download URL ARS_Test-0.0.2-py3-none-any.whl
Size 6.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
4714c6ea21a29dfeb581b4e2ff4b3b586cdbf37f8f9b3e2c7e09c59bc94278bb
BLAKE2b-256 checksum
How to use checksums
d870e8aec20a9376559feadb9e0dc36ef3333d9f199c9bf357b2c182da9b9a04
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.7

Release history Release notifications | RSS feed

This release

0.0.2 This release

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page