Skip to main content

Translator UI Test Runner

This testing framework performs UI Pass/Fail analysis on queries it receives from the Translator Test Harness.

Installation

pip install ui-test-runner

Usage

from ui_test_runner import run_ui_test
report = run_ui_test(<env>, <query_type>, <expected_output>, <input_curie>, <output_curie>)

Arguements:

  • env: the environment to run the queries against. (dev, ci, test, prod)
  • query_type: type of query to test. (treats(creative), upregulates, downregulates)
  • expected_output: whether the output curie is good or bad. (TopAnswer, Acceptable, BadButForgivable, NeverShow)
  • input_curie: curie used in the initial query.
  • output_curie: curie checked for in the results

Metadata

Release files for ui-test-runner 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ui-test-runner 0.0.2
File Size Uploaded
ui-test-runner-0.0.2.tar.gz 3.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for ui-test-runner 0.0.2
File Interpreter ABI Platform
ui_test_runner-0.0.2-py3-none-any.whl Python 3 none any Details

Total release size: 6.3 kB

Release files / ui-test-runner-0.0.2.tar.gz

Download URL ui-test-runner-0.0.2.tar.gz
Size 3.1 kB
Tags Source
SHA-256 checksum
How to use checksums
0ea05cff18cbb7f049c44b5c69dc5cfb05596e15368c9c2a6582de31a638a55f
BLAKE2b-256 checksum
How to use checksums
b375a76fd4c93b1baa647cbcb3a4e019b39943d84ef01d746e9abedeb31264d8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/4.0.2 CPython/3.11.6

Release files / ui_test_runner-0.0.2-py3-none-any.whl

Download URL ui_test_runner-0.0.2-py3-none-any.whl
Size 3.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f433c611c5e15fc80a1591453af7880920cb3bb462feb7cce941626f67a37541
BLAKE2b-256 checksum
How to use checksums
78e66d11c47c93fc9f44e1702332ced30edeab1b07d0ee7aa85d7ec48d11d774
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/4.0.2 CPython/3.11.6

Release history Release notifications | RSS feed

This release

0.0.2 This release

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page