AI Verify Test Engine provides core interfaces, converters, data, model and plugin managers to facilitate the development of tests for AI systems. It is used as a base library for all AI Verify official stock-plugins and can be used to develop custom plugins.
Project description
AI Verify Test Engine
Description
AI Verify Test Engine provides core interfaces, converters, data, model and plugin managers to facilitate the development of tests for AI systems. It is used as a base library for all AI Verify official stock-plugins and can be used to develop custom plugins.
Installation
[!IMPORTANT]
Currently, aiverify-test-engine is in alpha release. To install the package, you should specify the version i.e.pip install aiverify-test-engine==2.0.0a1
.
Install aiverify-test-engine
via pip. The following table list the available install options and the optional dependencies along with the additional functionality that is supported.
Installation Command | Description |
---|---|
pip install aiverify-test-engine |
Installs only the core functionalites. Supports tabular data formats like CSV, as well as Pandas pickle and Joblib files, and Scikit-learn models. |
pip install aiverify-test-engine[dev] |
Includes additional dependencies for development. Intended for developers who want to contribute to the project. |
pip install aiverify-test-engine[tensorflow] |
Installs optional Tensorflow and Keras dependencies. |
pip install aiverify-test-engine[gbm] |
Installs XGBoost and LightGBM packages. Supports serializing models in these formats. |
pip install aiverify-test-engine[all] |
Installs the core package along with all additional non development dependencies. |
Developer Guide
Local Installation
To contribute changes to the test engine code, clone the repository, navigate to the aiverify-test-engine
folder, and install the dev version of the library:
pip install '.[dev]'
Here's an overview of the project folder structure and a brief description of each:
aiverify-test-engine/
├── aiverify_test_engine/ # Core library code
│ ├── interfaces/ # Core interfaces (algorithm, converter, data, model, pipeline, serializer, plugin)
│ ├── io/ # Data and model IO related logic
│ ├── plugins/ # Manage the loading and execution of algorithm, data, model, pipeline and plugins
│ ├── utils/ # Utility functions and validators
├── tests/ # Test cases
├── pyproject.toml # Project configuration file
Running Tests
python -m pytest tests
Building the Package
hatch build
License
- Licensed under Apache Software License 2.0
Developers:
- AI Verify
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file tlrx_test_engine-2.0.0a1.tar.gz
.
File metadata
- Download URL: tlrx_test_engine-2.0.0a1.tar.gz
- Upload date:
- Size: 772.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.26.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b80ae75dcd838967dd16268a28328911e68ba76b608a7281d84443425cb2996e |
|
MD5 | e9f3fa5bfc9574b0a2b5738046e27b01 |
|
BLAKE2b-256 | e09760eea413daca99d4862344459da9d19d453b96c9bff37eff5601c713f1bb |
File details
Details for the file tlrx_test_engine-2.0.0a1-py3-none-any.whl
.
File metadata
- Download URL: tlrx_test_engine-2.0.0a1-py3-none-any.whl
- Upload date:
- Size: 83.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.26.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e787acdccd41627e9c68a2bb8069e476e8f560f14da0df56a5ed66a6d75a5a2 |
|
MD5 | c46e60fd0d85e3d35725bedd85a1d2bf |
|
BLAKE2b-256 | c144dc41fce8adefbc517510a8138d0be3a3b05cf6e79f4bbe6be24a2a11009a |