Skip to main content

Hardened Extension of the Adversarial Robustness Toolbox (HEART) supports assessment of adversarial AI vulnerabilities in Test & Evaluation workflows.

Project description

Hardened Extension of the Adversarial Robustness Toolbox (HEART)

Static Badge

HEART is a Python extension library for Machine Learning Security that builds on the popular Adversarial Robustness algorithms within the Adversarial Robustness Toolbox (ART). The extension library allows the user to leverage core ART algorithms while providing additional benefits to AI Test & Evaluation (T&E) engineers. HEART documentation can be found here.

  • Support for T&E of models for Department of Defense use cases
  • Alignment to MAITE protocols for seamless T&E workflows
  • Essential subset of adversarial robustness methods for targeted AI security coverage
  • Quality assurance of model assessments in the form of metadata
  • In-depth support for users based on codified T&E expert experience in form of guides and examples
  • Front-end application for low-code users: HEART Gradio Application

Installation

From Python Packaging Index (PyPI)

To install the latest version of HEART from PyPI, run:

pip install heart-library

From IBM GitHub Source

To install the latest version of HEART from the heart-library public GitHub, run:

git clone https://github.com/IBM/heart-library.git
cd heart-library
pip install .

(Optional) Development Environment via Poetry

In some cases, it may be beneficial for developers to set up an environment from a reproducible source of truth. This environment is useful for developers that wish to work within a pull request or leverage the same development conditions used by HEART contributors. Please follow the instructions for installation via Poetry within the official HEART repository:

Getting Started With HEART

IBM has published a catalog of notebooks designed to assist developers of all skill levels with the process of getting started utilizing HEART in their AI T&E workflows. These Jupyter notebooks can be accessed within the official heart-library GitHub repository:

HEART Modules

The HEART library is organized into three primary modules: attacks, estimators, and metrics.

heart_library.attacks

The HEART attacks module contains implementations of attack algorithms for generating adversarial examples and evaluating model robustness.

heart_library.estimators

The HEART estimators module contains classes that wrap and extend the evaluated model to make it compatible with attacks and metrics.

heart_library.metrics

The HEART metrics module implements industry standard, commonly-used T&E metrics for model evaluation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

heart_library-0.4.4.tar.gz (23.1 kB view details)

Uploaded Source

Built Distribution

heart_library-0.4.4-py3-none-any.whl (33.3 kB view details)

Uploaded Python 3

File details

Details for the file heart_library-0.4.4.tar.gz.

File metadata

  • Download URL: heart_library-0.4.4.tar.gz
  • Upload date:
  • Size: 23.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.10

File hashes

Hashes for heart_library-0.4.4.tar.gz
Algorithm Hash digest
SHA256 174465700fdc97cd39f8d435542b61c74c3fedabd1d61669eeaead4ab0a8f83a
MD5 f710fe17da5a07dac23b926c26e224ba
BLAKE2b-256 763a78037c4c94e33580cd01a942e61b71e2a1aac018295067aa56905ef8b46f

See more details on using hashes here.

File details

Details for the file heart_library-0.4.4-py3-none-any.whl.

File metadata

File hashes

Hashes for heart_library-0.4.4-py3-none-any.whl
Algorithm Hash digest
SHA256 7ee6dae1b8a2592801e26d42d2c3e9d8b71ef8d170fbac76b738f0b5c414be36
MD5 74d677b79efa4f8c93ea6c84d0a613cd
BLAKE2b-256 33974e8f4c75d2cd3e4c64727f7c439d352b575327ce314c3480697d8f9881cd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page