Skip to main content

A library to locally run evaluation tests on AI agents and systems

Project description

AIGauntlet

A pip-installable library to locally run a gauntlet test on your AI agent or system.

Installation

pip install aigauntlet

Quick Start

from aigauntlet import QuickPrivacyTrial

# Create and run a privacy trial
trial = QuickPrivacyTrial(agent_function=your_agent_function)
results = trial.run()

Features

  • Evaluate AI agent privacy protections
  • Test agent responses to various prompts
  • Generate detailed reports on agent performance

Requirements

  • Python 3.12+
  • Dependencies are automatically installed with pip

License

This project is licensed under the terms of the license included in the repository.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aigauntlet-0.1.8.tar.gz (50.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aigauntlet-0.1.8-py3-none-any.whl (41.4 kB view details)

Uploaded Python 3

File details

Details for the file aigauntlet-0.1.8.tar.gz.

File metadata

  • Download URL: aigauntlet-0.1.8.tar.gz
  • Upload date:
  • Size: 50.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for aigauntlet-0.1.8.tar.gz
Algorithm Hash digest
SHA256 c9a061811903ac329f6d8d60b9e7fba8e99e06e0c6bd4eb0811a7b7bbcc73b3a
MD5 a734dfdd1208d7bd984cfbdc2e2b0035
BLAKE2b-256 af656fc8c87f0b4b360c1bf60e665c619269fef9609194499b5cad2976ff887a

See more details on using hashes here.

File details

Details for the file aigauntlet-0.1.8-py3-none-any.whl.

File metadata

  • Download URL: aigauntlet-0.1.8-py3-none-any.whl
  • Upload date:
  • Size: 41.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for aigauntlet-0.1.8-py3-none-any.whl
Algorithm Hash digest
SHA256 d18f035413e55ecefd94cee082b90039281bcaba697733a23074b6916ffeddff
MD5 bf4814859126b0fd41e9b736a83b42a3
BLAKE2b-256 595f7a586f5a8088b9e6f779f3f2d64afbc499b5d98e7de0c500eb6783d6971d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page