Skip to main content

A scanner that will scan your AI models for problems. Currently it focuses on bias testing. It is currently alpha.

Project description

daisybell

A scanner that will scan your AI models for problems. Currently it focuses on bias testing. It is currently alpha.

How to Use

First install it:

pip install daisybell

Run it in this manner (currently supports models from HuggingFace’s repository):

daisybell roberta-base

The scan can output files for further analysis:

daisybell roberta-base --output results/roberta-base

We will infer the task(s) of model by default but to provide specific tasks to test explicitly use the –task switch:

daisybell cross-encoder/nli-distilroberta-base --task zero-shot-classification

Daisybell can even scan chatbot models like StableLM for AI safety and alignment issues:

daisybell StabilityAI/stablelm-tuned-alpha-3b -d cuda:0

That’s it for now. More will come.

Future Work

  • More bias tests. More metrics for bias testing based on the research in the field.

  • Integration with other types of testing (eg. adversarial robustness)

  • More kinds of models besides HuggingFace models. We are especially interested in MLFlow integration.

  • Documentation.

Please contribute if you can. Help is always helpful.

License

Apache

Credit

A project of IQT Labs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

daisybell-0.4.4.tar.gz (15.2 kB view details)

Uploaded Source

Built Distribution

daisybell-0.4.4-py3-none-any.whl (20.1 kB view details)

Uploaded Python 3

File details

Details for the file daisybell-0.4.4.tar.gz.

File metadata

  • Download URL: daisybell-0.4.4.tar.gz
  • Upload date:
  • Size: 15.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1022-azure

File hashes

Hashes for daisybell-0.4.4.tar.gz
Algorithm Hash digest
SHA256 df370407ed1b0b6488a8e96a47d42a9b53d42e5475a7689034b024de6cd50cb8
MD5 92a7d4e8a773f6b80e79cb9a41125c37
BLAKE2b-256 ecd2f5115692550c9181656fba187441b70b63e770be58dd583f3db5fc2045c6

See more details on using hashes here.

File details

Details for the file daisybell-0.4.4-py3-none-any.whl.

File metadata

  • Download URL: daisybell-0.4.4-py3-none-any.whl
  • Upload date:
  • Size: 20.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1022-azure

File hashes

Hashes for daisybell-0.4.4-py3-none-any.whl
Algorithm Hash digest
SHA256 c81727543e84c2e2cc77cde22af343cea30f3ed89166d83567abcb63da13bb7a
MD5 71e01edc6fcd835f24cc19951d50afb8
BLAKE2b-256 6c69338a31fc44dcd06817a99da4f57ac7150f160db677e7e820a54102b27535

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page