Skip to main content

Lens: comprehensive assessment framework for AI systems

Project description

Credo AI Lens


Lens by Credo AI - Responsible AI Assessment Framework

Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community. In short, Lens connects arbitrary AI models and datasets with Responsible AI tools throughout the ecosystem.

Lens can be run in a notebook, a CI/CD pipeline, or anywhere else you do your ML analytics. It is extensible, and easily customized to your organizations assessments if they are not supported by default.

Though it can be used alone, Lens shows its full value when connected to your organization's Credo AI App. Credo AI is an end-to-end AI Governance App that supports multi-stakeholder alignment, AI assessment (via Lens) and AI risk assessment.

Dependencies

  • Credo AI Lens supports Python 3.7+
  • Sphinx (optional for local docs site)

Installation

The latest stable release (and required dependencies) can be installed from PyPI. Note this installation only includes dependencies needed for a small set of modules

pip install credoai-lens

To include additional dependencies needed for some modules and demos, use the following installation command.

On Mac

pip install 'credoai-lens[extras]'

On Windows

pip install credoai-lens[extras]

Modules that require extras include:

  • nlp_generator

ARM Macbook failed pip installation - use conda

Installation sometimes fails on M1 macbooks. Specifically, pandas, scipy, and scikit-learn may fail to build. Installing these packages with the anaconda package manager seems to be the easiest way to circumvent this issue.

For development, the easiest way to interact with Lens is to use anaconda.

conda env create --file environment.yml

Getting Started

To get started, see the quickstart demo.

If you are using the Credo AI Governance App, also check out the governance integration demo.

A listing and overview of all the demonstration notebooks are available here.

Documentation

Documentation is hosted by readthedocs.

For dev documentation, see latest.

Configuration

To connect to Credo AI's Governance App, enter your connection info in ~/.credoconfig (".credoconfig" in the root directory) using the below format.

TENANT={tenant name} # Example: credoai
API_KEY=<your api key> # Example: JSMmd26...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

credoai-lens-0.0.6.tar.gz (659.7 kB view hashes)

Uploaded Source

Built Distribution

credoai_lens-0.0.6-py3-none-any.whl (1.1 MB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page