Lens: comprehensive assessment framework for AI systems
Project description
Lens by Credo AI - Responsible AI Assessment Framework
Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community. In short, Lens connects arbitrary AI models and datasets with Responsible AI tools throughout the ecosystem.
Lens can be run in a notebook, a CI/CD pipeline, or anywhere else you do your ML analytics. It is extensible, and easily customized to your organizations assessments if they are not supported by default.
Though it can be used alone, Lens shows its full value when connected to your organization's Credo AI App. Credo AI is an end-to-end AI Governance App that supports multi-stakeholder alignment, AI assessment (via Lens) and AI risk assessment.
Dependencies
- Credo AI Lens supports Python 3.8+
- Sphinx (optional for local docs site)
Installation
The latest stable release (and required dependencies) can be installed from PyPI. Note this installation only includes dependencies needed for a small set of modules
pip install credoai-lens
To include additional dependencies needed for some modules and demos, use the following installation command.
On Mac
pip install 'credoai-lens[full]'
On Windows
pip install credoai-lens[full]
Modules that require extras include:
- nlp_generator
ARM Macbook failed pip installation - use conda
Installation sometimes fails on M1 macbooks. Specifically, pandas, scipy, and scikit-learn may fail to build. Installing these packages with the anaconda package manager seems to be the easiest way to circumvent this issue.
For development, the easiest way to interact with Lens is to use anaconda.
conda env create --file environment.yml
Getting Started
To get started, see the quickstart demo.
If you are using the Credo AI Governance App, also check out the governance integration demo.
A listing and overview of all the demonstration notebooks are available here.
Documentation
Documentation is hosted by readthedocs.
For dev documentation, see latest.
Configuration
To connect to Credo AI's Governance App, enter your connection info in ~/.credoconfig
(".credoconfig" in the root directory) using
the below format.
TENANT={tenant name} # Example: credoai
API_KEY=<your api key> # Example: JSMmd26...
For Lens developers
Running tests
Install requirements needed for testing.
pip install -r requirements-extras.txt
Running a test
scripts/test.sh
Running tests with pytest-watch
ptw --runner "pytest -s"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for credoai_lens-0.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fae8331b746ead0126f5ce88d3bf7e400950e414b8d5dc1f5c718d1d4abf498f |
|
MD5 | 973a57f7ef6e3a3b96afed99c300f294 |
|
BLAKE2b-256 | 43ae2175dd4daf456328b0bcfbe5c3c1bcd90bc165d4b6aa4e3f43a5d50cd36c |