Skip to main content

DALEX in Python

Project description

dalex

moDel Agnostic Language for Exploration and eXplanation

Python-check PyPI version Downloads

Overview

Unverified black box model is the path to the failure. Opaqueness leads to distrust. Distrust leads to ignoration. Ignoration leads to rejection.

The dalex package xrays any model and helps to explore and explain its behaviour, helps to understand how complex models are working. The main Explainer object creates a wrapper around a predictive model. Wrapped models may then be explored and compared with a collection of local and global explainers. Recent developents from the area of Interpretable Machine Learning/eXplainable Artificial Intelligence.

The philosophy behind dalex explanations is described in the Explanatory Model Analysis e-book.

The dalex package is a part of DrWhy.AI universe.

Installation

pip install dalex

Resources

Plots

This package uses plotly to render the plots:

Learn more

Machine Learning models are widely used and have various applications in classification or regression tasks. Due to increasing computational power, availability of new data sources and new methods, ML models are more and more complex. Models created with techniques like boosting, bagging of neural networks are true black boxes. It is hard to trace the link between input variables and model outcomes. They are use because of high performance, but lack of interpretability is one of their weakest sides.

In many applications we need to know, understand or prove how input variables are used in the model and what impact do they have on final model prediction. DALEX is a set of tools that help to understand how complex models are working.

Talks about DALEX

Why

76 years ago Isaac Asimov devised Three Laws of Robotics: 1) a robot may not injure a human being, 2) a robot must obey the orders given it by human beings and 3) A robot must protect its own existence. These laws impact discussion around Ethics of AI. Today’s robots, like cleaning robots, robotic pets or autonomous cars are far from being conscious enough to be under Asimov’s ethics.

Today we are surrounded by complex predictive algorithms used for decision making. Machine learning models are used in health care, politics, education, judiciary and many other areas. Black box predictive models have far larger influence on our lives than physical robots. Yet, applications of such models are left unregulated despite many examples of their potential harmfulness. See Weapons of Math Destruction by Cathy O'Neil for an excellent overview of potential problems.

It's clear that we need to control algorithms that may affect us. Such control is in our civic rights. Here we propose three requirements that any predictive model should fulfill.

  • Prediction's justifications. For every prediction of a model one should be able to understand which variables affect the prediction and how strongly. Variable attribution to final prediction.
  • Prediction's speculations. For every prediction of a model one should be able to understand how the model prediction would change if input variables were changed. Hypothesizing about what-if scenarios.
  • Prediction's validations For every prediction of a model one should be able to verify how strong are evidences that confirm this particular prediction.

There are two ways to comply with these requirements. One is to use only models that fulfill these conditions by design. White-box models like linear regression or decision trees. In many cases the price for transparency is lower performance. The other way is to use approximated explainers – techniques that find only approximated answers, but work for any black box model. Here we present such techniques.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dalex-0.1.9.tar.gz (312.4 kB view details)

Uploaded Source

Built Distribution

dalex-0.1.9-py3-none-any.whl (324.4 kB view details)

Uploaded Python 3

File details

Details for the file dalex-0.1.9.tar.gz.

File metadata

  • Download URL: dalex-0.1.9.tar.gz
  • Upload date:
  • Size: 312.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.6

File hashes

Hashes for dalex-0.1.9.tar.gz
Algorithm Hash digest
SHA256 89a6abe39b38f876b6496af7aeee4f216d47fc2f878926b9f27c3ec4228c6f8c
MD5 818f6f8fff8d2a7487ea265a761a1c69
BLAKE2b-256 105abb0d81082c9e7aeb23fe1bf004254daf5c3b8c4ac55741f305bec2b2d5dd

See more details on using hashes here.

File details

Details for the file dalex-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: dalex-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 324.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.6

File hashes

Hashes for dalex-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 acb2c25998cc9a733b5674d3a595412e85bae8095051ff56ee0a867290d52fb4
MD5 27a6f946d6c3caa165bac6724fc42f59
BLAKE2b-256 7614ac57b1e63d4f07484cbf99b8d239532f48392071e8514b66d529e0405022

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page