Compares weaknesses in multiple models
Project description
AutoRA Model Disagreement Experimentlist
The model disagreement experimentlist identifies experimental conditions $\vec{x}' \in X'$ with respect to a pairwise distance metric between theorist models, $P_{M_{i}}(\hat{y}, \vec{x}')$:
$$ \underset{\vec{x}'}{\arg\max}~(P_{M_{1}}(\hat{y}, \vec{x}') - P_{M_{2}}(\hat{y}, \vec{x}'))^2 $$
Example Code
from autora.experimentalist.model_disagreement import model_disagreement_sample
from autora.theorist.bms import BMSRegressor; BMSRegressor()
from autora.theorist.darts import DARTSRegressor; DARTSRegressor()
import numpy as np
#Meta-Setup
X = np.linspace(start=-3, stop=6, num=10).reshape(-1, 1)
y = (X**2).reshape(-1, 1)
n = 5
#Theorists
bms_theorist = BMSRegressor()
darts_theorist = DARTSRegressor()
bms_theorist.fit(X,y)
darts_theorist.fit(X,y)
#experimentlist
X_new = model_disagreement_sample(X, [bms_theorist, darts_theorist], n)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for autora_experimentalist_model_disagreement-2.0.1a0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d524fcbc6655b11487d3a457f6bd286c8837500b1d5a96b7fdf6845112a97ea |
|
MD5 | 62d5781d817fd1ee108c45b0f52d55ab |
|
BLAKE2b-256 | 74314649d85a28db67673f38f9b70b9f6bb6a331c7195b7899fc49b7cae836ef |
Close
Hashes for autora_experimentalist_model_disagreement-2.0.1a0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5e99a2c2478a7668600962ffc24a9c433dfcdeddde511f2bc7c015c23aa52f09 |
|
MD5 | 4f986697e1ccd445b4888fd3a8c6701a |
|
BLAKE2b-256 | 0f6c06ae96875084fe3acb44006f2e54a8b508bc236752233e8d32d6192a1d56 |