beyonddefer 1.0.5

The code for paper 'Is Learn to Defer Enough? Optimal Predictors that Incorporate Human Decisions'

Quick Start

In this package, we provide the code to reproduce the experiments in the paper "Is Learn to Defer Enough? Optimal Predictors that Incorporate Human Decisions". The main set of experiments are in Experiments/ (Section 7). In fact,

• in Experiments/acc_vs_c.py the code corresponding to the accuracy of methods based on additional defer cost is provided,
• in Experiments/CIFAR10K.py the code corresponding to the CIFAR10K experiment for different $K$ is provided,
• in Experiments/cost_sensitive_cov_acc.py the code of accuracy vs. coverage for cost-sensitive methods is provided,
• in Experiments/SampleComp.py the role of sample complexity is studied, and
• in Experiments/no_loss_cov_acc.py the code of accuracy vs. coverage for methods for 0-1 losses is provided.