banditeval 0.1.0

On Speeding Up Language Model Evaluation

BanditEval

BanditEval is the official package for On Speeding Up Language Model Evaluation.

Installation

# Basic installation
pip install banditeval

# With examples dependencies
pip install banditeval[examples]

# With development tools
pip install banditeval[dev]

Citing Our Work

If you use BanditEval in your research, please cite:

@inproceedings{
zhou2025on,
title={On Speeding Up Language Model Evaluation},
author={Jin Peng Zhou and Christian K Belardi and Ruihan Wu and Travis Zhang and Carla P Gomes and Wen Sun and Kilian Q Weinberger},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025},
url={https://openreview.net/forum?id=3cvwO5DBZn}
}