Robust ML API
Interfaces for defining Robust ML models and precisely specifying the threat models under which they claim to be secure. Also includes interfaces for specifying attacks and evaluating attacks against models.
The motivation behind this project is to make it easy to make specific, testable claims about the robustness about machine learning models. Read more in the FAQ.
You can install from PyPI: pip install robustml.
See this repository for a complete example of implenenting a model, implementing an attack, and evaluating the attack against the model.
If you’re implementing a defense, you should implement robustml.model.Model. See here for an example.
If you’re implementing an attack against a specific defense, you should implement robustml.attack.Attack. See here for an example.
To evaluate a specific attack against a specific defense, use robustml.evaluate.evaluate(). See here for an example.
Before contributing a major change, it’s recommended that you open a pull request first and get feedback on the idea before investing time in the implementation.
Update version information.
Build the package using python setup.py sdist bdist_wheel.
Sign and upload the package using twine upload -s dist/*.
Create a signed tag in the git repo with the version number that was uploaded to PyPI.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.