Evaluation code for vision tasks.
Project description
Introduction
This repo contains evaluation metric codes used in Microsoft Cognitive Services Computer Vision for tasks such as classification and object detection.
Functionalities
This repo currently offers evaluation metrics for two vision tasks:
- Image classification:
evaluators.TopKAccuracyEvaluator
: computes the top-k accuracy, i.e., accuracy of the top k predictions with highest confidence.evaluators.AveragePrecisionEvaluator
: computes the average precision, precision averaged across different confidence thresholds.evaluators.ThresholdAccuracyEvaluator
: computes the threshold based accuracy, i.e., accuracy of the predictions with confidence over a certain threshold.evaluators.PrecisionEvaluator
: computes precisionevaluators.RecallEvaluator
: computes recallevaluators.EceLossEvaluator
: computes the ECE loss, i.e., the expected calibration error, given the model confidence and true labels for a set of data points.
- Object detection:
evaluators.MeanAveragePrecisionEvaluatorForSingleIOU
,evaluators.MeanAveragePrecisionEvaluatorForMultipleIOUs
: computes the mean average precision (mAP), i.e. mean average precision across different classes, under single or multiple IoU(s).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for vision_evaluation-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac5e66a2337dc84aed21a03654482577e11c5f3f91c3404d475f650939fa9085 |
|
MD5 | e20feaa764e4f5bd06d67feb9e8f9bd5 |
|
BLAKE2b-256 | cf462df7971165ffa27e5997f8e403c9a47b8997e93f0d36abe3fb57ff6d1b19 |