Skip to main content

Calculates the mAP value in object detection tasks

Project description

mapcalc (mean average precision calculator)

Table of contents

Introduction

For object detection in images the mAP (mean average precision) metric is often used to see how good the implementation is. As no packages that make the calculation for you were available at this time, I adapted the implementation from João Cartucho, which uses files which hold the detection results. It now can be installed as a package with pip and simply gives you the mAP value at a certain iou threshold.

Explanation

The performance of your neural net will be judged using the mAP criterium defined in the PASCAL VOC 2012 competition. The code from official Matlab code was adapted into Python.

Prerequisites

Packages needed:

  • numpy

Usage

from mapcalc import calculate_map, calculate_map_range

ground_truth = {
    'boxes':
        [[60., 80., 66., 92.],
         [59., 94., 68., 97.],
         [70., 87., 81., 94.],
         [8., 34., 10., 36.]],

    'labels':
        [2, 2, 3, 4]}

result_dict = {
    'boxes':
        [[57., 87., 66., 94.],
         [58., 94., 68., 95.],
         [70., 88., 81., 93.],
         [10., 37., 17., 40.]],

    'labels':
        [2, 3, 3, 4],

    'scores':
        [0.99056727, 0.98965424, 0.93990153, 0.9157755]}

# calculates the mAP for an IOU threshold of 0.5
print(calculate_map(ground_truth, result_dict, 0.5))

# calculates the mAP average for the IOU thresholds 0.05, 0.1, 0.15, ..., 0.90, 0.95.
print(calculate_map_range(ground_truth, result_dict, 0.05, 0.95, 0.05))

The methods expect two dicts:

  • ground_truth_dict with {boxes:, labels:}
  • result_dict with {boxes:, labels:, scores:}

Boxes: A list of [x1, y1, x2, y2] (or [u, v, u + w, v + h], where (u, v) is the bounding box corner and (w, h) is the shape of the bounding box, so width and height), each representing a box that was detected.

Labels: List of classes (int) the algorithm assigned to the box

Scores: List of scores (float) the algorithm generated. If not specified, scores will be set to 1.

Authors:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mapcalc-0.2.2.tar.gz (9.0 kB view details)

Uploaded Source

Built Distribution

mapcalc-0.2.2-py3-none-any.whl (9.5 kB view details)

Uploaded Python 3

File details

Details for the file mapcalc-0.2.2.tar.gz.

File metadata

  • Download URL: mapcalc-0.2.2.tar.gz
  • Upload date:
  • Size: 9.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.4

File hashes

Hashes for mapcalc-0.2.2.tar.gz
Algorithm Hash digest
SHA256 3f9462b52ed97e41b6895023f285d209b8edb46c86544989a20b3d0658cc20c2
MD5 7a849cf6fb6ab0933e2e60695386a281
BLAKE2b-256 267ea44dd6d2e06250162dd9f0479cea687833d917e3cb95bd7ecdcb75c61098

See more details on using hashes here.

File details

Details for the file mapcalc-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: mapcalc-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 9.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.4

File hashes

Hashes for mapcalc-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 2629cdaadc569cbc21e6c94a40a37b577b4b02c32091e54364fe840b491fbef9
MD5 c6efac537bf870d5cd5cdf87a200c626
BLAKE2b-256 c979449bfb5d999cfe38bb0277390766e228d9bce449e612f926dc95827427b1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page