'Understanding Detectron2 COCO Evaluator

I am evaluating Cityscapes dataset using COCOEvaluator from Detectron2.

I want to know if COCO Evaluation metric implemented in Detectron2 takes into consideration the number of instances of each class, i.e. if the mAP is actually the weighted mAP.

Disclaimer: I already googled for high level algorithmic details about COCO mAP metric but didn't found any reference about whether the mAP is weighted or not. Also took a look into the COCO API and Detectron2 mAP implementation code but it's way to complex.



Solution 1:[1]

I don't think the COCOEvaluator calculate a weighted mAP based on different classes. Actually, it directly calls the code prom pycoco library. They calculate the average mAP over different object categories directly

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 Shawn Jiang