Are performance differences of interest operators statistically significant?

Authors:
Nadia Kanwal;Shoaib Ehsan;Adrian F. Clark
Affiliations:
VASE Laboratory, Computer Science & Electronic Engineering University of Essex, Colchester, UK and Lahore College for Women University, Pakistan;VASE Laboratory, Computer Science & Electronic Engineering University of Essex, Colchester, UK;VASE Laboratory, Computer Science & Electronic Engineering University of Essex, Colchester, UK
Venue:
CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
Year:
2011

Citing 6
Cited 0

Evaluation of Interest Point Detectors

International Journal of Computer Vision - Special issue on a special section on visual surveillance
Scale & Affine Invariant Interest Point Detectors

International Journal of Computer Vision
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A Performance Evaluation of Local Descriptors

IEEE Transactions on Pattern Analysis and Machine Intelligence
Local invariant feature detectors: a survey

Foundations and Trends® in Computer Graphics and Vision
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

The differences in performance of a range of interest operators are examined in a null hypothesis framework using McNemar's test on a widely-used database of images, to ascertain whether these apparent differences are statistically significant. It is found that some performance differences are indeed statistically significant, though most of them are at a fairly low level of confidence, i.e. with about a 1-in-20 chance that the results could be due to features of the evaluation database. A new evaluation measure i.e. accurate homography estimation is used to characterize the performance of feature extraction algorithms.Results suggest that operators employing longer descriptors are more reliable.