A quantitative methodology for analyzing the performance of detection algorithms

The authors present a methodology for designing experiments to characterize detection algorithms. The usual method is to vary parameters of the input images or parameters of the algorithms and then construct operating curves that relate the probability of misdetection and false alarm for each parameter setting. Such an analysis does not integrate the performance of the numerous operating curves. A methodology is outlined for summarizing many operating curves into a few performance curves. This methodology is adapted from the human psychophysics literature and is general to any detection algorithm. The central concept is to measure the effect of variables in terms of the equivalent effect of a critical signal variable. The methodology is demonstrated by comparing the performance of two line detection algorithms