Title :
Decision strategies that maximize the area under the LROC curve
Author :
Khurd, Parmeshwar ; Gindi, Gene
Author_Institution :
Med. Image Process. Lab, State Univ. of New York, Stony Brook, NY, USA
Abstract :
For the 2-class detection problem (signal absent/present), the likelihood ratio is an ideal observer in that it minimizes Bayes risk for arbitrary costs and it maximizes the area under the receiver operating characteristic (ROC) curve [AUC]. The AUC-optimizing property makes it a valuable tool in imaging system optimization. If one considered a different task, namely, joint detection and localization of the signal, then it would be similarly valuable to have a decision strategy that optimized a relevant scalar figure of merit. We are interested in quantifying performance on decision tasks involving location uncertainty using the localization ROC (LROC) methodology. Therefore, we derive decision strategies that maximize the area under the LROC curve, ALROC. We show that these decision strategies minimize Bayes risk under certain reasonable cost constraints. The detection-localization task is modeled as a decision problem in three increasingly realistic ways. In the first two models, we treat location as a discrete parameter having finitely many values resulting in an (L+1) class classification problem. In our first simple model, we do not include search tolerance effects and in the second, more general, model, we do. In the third and most general model, we treat location as a continuous parameter and also include search tolerance effects. In all cases, the essential proof that the observer maximizes ALROC is obtained with a modified version of the Neyman-Pearson lemma. A separate form of proof is used to show that in all three cases, the decision strategy minimizes the Bayes risk under certain reasonable cost constraints.
Keywords :
Bayes methods; image classification; medical image processing; sensitivity analysis; 2-class detection problem; Bayes risk; LROC curve; Neyman-Pearson lemma; decision strategies; imaging system optimization; joint signal detection; localization receiver operating characteristic; signal localization; Biomedical image processing; Biomedical imaging; Costs; Measurement; Optimization methods; Performance analysis; Radiology; Risk analysis; Signal detection; Uncertainty; Bayes risk; LROC analysis; LROC performance metrics; ideal observers; Algorithms; Bayes Theorem; Data Interpretation, Statistical; Decision Support Systems, Clinical; Decision Support Techniques; Diagnosis, Computer-Assisted; Image Interpretation, Computer-Assisted; Pattern Recognition, Automated; ROC Curve; Reproducibility of Results; Sensitivity and Specificity;
Journal_Title :
Medical Imaging, IEEE Transactions on
DOI :
10.1109/TMI.2005.859210