DocumentCode :
3437463
Title :
Reducing Classification Cost through Strategic Annotation Assignment
Author :
Zamacona, Jose R. ; Rasin, Alexander ; Furst, Jacob D. ; Raicu, Daniela S.
Author_Institution :
Sch. of Comput., DePaul Univ., Chicago, IL, USA
fYear :
2013
fDate :
7-10 Dec. 2013
Firstpage :
287
Lastpage :
294
Abstract :
The problem of classifying samples for which there is no definite label is a challenging one in which multiple annotators will provide a more certain input for a classifier. Unlike most of active learning scenarios that require identifying which images to be annotated, we explore how many annotations can potentially be used per instance (one annotation per instance is only the initial step) and propose a threshold-based concept of estimated instance difficulty to guide the custom label acquisition strategy. Using a lung nodule image data set, we determined that, by a simple division of cases into easy and hard to classify, the number of annotations can be distributed to significantly lower the cost (number of acquired annotations) for building a reliable classifier. We show the entire range of available tradeoffs-from a small reduction in annotation cost with no perceptible accuracy loss to a large reduction in annotation cost with a minimal sacrifice of classification accuracy.
Keywords :
data acquisition; image classification; lung; medical image processing; annotation cost reduction; classification accuracy; classification cost reduction; custom label acquisition strategy; lung nodule image data set; strategic annotation assignment; threshold-based concept; Accuracy; Data models; Labeling; Predictive models; Testing; Training; Uncertainty; computer-aided diagnosis; image classification; resource allocation;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Data Mining Workshops (ICDMW), 2013 IEEE 13th International Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4799-3143-9
Type :
conf
DOI :
10.1109/ICDMW.2013.97
Filename :
6753933
Link To Document :
بازگشت