Title :
A Batch-Mode Active Learning Technique Based on Multiple Uncertainty for SVM Classifier
Author :
Patra, Swarnajyoti ; Bruzzone, Lorenzo
Author_Institution :
Dept. of Inf. Eng. & Comput. Sci., Univ. of Trento, Trento, Italy
fDate :
5/1/2012 12:00:00 AM
Abstract :
In this letter, we present a novel batch-mode active learning technique for solving multiclass classification problems by using the support vector machine classifier with the one-against-all architecture. The uncertainty of each unlabeled sample is measured by defining a criterion which not only considers the smallest distance to the decision hyperplanes but also takes into account the distances to other hyperplanes if the sample is within the margin of their decision boundaries. To select batch of most uncertain samples from all over the decision region, the uncertain regions of the classifiers are partitioned into multiple parts depending on the number of geometrical margins of binary classifiers passing on them. Then, a balanced number of most uncertain samples are selected from each part. To minimize the redundancy and keep the diversity among these samples, the kernel k-means clustering algorithm is applied to the set of uncertain samples, and the representative sample (medoid) from each cluster is selected for labeling. The effectiveness of the proposed method is evaluated by comparing it with other batch-mode active learning techniques existing in the literature. Experimental results on two different remote sensing data sets confirmed the effectiveness of the proposed technique.
Keywords :
geophysical image processing; geophysical techniques; image classification; learning (artificial intelligence); pattern clustering; remote sensing; support vector machines; SVM classifier; batch-mode active learning technique; binary classifiers; decision boundary; decision hyperplane; decision region; geometrical margin; kernel k-means clustering algorithm; medoid; multiclass classification problem; one-against-all architecture; redundancy minimization; remote sensing data set; representative sample; support vector machine; unlabeled sample uncertainty measurement; Accuracy; Hyperspectral imaging; Kernel; Support vector machines; Training; Uncertainty; Active learning; hyperspectral imagery; multispectral imagery; query function; remote sensing; support vector machine (SVM);
Journal_Title :
Geoscience and Remote Sensing Letters, IEEE
DOI :
10.1109/LGRS.2011.2172770