Title :
How many neighbors to consider in pattern pre-selection for support vector classifiers?
Author :
Shin, Hyunjgng ; Cho, Sungzoon
Author_Institution :
Dept. of Ind. Eng., Seoul Nat. Univ., South Korea
Abstract :
Training support vector classifiers (SVC) requires large memory and long cpu time when the pattern set is large. To alleviate the computational burden in SVC training, we previously proposed a preprocessing algorithm which selects only the patterns in the overlap region around the decision boundary, based on neighborhood properties. The k-nearest neighbors´ class label entropy for each pattern was used to estimate the pattern´s proximity to the decision boundary. The value of parameter k is critical, yet has been determined by a rather ad-hoc fashion. We propose in this paper a systematic procedure to determine k and show its effectiveness through experiments.
Keywords :
entropy; pattern classification; support vector machines; ad-hoc fashion; decision boundary; k-nearest neighbors´ class label entropy; overlap pattern; pattern preselection; pattern proximity; support vector classifiers; Entropy; Iterative methods; Kernel; Lapping; MATLAB; Matrix decomposition; Pattern matching; Quadratic programming; Static VAr compensators; Timing;
Conference_Titel :
Neural Networks, 2003. Proceedings of the International Joint Conference on
Print_ISBN :
0-7803-7898-9
DOI :
10.1109/IJCNN.2003.1223408