Title :
A Kernel-Based Weight-Setting Method in Robust Weighted Least Squares Support Vector Regression
Author :
Wen, Wen ; Hao, Zhi-Feng ; Shao, Zhuang-feng ; Yang, Xiao-Wei
Author_Institution :
Coll. of Comput. Sci. & Eng., South China Univ. of Technol., Guangzhou
Abstract :
By combining the basic idea of weighted least squares support vector machines (WLS-SVM) and fuzzy support vector machines (FSVM), a weight-setting strategy based on 2-norm distance and neighborhood density (WLS-SVM I) is presented in this paper. Then the relationship between the 2-norm distance and RBF kernel is revealed. Consequently, an equivalent weight setting strategy (WLS-SVM II) using information from RBF kernel is put forward. Numerical experiments show both the 2-norm distance-based strategy and the kernel-based strategy produce robust LS-SVM estimators of noisy data. And when satisfying some conditions, WLS-SVM I can be substituted by WLS-SVM II, which may provide an efficiency-enhancing strategy for online LS-SVM
Keywords :
least squares approximations; radial basis function networks; regression analysis; support vector machines; 2-norm distance; LS-SVM estimator; RBF kernel; WLS-SVM I; WLS-SVM II; fuzzy support vector machines; kernel-based weight-setting method; noisy data; weighted least squares support vector machines; Australia; Computer science; Cybernetics; Educational institutions; Information technology; Kernel; Least squares methods; Machine learning; Noise robustness; Pattern recognition; Quadratic programming; Support vector machines; (Weighted) least squares; Support vector machine; regression; robust;
Conference_Titel :
Machine Learning and Cybernetics, 2006 International Conference on
Conference_Location :
Dalian, China
Print_ISBN :
1-4244-0061-9
DOI :
10.1109/ICMLC.2006.258944