Title :
Robust wavelets support vector machine estimation method for regression
Author :
Zhang, Xiao-guang ; Li, Yi-Min ; Ren, Shi-jin ; Xu, Ji-Hua
Author_Institution :
Coll. of Mech. & Electr. Eng., China Univ. of Mining & Technol., Xuzhou, China
Abstract :
Due to wavelet network with the advantage of multi-scale of wavelet and self-learning of neural network, it is widely applied in regression estimation. But it is seriously affected by the samples with gross error. Although M-estimation as object function can be used to solve the problem, its corresponding influence function is determined by the absolute value of error, thus a key problem is to choose initial parameters. In this paper, we propose an estimation method for regression function based on multiwavelet support vector machine (SVM). This method firstly puts forward and proves a new wavelet SVM used to determine initial parameters. It can determine reasonable network structure and appropriate initial parameters, which makes sure that there is bigger absolute value of residual error of samples with gross error. Then M-estimation is used as object function and the method used to determine the threshold is put forward. Simulation results show that regression model obtained with this proposed method not only has better approximation precision, but also improves robustness and generalization. It is conduced to widening the application for wavelet network.
Keywords :
estimation theory; regression analysis; sampling methods; support vector machines; unsupervised learning; wavelet transforms; M-estimation; SVM; admissible support vector kernel; neural network self-learning; regression estimation; robust multiwavelet support vector machine estimation method; Educational institutions; Electronic mail; Industrial control; Kernel; Neural networks; Pattern recognition; Physics; Regression analysis; Robustness; Support vector machines; M-estimation; SVM; admissible support vector kernel; outlier case; regression;
Conference_Titel :
Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on
Conference_Location :
Guangzhou, China
Print_ISBN :
0-7803-9091-1
DOI :
10.1109/ICMLC.2005.1527089