Title :
A Reformative KMSE Algorithm Based on the Numerical Analysis of Matrix
Author_Institution :
Shenzhen Grad. Sch., Dept. of Math. & Natural Sci., Harbin Inst. of Technol., Shenzhen, China
Abstract :
In order to improve the feature extraction efficiency of KMSE, we propose a novel KMSE algorithm. This algorithm assumes that the discriminant vector can be expressed as the linear combination of “significant nodes”, a subset of the training samples rather than all training samples. Determining the “significant nodes” based on the numerical analysis of the kernel matrix is the key of this method. We evaluate the effect, on the condition number of the kernel matrix, of each training sample. The rationale is that the lower the condition number of the kernel matrix is, the higher the generalization ability of the KMSE solution is. Exploiting the determined “significant nodes”, we construct a reformative KMSE model that can perform feature extraction computationally more efficient than naïve KMSE.
Keywords :
feature extraction; learning (artificial intelligence); matrix algebra; mean square error methods; feature extraction; generalization ability; kernel based learning machine; kernel minimum squared sample; linear subset combination; numerical matrix analysis; reformative KMSE algorithm; training sample; Accuracy; Algorithm design and analysis; Analytical models; Artificial neural networks; Classification algorithms; Feature extraction; Signal processing algorithms; KMSE; condition number; kernel method;
Conference_Titel :
Pervasive Computing Signal Processing and Applications (PCSPA), 2010 First International Conference on
Conference_Location :
Harbin
Print_ISBN :
978-1-4244-8043-2
Electronic_ISBN :
978-0-7695-4180-8
DOI :
10.1109/PCSPA.2010.114