Title :
Robust principal component extracting neural networks
Author :
Diamantaras, K.I.
Author_Institution :
Dept. of Electr. & Comput. Eng., Aristotelian Univ. of Thessaloniki, Greece
Abstract :
We present a modification of Oja´s single unit PC learning rule that behaves optimally in a certain sense, if the unit output value - the representation value of the input signal - is corrupted with noise. The mathematical formulation of the problem falls under the name noisy principal component analysis (PCA) whose analytical solution for the single component case is presented here. Both Oja´s rule and the proposed robust PCA rule lead to zero solution as the noise power gets high, but the noise tolerance of the new rule is twice as large as Oja´s rule; in the noise-free case both rules behave identically
Keywords :
Hebbian learning; eigenvalues and eigenfunctions; neural nets; noise; statistical analysis; Hebbian learning; Oja rule; eigenvalues; neural networks; noise; principal component analysis; Cost function; Data mining; Gaussian noise; Mean square error methods; Multidimensional systems; Neural networks; Noise robustness; Principal component analysis; Stochastic resonance; White noise;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.548869