DocumentCode
1626039
Title
Initial analysis on sensitivity of multilayer perceptron
Author
Yeung, D.S. ; Wang, X.Z.
Author_Institution
Dept. of Comput., Hong Kong Polytech. Univ., Kowloon, Hong Kong
Volume
3
fYear
1999
fDate
6/21/1905 12:00:00 AM
Firstpage
407
Abstract
One of the most important issues in the study of neural networks is its sensitivity arising from weight perturbation and input error, which may be caused by initial error, propagation or limited precision in data storage. It is difficult to establish a generic sensitivity formulation for the general multilayer perceptron. The paper continues our previous work on sensitivity analysis of the Neocognitron and makes an initial effort to analyze the sensitivity of a multilayer perceptron by following a similar method used in the case of the Neocognitron. Initial estimates on the expected decision error of an individual node due to the weight perturbation and on the expected decision error due to the input error are obtained. One general method is demonstrated by considering a special activation function for the multilayer perceptron. These preliminary investigations form the basis for our overall sensitivity analysis of the multilayer perceptron
Keywords
multilayer perceptrons; sensitivity analysis; transfer functions; activation function; data storage; expected decision error; generic sensitivity formulation; initial error; input error; limited precision; propagation; weight perturbation; Computer networks; Equations; Guidelines; Hardware; Information geometry; Memory; Multilayer perceptrons; Neural networks; Neurons; Sensitivity analysis;
fLanguage
English
Publisher
ieee
Conference_Titel
Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings. 1999 IEEE International Conference on
Conference_Location
Tokyo
ISSN
1062-922X
Print_ISBN
0-7803-5731-0
Type
conf
DOI
10.1109/ICSMC.1999.823239
Filename
823239
Link To Document