Title :
Limited precision incremental communication: error analysis
Author :
Ghorbani, Ali A. ; Bhavsar, Virendrakumar C.
Author_Institution :
Fac. of Comput. Sci., New Brunswick Univ., Fredericton, NB, Canada
Abstract :
The effects of the limited precision incremental communication method on the convergence behavior and performance degradation of multilayer perceptrons are investigated. The nonlinear effects of representing the incremental values with reduced (limited) precision on the commonly used error backpropagation training algorithm are analysed. It is shown that the small perturbation in the input(s)/output of a node does not enforce instability. However, when the precision of the incremental values falls below a certain level, the network fails to converge. The analysis is supported by simulation studies of two learning problems
Keywords :
backpropagation; convergence; error analysis; multilayer perceptrons; convergence behavior; error analysis; error backpropagation training algorithm; learning problems; limited precision incremental communication; multilayer perceptrons; performance degradation; Analytical models; Artificial neural networks; Backpropagation algorithms; Computer science; Convergence; Degradation; Error analysis; Logistics; Multilayer perceptrons; Nonhomogeneous media;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.549056
