Title :
Contrast enhancement for backpropagation
Author :
Kwon, Taek Mu ; Cheng, Hui
Author_Institution :
Dept. of Electr. & Comput. Eng., Minnesota Univ., Duluth, MN, USA
fDate :
3/1/1996 12:00:00 AM
Abstract :
This paper analyzes the effect of data-contrast to a backpropagation (BP) network and introduces a data preprocessing algorithm that can improve the efficiency of the standard BP learning. The basic idea is to transform input data to a range that associates the high-slope region of the sigmoid function where a relatively large modification of weights occurs. A simple uniform transformation to such a desired range, however, can lead to a slow and unbalanced learning if the data distribution is heavily skewed. To facilitate data processing on such distribution, the authors propose a modified histogram equalization technique which enhances the sparing between the data points in the heavily concentrated regions of the distribution
Keywords :
backpropagation; multilayer perceptrons; backpropagation; contrast enhancement; data preprocessing algorithm; high-slope region; modified histogram equalization technique; sigmoid function; slow learning; unbalanced learning; Algorithm design and analysis; Backpropagation algorithms; Data processing; Error correction; Helium; Histograms; Neurons; Shape; Training data;
Journal_Title :
Neural Networks, IEEE Transactions on