Dynamic construction of fault tolerant multi-layer neural networks

We propose a new training algorithm for enhanced tolerance to physical defects (faults) of multi-layer neural networks (MLNs). We aim to construct such MLNs with the minimal number of hidden units. The proposed method has two characteristics, constructing MLNs dynamically and getting high fault tolerance easily. We proposed dynamic constructive algorithm with weight minimization approach (DCWMA) based on a DCA and WMA. DCA (dynamic constructive algorithm) is a basic dynamic constructive algorithm for MLNs. WMA (weight minimization algorithm) is a training algorithm to enhance the fault tolerance of fixed structure MLNs. The effectiveness of DCWMA is shown by some experiments.