Feedforward networks training speed enhancement by optimal initialization of the synaptic coefficients

This letter aims at determining the optimal bias and magnitude of initial weight vectors based on multidimensional geometry. This method ensures the outputs of neurons are in the active region and the range of the activation function is fully utilized. In this letter, very thorough simulations and comparative study were performed to validate the performance of the proposed method. The obtained results on five well-known benchmark problems demonstrate that the proposed method deliver consistent good results compared with other weight initialization methods