Be expert in multiple aspects and good at many modular neural network with reduced subnet relative training complexity

This paper mainly aims at reducing relative learning complexity of subnets originate from “be Expert in Multiple aspects and Good at Many” (EMGM) modular neural network (MNN). Firstly, subnet learning algorithm which has a pure sequential execution style is built and convergence analysis is given. Secondly, in EMGM MNN system, an equivalent learning condition, which satisfies the criterion needed for the efficient training algorithm designed before, is founded for every subnet. Three identification problems have been involved to test the effectiveness and efficiency of the new framework in dealing with low dimension data. Both theoretical and experimental results show the new framework will reduce relative learning complexity of every subnet. The experiment result also shows new framework can achieve comparable generalization capability with original one. Furthermore, Bias Variance analysis shows maximum ability of generalization performance improvement of EMGM MNN may exist and the improvement comes from the improvement of bias estimation accuracy.