Title :
Weights and structure determination of pruning-while-growing type for 3-input power-activation feed-forward neuronet
Author :
Zhang, Yunong ; Lao, Wenchao ; Yin, Yonghua ; Xiao, Lin ; Chen, Jinhao
Author_Institution :
Sch. of Inf. Sci. & Technol., Sun Yat-sen Univ., Guangzhou, China
Abstract :
In this paper, a new type of 3-input power-activation feed-forward neuronet (3IPFN) is constructed and investigated. For the 3IPFN, a novel weights-and-structure-determination (WASD) algorithm is presented to solve data approximation and prediction problems. With the weights-direct-determination (WDD) method exploited, the WASD algorithm can obtain the optimal weights of the 3IPFN between hidden layer and output layer directly. Moreover, the WASD algorithm determines the optimal structure (i.e., the optimal number of hidden-layer neurons) of the 3IPFN adaptively by growing and pruning hidden-layer neurons during the training process. Numerical results of illustrative examples highlight the efficacy of the 3IPFN equipped with the so-called WASD algorithm.
Keywords :
feedforward neural nets; learning (artificial intelligence); 3-input power-activation feed-forward neuronet; 3IPFN; WASD algorithm; WDD; hidden-layer neurons; pruning-while-growing type; training process; weights-and-structure-determination algorithm; weights-direct-determination method; Algorithm design and analysis; Approximation algorithms; Approximation methods; Frequency modulation; Neurons; Prediction algorithms; Training; Pruning-while-growing; approximation; feed-forward neuronet; optimal structure; weights-and-structure-determination (WASD) algorithm;
Conference_Titel :
Automation and Logistics (ICAL), 2012 IEEE International Conference on
Conference_Location :
Zhengzhou
Print_ISBN :
978-1-4673-0362-0
Electronic_ISBN :
2161-8151
DOI :
10.1109/ICAL.2012.6308199