DocumentCode :
1180941
Title :
Two-Phase Construction of Multilayer Perceptrons Using Information Theory
Author :
Xing, Hong-Jie ; Hu, Bao-Gang
Author_Institution :
Coll. of Math. & Comput. Sci., Hebei Univ., Baoding
Volume :
20
Issue :
4
fYear :
2009
fDate :
4/1/2009 12:00:00 AM
Firstpage :
715
Lastpage :
721
Abstract :
This brief presents a two-phase construction approach for pruning both input and hidden units of multilayer perceptrons (MLPs) based on mutual information (MI). First, all features of input vectors are ranked according to their relevance to target outputs through a forward strategy. The salient input units of an MLP are thus determined according to the order of the ranking result and by considering their contributions to the network´s performance. Then, the irrelevant features of input vectors can be identified and eliminated. Second, the redundant hidden units are removed from the trained MLP one after another according to a novel relevance measure. Compared with its related work, the proposed strategy exhibits better performance. Moreover, experimental results show that the proposed method is comparable or even superior to support vector machine (SVM) and support vector regression (SVR). Finally, the advantages of the MI-based method are investigated in comparison with the sensitivity analysis (SA)-based method.
Keywords :
information theory; learning (artificial intelligence); multilayer perceptrons; SVM; SVR; information theory; mutual information criterion; relevance measure; sensitivity analysis-based method; support vector machine; support vector regression; two-phase trained multilayer perceptron construction; Hidden units pruning; input units selection; multilayer perceptron (MLP); mutual information (MI) criterion;
fLanguage :
English
Journal_Title :
Neural Networks, IEEE Transactions on
Publisher :
ieee
ISSN :
1045-9227
Type :
jour
DOI :
10.1109/TNN.2008.2005604
Filename :
4796255
Link To Document :
بازگشت