DocumentCode :
2775781
Title :
A modified fast recursive hidden nodes selection algorithm for ELM
Author :
Han, Min ; Wang, Xinying
Author_Institution :
Fac. of Electron. Inf. & Electr. Eng., Dalian Univ. of Technol., Dalian, China
fYear :
2012
fDate :
10-15 June 2012
Firstpage :
1
Lastpage :
7
Abstract :
Extreme Learning Machine (ELM) is a new paradigm for using Single-hidden Layer Feedforward Networks (SLFNs) with a much simpler training method. The input weights and the bias of the hidden layer are randomly chosen and output weights are analytically determined. One of the open problems in ELM research is how to automatically determine network architectures for given tasks. In this paper, it is taken as a model selection problem, a modified fast recursive algorithm (MFRA) is introduced to quickly and efficiently estimate the contribution of each hidden layer node to the decrease of the net function, and then a leave one out (LOO) cross validation is used to select the optimal number of hidden layer nodes. Simulation results on both artificial and real world benchmark datasets indicate the effectiveness of the proposed method.
Keywords :
feedforward neural nets; learning (artificial intelligence); random processes; recursive estimation; ELM; artificial datasets; extreme learning machine; hidden layer nodes; input weights; leave one out cross validation; model selection problem; modified fast recursive hidden node selection algorithm; network architectures; real world benchmark datasets; single hidden layer feedforward networks; Cost function; Machine learning; Reservoirs; Simulation; Testing; Training; Vectors; extreme learning machine; model selection; prediction; time series;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location :
Brisbane, QLD
ISSN :
2161-4393
Print_ISBN :
978-1-4673-1488-6
Electronic_ISBN :
2161-4393
Type :
conf
DOI :
10.1109/IJCNN.2012.6252701
Filename :
6252701
Link To Document :
بازگشت