Title :
Ensemble online sequential extreme learning machine for large data set classification
Author :
Junhai Zhai ; Jinggeng Wang ; Xizhao Wang
Author_Institution :
Coll. of Math. & Comput. Sci., Hebei Univ., Baoding, China
Abstract :
Online sequential extreme learning machine (OS-ELM) proposed by Liang et al. employ sequential learning strategy to learn the target concept from the data. Compared with the original ELM, OS-ELM can learn data one-by-one or chunk-by-chunk with fixed or varying chunk size with almost same performance as ELM. While compared with other state-of-the-art sequential algorithms such as SGBP, RAN and GAP-RBF, OS-ELM has faster learning speed and better generalization ability. However, similar to ELM, OS-ELM also has instability in different trials of simulations. In addition, for large data sets, OS-ELM will not halt when there are training samples not be learned, this phenomenon results in long learning time. In order to deal with the problems, this paper proposes an algorithm named E-OS-ELM for integrating OS-ELM to classify large data sets. The experimental results show that the proposed method is effective and efficient; it can effectively overcome the drawbacks mentioned above.
Keywords :
data handling; generalisation (artificial intelligence); learning (artificial intelligence); GAP-RBF; OS-ELM; RAN; SGBP; chunk-by-chunk; ensemble online sequential extreme learning machine; generalization ability; large data set classification; large data sets; learn data one-by-one; sequential algorithms; sequential learning strategy; varying chunk size; Accuracy; Algorithm design and analysis; Classification algorithms; Partitioning algorithms; Support vector machines; Testing; Training; Ensemble; Extreme learning machine; Large data set; Sequential learning;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6974260