Title :
Introduce randomness into AdaBoost for robust performance on noisy data
Author :
Sun, Binxuan ; Luo, Jiarong ; Shu, Shuangbao ; Yu, Nan
Author_Institution :
Coll. of Sci., Donghua Univ., Shanghai, China
Abstract :
AdaBoost is a well-known ensemble learning algorithm that generates weak classifiers sequentially and then combines them into a strong one. Also it shows its resistance to overfitting in low noise data cases , a lot of experiments have shown that it is quite sensitive on noisy data. Several modifications to AdaBoost have been proposed to deal with noisy data. Bagging and Random forests have shown their resistance to noisy data which could be explained partially by their randomness. We study on introducing randomness into AdaBoost and propose a method called TRandom-AdaBoost which domains AdaBoost on both low and high noise dataset. We conjecture that the success of the proposed method could be explained by regarding it as a Random Forest with an ergodic sequence of weighted base hypotheses where the weights are generated by the technique used in AdaBoost.
Keywords :
bagging; learning systems; pattern classification; AdaBoost; TRandom-AdaBoost; ensemble learning algorithm; ergodic sequence; random forest; robust performance; Boosting; Classification algorithms; Noise; Noise level; Noise measurement; Training; AdaBoost; Random forests; noise; overfitting; robust;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on
Conference_Location :
Yantai, Shandong
Print_ISBN :
978-1-4244-5931-5
DOI :
10.1109/FSKD.2010.5569438