Ensemble systems and incremental learning

Classification of the unknown dataset can be obtained by several methods. Ensemble classifier methods are proved to be the better for classification. Learn++, An incremental learning algorithm, which allows supervised classification algorithms to learn from new data without forgetting previously acquired knowledge even when the previously used data is no longer available. Learn++ suffers from inherent “out-voting problem when asked to learn new classes, which causes it to generate an unnecessarily large number of classifiers. Also, in Learn++, distribution update rule based on performance of compound hypothesis, for selecting training set of the next weak classifier, it allows an efficient incremental learning capability when new classes are introduced. Whereas, in AdaBoost distribution update rule based on individual hypothesis guarantees robustness and prevents performance deterioration. In proposed algorithm, it combines the advantages of both the methods. It provides weight updating rule based on a combination of individual hypothesis and compound hypothesis which provide optimum performance level.