Outliers Learning and Its Applications

Outlier problem is one of the typical problems in an incomplete data based machine learning system. An outlier is a pattern that was either mislabeled in the training data, or inherently ambiguous and hard to recognize, therefore, it usually brings extra trouble for a learning task, either in debasing the performance or leading the learning process to be more complicated. In order to tackle the outlier problem, in this study, two strategies, i.e. restraining and eliminating, are presented regarding to ensemble learning methodology. The simulation results on two real world learning tasks, speaker identification and text categorization, show that two presented strategies are effective in dealing with the outliers and successful in improving the learning performance