Title :
A comparative research on noise resistance for two heuristic algorithms
Author :
Xie, Bo-Jun ; Zhou, Ning ; Wang, Tao
Author_Institution :
Machine Learning Center, Hebei Univ., Baoding, China
Abstract :
Decision tree induction is an important way of learning rules from examples. Due to the NP-hard problem, heuristic algorithms play a crucial role for generating short decision trees. This paper investigates the comparison between two heuristic algorithms in decision tree generation for the capacity of resisting noise. One heuristic is the well-known ID3 while the other is our previously proposed. The investigation is aiming at giving theoretically and experimentally some comparative advantages on the robustness for the two heuristics. Since most real world data are usually imprecise and inexact, the investigation to noise resistance is really necessary and significant to deal with the practical data in knowledge acquisition area.
Keywords :
computational complexity; decision trees; knowledge acquisition; ID3; NP-hard problem; decision tree generation; heuristic algorithm; knowledge acquisition; noise resistance; Accuracy; Classification algorithms; Decision trees; Heuristic algorithms; Machine learning; Noise; Testing; Degree of Importance; Heuristic Algorithm; ID3; Noise Data;
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2010 International Conference on
Conference_Location :
Qingdao
Print_ISBN :
978-1-4244-6526-2
DOI :
10.1109/ICMLC.2010.5581079