Title :
Greedy heuristics for minimization of number of terminal nodes in decision trees
Author_Institution :
Comput., Electr. & Math. Sci. & Eng. Div., King Abdullah Univ. of Sci. & Technol., Thuwal, Saudi Arabia
Abstract :
This paper describes, in detail, several greedy heuristics for construction of decision trees. We study the number of terminal nodes of decision trees, which is closely related with the cardinality of the set of rules corresponding to the tree. We compare these heuristics empirically for two different types of datasets (datasets acquired from UCI ML Repository and randomly generated data) as well as compare with the optimal results obtained using dynamic programming method.
Keywords :
decision trees; dynamic programming; minimisation; decision trees; dynamic programming method; greedy heuristics; terminal node number minimization; Cost function; Decision trees; Greedy algorithms; Heuristic algorithms; Impurities; Measurement uncertainty; Uncertainty; Decision trees; Friedman test; Nemenyi ad hoc tests; greedy heuristics; number of terminal nodes;
Conference_Titel :
Granular Computing (GrC), 2014 IEEE International Conference on
Conference_Location :
Noboribetsu
DOI :
10.1109/GRC.2014.6982817