Title :
A comparative study of pruned decision trees and fuzzy decision trees
Author :
Benbrahim, Houda ; Bensaid, Amine
Author_Institution :
Sch. of Sci. & Eng., Al Akhawayn Univ., Ifrane, Morocco
Abstract :
Decision bees have been widely and successfully used in machine learning. However, they have suffered from overfitting in noisy domains. This problem has been remedied, in C4.5 for example, by tree pruning, resulting in improved performance. More recently, fuzzy representations have been combined with decision trees. How does the performance of fuzzy decision trees compare to that of pruned decision trees? The authors propose a comparative study of pruned decision trees and fuzzy decision trees. Further, for continuous inputs, they explore different ways: (1) for selecting the granularity of the fuzzy input variables; and (2) for defining the membership functions of the fuzzy input values. We carry out an empirical study using 12 data sets. The results show that a fuzzy decision tree constructed using FID3, combined with fuzzy clustering (to build membership functions) and cluster validity (to decide on granularity), is superior to pruned decision trees
Keywords :
decision trees; fuzzy set theory; fuzzy systems; learning (artificial intelligence); pattern clustering; FID3; comparative study; continuous inputs; data sets; fuzzy clustering; fuzzy decision trees; fuzzy input values; fuzzy input variables; fuzzy representations; granularity; machine learning; membership functions; noisy domains; overfitting; pruned decision trees; tree pruning; Decision trees; Degradation; Fuzzy reasoning; Fuzzy sets; Input variables; Machine learning; Noise measurement; Testing; Training data; Uncertainty;
Conference_Titel :
Fuzzy Information Processing Society, 2000. NAFIPS. 19th International Conference of the North American
Conference_Location :
Atlanta, GA
Print_ISBN :
0-7803-6274-8
DOI :
10.1109/NAFIPS.2000.877426
