Title :
Using mutual information for fuzzy decision tree generation
Author :
Li, Hua ; Lv, Gui-wen ; Zhang, Su-juan ; Guo, Zhi-fang
Author_Institution :
Math. & Phys. Dept., Shijiazhuang Tiedao Univ., Shijiazhuang, China
Abstract :
In this paper, we proposed an extended heuristic algorithm to Fuzzy ID3 using the minimization information entropy and mutual information entropy. Most of the current fuzzy decision trees learning algorithms often select the previously selected attributes for branching. The repeated selection limits the accuracy of training and testing and the structure of decision trees may become complex. Here, we use mutual information to avoid selecting the redundancy attributes in the generation of fuzzy decision tree. The test results show that this method can obtain good performance.
Keywords :
decision trees; entropy; fuzzy set theory; minimisation; fuzzy ID3; fuzzy decision tree generation; heuristic algorithm; minimization information entropy; mutual information entropy; Classification algorithms; Decision trees; Entropy; Heuristic algorithms; Information entropy; Machine learning; Mutual information; Fuzzy ID3 algorithm; Heuristic; Learning from Fuzzy examples; Machine learning; Mutual information;
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2010 International Conference on
Conference_Location :
Qingdao
Print_ISBN :
978-1-4244-6526-2
DOI :
10.1109/ICMLC.2010.5581043