Title :
Learning algorithm of decision tree generation for continuous-valued attribute
Author :
Li Hua ; Hu Xiaojuan ; Sun Haizhen
Author_Institution :
Math. & Phys. Dept., Shijiazhuang Tiedao Univ., Shijiazhuang, China
Abstract :
In this paper, we presented a learning algorithm using the information entropy minimization and mutual information entropy to generate a decision tree. Most of the current decision trees learning algorithms attempt to select the previously selected attributes for branching in a data set of which the values of condition attributes are continuous. The repeated selection limits the accuracy of training and testing. We should consider not only the information entropy minimization between the condition attributes and decision attributes but also the mutual information between condition attributes. The mutual information can avoid the repeated selection. The test results show that this method can obtain good performance.
Keywords :
decision trees; entropy; learning systems; minimisation; condition attributes; continuous-valued attribute; decision attributes; decision tree generation; information entropy minimization; learning algorithm; mutual information entropy; Algorithm design and analysis; Decision trees; Entropy; Information entropy; Minimization; Mutual information; Testing; Classification; Decision Trees; Discretization; Information Entropy Minimization; Mutual Information;
Conference_Titel :
Control Conference (CCC), 2010 29th Chinese
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-6263-6