Research and Application of a Method for Constructing Decision Forests

Author

Qiang, Zhu

Author_Institution

Zhejiang Inst. of Commun. & Media, Hangzhou

fYear

2007

fDate

9-11 June 2007

Firstpage

1

Lastpage

6

Abstract

Decision forest (DF) is an implementation of multiple classifier system, which has been introduced to overcome the flaw of a single decision tree. In this paper, a method named the random subspace method (RSM) for constructing DF is investigated. RSM can keep perfect accuracy on training data while having desirable generalization accuracy. Moreover, its accuracy continues to increase as DF becomes larger, exhibiting a characteristic of overtraining resistant. The underlying theory of this model is presented in this paper. A comparison of three combination methods for this model voting, Bayesian method and neural-network is carried out. The power of voting is demonstrated both theoretically and experimentally. As for the application of this method, the superiority of RSM is explored and an advice regarding the size of attribute subsets is given.

Keywords

decision trees; pattern classification; random processes; trees (mathematics); Bayesian method; decision forests; multiple classifier system; neural network; pattern recognition; random subspace method; single decision tree; Bayesian methods; Classification tree analysis; Decision trees; Genetic algorithms; Pattern classification; Pattern recognition; Stochastic processes; Testing; Training data; Voting; Decision Forest; Pattern recognition; classifier combination; decision tree; stochastic discrimination;

fLanguage

English

Publisher

ieee

Conference_Titel

Service Systems and Service Management, 2007 International Conference on

Conference_Location

Chengdu

Print_ISBN

1-4244-0885-7

Electronic_ISBN

1-4244-0885-7

Type

conf

DOI

10.1109/ICSSSM.2007.4280168

Filename

4280168