DocumentCode :
943420
Title :
Inducing NNC-trees with the R4-rule
Author :
Zhao, Qiangfu
Author_Institution :
Univ. of Aizu, Fukushima, Japan
Volume :
36
Issue :
3
fYear :
2005
fDate :
6/1/2005 12:00:00 AM
Firstpage :
520
Lastpage :
533
Abstract :
An NNC-Tree is a decision tree (DT) with each nonterminal node containing a nearest neighbor classifier (NNC). Compared with the conventional axis-parallel DTs (APDTs), the NNC-Trees can be more efficient, because the decision boundary made by an NNC is more complex than an axis-parallel hyperplane. Compared with single-layer NNCs, the NNC-Trees can classify given data in a hierarchical structure that is often useful for many applications. This paper proposes an algorithm for inducing NNC-Trees based on the R4-rule, which was proposed by the author for finding the smallest nearest neighbor based multilayer perceptrons (NN-MLPs). There are mainly two contributions here. 1) A heuristic but effective method is given to define the teacher signals (group labels) for the data assigned to each nonterminal node. 2) The R4-rule is modified so that an NNC with proper size can be designed automatically in each nonterminal node. Experiments with several public databases show that the proposed algorithm can produce NNC-Trees effectively and efficiently.
Keywords :
decision trees; learning (artificial intelligence); multilayer perceptrons; pattern classification; NNC-Trees; R/sup 4/-rule; data classification; decision tree; multilayer perceptrons; nearest neighbor classifier; Classification tree analysis; Databases; Decision trees; Machine learning; Machine learning algorithms; Multilayer perceptrons; Nearest neighbor searches; Neural networks; Signal design; Testing; Decision trees; NNC-Trees; machine learning and understanding; nearest neighbor classifier; neural networks; Algorithms; Artificial Intelligence; Decision Support Techniques; Pattern Recognition, Automated;
fLanguage :
English
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
Publisher :
ieee
ISSN :
1083-4419
Type :
jour
DOI :
10.1109/TSMCB.2005.861868
Filename :
1634646
Link To Document :
بازگشت