Title :
Inducing NNC-trees with the R4-rule
Author_Institution :
Univ. of Aizu, Fukushima, Japan
fDate :
6/1/2005 12:00:00 AM
Abstract :
An NNC-Tree is a decision tree (DT) with each nonterminal node containing a nearest neighbor classifier (NNC). Compared with the conventional axis-parallel DTs (APDTs), the NNC-Trees can be more efficient, because the decision boundary made by an NNC is more complex than an axis-parallel hyperplane. Compared with single-layer NNCs, the NNC-Trees can classify given data in a hierarchical structure that is often useful for many applications. This paper proposes an algorithm for inducing NNC-Trees based on the R4-rule, which was proposed by the author for finding the smallest nearest neighbor based multilayer perceptrons (NN-MLPs). There are mainly two contributions here. 1) A heuristic but effective method is given to define the teacher signals (group labels) for the data assigned to each nonterminal node. 2) The R4-rule is modified so that an NNC with proper size can be designed automatically in each nonterminal node. Experiments with several public databases show that the proposed algorithm can produce NNC-Trees effectively and efficiently.
Keywords :
decision trees; learning (artificial intelligence); multilayer perceptrons; pattern classification; NNC-Trees; R/sup 4/-rule; data classification; decision tree; multilayer perceptrons; nearest neighbor classifier; Classification tree analysis; Databases; Decision trees; Machine learning; Machine learning algorithms; Multilayer perceptrons; Nearest neighbor searches; Neural networks; Signal design; Testing; Decision trees; NNC-Trees; machine learning and understanding; nearest neighbor classifier; neural networks; Algorithms; Artificial Intelligence; Decision Support Techniques; Pattern Recognition, Automated;
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/TSMCB.2005.861868