Title :
The multiscale classifier
Author :
Lovell, Brian C. ; Bradley, Andrew P.
Author_Institution :
Cooperative Res. Centre for Sensor Signal & Inf. Process., Queensland Univ., Qld., Australia
fDate :
2/1/1996 12:00:00 AM
Abstract :
Proposes a rule-based inductive learning algorithm called multiscale classification (MSC). It can be applied to any N-dimensional real or binary classification problem to classify the training data by successively splitting the feature space in half. The algorithm has several significant differences from existing rule-based approaches: learning is incremental, the tree is non-binary, and backtracking of decisions is possible to some extent. The paper first provides background on current machine learning techniques and outlines some of their strengths and weaknesses. It then describes the MSC algorithm and compares it to other inductive learning algorithms with particular reference to ID3, C4.5, and back-propagation neural networks. Its performance on a number of standard benchmark problems is then discussed and related to standard learning issues such as generalization, representational power, and over-specialization
Keywords :
backpropagation; backtracking; generalisation (artificial intelligence); learning by example; neural nets; pattern classification; tree searching; C4.5; ID3; backpropagation neural networks; backtracking; binary classification problem; generalization; incremental learning; multiscale classifier; nonbinary tree; over-specialization; representational power; rule-based inductive learning algorithm; Classification algorithms; Classification tree analysis; Decision trees; Ear; Machine learning; Machine learning algorithms; Nearest neighbor searches; Neural networks; Probability distribution; Training data;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on