Title :
Class-specific classifier: avoiding the curse of dimensionality
Author :
Baggenstoss, Paul M.
Author_Institution :
U.S. Naval Undersea Warfare Center, Newport, RI, USA
Abstract :
This article describes a new probabilistic method called the "class-specific method" (CSM). CSM has the potential to avoid the "curse of dimensionality" which plagues most classifiers which attempt to determine the decision boundaries in a high-dimensional feature space. In contrast, in CSM, it is possible to build classifiers without a common feature space. Separate low-dimensional features sets may be defined for each class, while the decision functions are projected back to the common raw data space. CSM effectively extends the classical classification theory to handle multiple feature spaces. It is completely general, and requires no simplifying assumption such as Gaussianity or that data ties in linear subspaces.
Keywords :
Gaussian noise; feature extraction; pattern classification; probability; Bayesian classifier; class-specific classifier; decision boundaries; dimensionality avoidance; high-dimensional feature space; likelihood function; multiple feature spaces; probabilistic method; probability density functions; separate low-dimensional feature sets; Automatic speech recognition; Automation; Electronic mail; Face recognition; Gaussian processes; Handwriting recognition; Humans; Image recognition; Military computing; Text recognition;
Journal_Title :
Aerospace and Electronic Systems Magazine, IEEE
DOI :
10.1109/MAES.2004.1263230