Title :
Constructing boosting algorithms from SVMs: an application to one-class classification
Author :
Rätsch, Gunnar ; Mika, Sebastian ; Scholkopf, Bernhard ; Müller, Klaus-Robert
Author_Institution :
RSISE, Australian Nat. Univ., Canberra, ACT, Australia
fDate :
9/1/2002 12:00:00 AM
Abstract :
We show via an equivalence of mathematical programs that a support vector (SV) algorithm can be translated into an equivalent boosting-like algorithm and vice versa. We exemplify this translation procedure for a new algorithm: one-class leveraging, starting from the one-class support vector machine (1-SVM). This is a first step toward unsupervised learning in a boosting framework. Building on so-called barrier methods known from the theory of constrained optimization, it returns a function, written as a convex combination of base hypotheses, that characterizes whether a given test point is likely to have been generated from the distribution underlying the training data. Simulations on one-class classification problems demonstrate the usefulness of our approach
Keywords :
learning automata; optimisation; pattern classification; unsupervised learning; 1-SVM; SVMs; boosting algorithms; boosting framework; constrained optimization; convex combination; mathematical programs; novelty detection; one-class classification problems; one-class leveraging; one-class support vector machine; support vector algorithm; translation procedure; unsupervised learning; Boosting; Support vector machine classification; Support vector machines;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2002.1033211