Title :
Estimating accurate multi-class probabilities with support vector machines
Author :
Milgram, Jonathan ; Cheriet, Mohamed ; Sabourin, Robert
Author_Institution :
Ecole de Technologie Superieure, Univ. du Quebec, Montreal, Que., Canada
fDate :
31 July-4 Aug. 2005
Abstract :
In this paper, we propose a comparison of several post-processing methods for estimating multi-class probabilities with standard support vector machines. The different approaches have been tested on a real pattern recognition problem with a large number of training samples. The best results have been obtained by using a "one against air coupling strategy along with a softmax function optimized by minimizing the negative log-likelihood of the training data. Finally, the analysis of the error-reject tradeoff have shown that SVM allows to estimate probabilities more accurate than a classical MLP, which is indeed promising in the view of incorporated within pattern recognition system using probabilistic framework.
Keywords :
optimisation; pattern classification; probability; support vector machines; error-reject tradeoff; log-likelihood; multiclass probability; pattern recognition problem; softmax function; support vector machine; training sample; Character recognition; Data analysis; Error analysis; Handwriting recognition; Machine learning; Pattern recognition; Support vector machine classification; Support vector machines; Testing; Training data;
Conference_Titel :
Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on
Print_ISBN :
0-7803-9048-2
DOI :
10.1109/IJCNN.2005.1556171