Title :
The Generalization Ability of Online SVM Classification Based on Markov Sampling
Author :
Jie Xu ; Yuan Yan Tang ; Bin Zou ; Zongben Xu ; Luoqing Li ; Yang Lu
Author_Institution :
Fac. of Comput. Sci. & Inf. Eng., Hubei Univ., Wuhan, China
Abstract :
In this paper, we consider online support vector machine (SVM) classification learning algorithms with uniformly ergodic Markov chain (u.e.M.c.) samples. We establish the bound on the misclassification error of an online SVM classification algorithm with u.e.M.c. samples based on reproducing kernel Hilbert spaces and obtain a satisfactory convergence rate. We also introduce a novel online SVM classification algorithm based on Markov sampling, and present the numerical studies on the learning ability of online SVM classification based on Markov sampling for benchmark repository. The numerical studies show that the learning performance of the online SVM classification algorithm based on Markov sampling is better than that of classical online SVM classification based on random sampling as the size of training samples is larger.
Keywords :
Markov processes; generalisation (artificial intelligence); pattern classification; sampling methods; support vector machines; Markov sampling; classification learning algorithm; generalization ability; kernel Hilbert space; online SVM classification; random sampling; support vector machines; uniformly ergodic Markov chain; Algorithm design and analysis; Classification algorithms; Educational institutions; Machine learning algorithms; Markov processes; Support vector machines; Training; Generalization ability; Markov sampling; online support vector machine (SVM) classification; uniformly ergodic Markov chain (u.e.M.c.); uniformly ergodic Markov chain (u.e.M.c.).;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2361026