Title :
Fast Incremental Learning Algorithm of SVM on KKT Conditions
Author :
Wu, Chongming ; Wang, Xiaodan ; Bai, Dongying ; Zhang, Hongda
Author_Institution :
Dept. of Comput. Eng., Air Force Eng. Univ., Sanyuan, China
Abstract :
How to deal with the newly added training samples, and utilize the result of the previous training effectively to get better classification result fast is the main task of incremental learning. To utilize the result of the previous training and retain the useful information in the training set effectively, the relationship between the Karush-Kuhn-Tucker (KKT) conditions and the influence of the newly added samples on the previous support vector set is analyzed, and the constitution of the of the new training sample set in the incremental learning is given. By choosing the most important samples for the incremental learning to reduce the computational cost of the SVM incremental training, a fast SVM incremental learning algorithm is proposed in this paper. Experimental results prove that the given algorithm has better classification performance.
Keywords :
classification; learning (artificial intelligence); support vector machines; Karush Kuhn Tucker conditions; SVM; classification performance; fast incremental learning algorithm; training set; Classification algorithms; Computational efficiency; Constitution; Fuzzy systems; Information analysis; Knowledge engineering; Machine learning algorithms; Military computing; Support vector machine classification; Support vector machines; Incremental Learning; KKT Conditions; SVM;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery, 2009. FSKD '09. Sixth International Conference on
Conference_Location :
Tianjin
Print_ISBN :
978-0-7695-3735-1
DOI :
10.1109/FSKD.2009.784