Title :
Binary tree of SVM: a new fast multiclass training and classification algorithm
Author :
Fei, B. ; Jinbai Liu
Author_Institution :
Dept. of Math., Tongji Univ., Shanghai
fDate :
5/1/2006 12:00:00 AM
Abstract :
We present a new architecture named Binary Tree of support vector machine (SVM), or BTS, in order to achieve high classification efficiency for multiclass problems. BTS and its enhanced version, c-BTS, decrease the number of binary classifiers to the greatest extent without increasing the complexity of the original problem. In the training phase, BTS has N-1 binary classifiers in the best situation (N is the number of classes), while it has log4/3((N+3)/4) binary tests on average when making a decision. At the same time the upper bound of convergence complexity is determined. The experiments in this paper indicate that maintaining comparable accuracy, BTS is much faster to be trained than other methods. Especially in classification, due to its Log complexity, it is much faster than directed acyclic graph SVM (DAGSVM) and ECOC in problems that have big class number
Keywords :
computational complexity; convergence; directed graphs; error correction codes; learning (artificial intelligence); support vector machines; trees (mathematics); binary classifiers; binary tree; classification algorithm; convergence complexity; directed acyclic graph SVM; error correcting output codes; fast multiclass training; log complexity; multiclass problems; support vector machine; Binary trees; Classification algorithms; Classification tree analysis; Convergence; Error correction codes; Support vector machine classification; Support vector machines; Testing; Tree graphs; Upper bound; Binary tree of support vector machine (BTS); c-BTS; multiclass classification; probabilistic output; support vector machine (SVM); Algorithms; Artificial Intelligence; Cluster Analysis; Image Interpretation, Computer-Assisted; Information Storage and Retrieval; Pattern Recognition, Automated;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2006.872343