Combining KNN algorithm and other classifiers

In this paper, we propose KNC algorithm for combining KNN algorithm and other three classifiers (C4.5 algorithm, Naive Bayes classifier and SVM) based on their classification capabilities on different types of instances. According to labels of instances and their K nearest neighbors, we divide instances into three types, S-, DS- and D-type. The classification capabilities of KNN algorithm on S-type instances are the best, while ones on D-type and DS-type are usually worse than other three classifiers. KNC algorithm uses KNN algorithm to classify S- and DS-type instances, and uses other classifiers to classify D-type instances. KNC algorithm utilizes classification capability of KNN algorithm on S-type instances and utilizes classification capabilities of other three classifiers on D-type instances. Experimental results on 20 UCI data sets demonstrate utility and feasibility of KNC algorithm.