Title :
Induction of High Performance Neural Networks Based on Decision Boundary Making
Author :
Kaneda, Yuya ; Qiangfu Zhao ; Yong Liu ; Yen, Neil Y.
Author_Institution :
Dept. of Comput. & Inf. Syst., Univ. of Aizu, Aizu-Wakamatsu, Japan
Abstract :
Smartphone, in recent year, becomes popular and has been widely applied by users. In order to meet different needs from users, embedding "awareness" providing supports by understanding onto smartphone devices is necessry. Due to the limitations (e.g. computing resources, etc.) on smartphone, methods that is light but with high performance are strongly expected. In this study, the concept of awareness agent (A-agent) is proposed for the purpose. For this purpose, we have proposed decision boundary learning (DBL) based on particle swarm optimization (PSO). Results show that this method can yield compact neural network (NNs) agents that are comparable in performance to support vector machines (SVMs). However, the computational cost of PSO is high, and the method cannot be used in smartphone environments. To reduce the computational cost, we propose a simple method called decision boundary making (DBM). The basic idea of DBM is to generate new training data around the support vectors of an SVM, add them to the training set, and then induce an NN agent. We conducted experiments using several public databases, and experimental results show that the proposed DBM is comparable to DBL in performance, and the computational cost can be greatly reduced.
Keywords :
decision making; learning (artificial intelligence); multi-agent systems; neural nets; particle swarm optimisation; smart phones; support vector machines; A-agent; DBL; DBM; NN agents; PSO; SVM; awareness agent; compact neural network agent; decision boundary learning; decision boundary making; high performance neural network induction; particle swarm optimization; smartphone devices; support vector machines; training data; training set; Artificial neural networks; Databases; Neurons; Smart phones; Support vector machines; Training; Training data; Awareness Agents; Decision Boundary Learning; Decision Boundary Making; Neural Network; Support Vector Machine;
Conference_Titel :
Systems, Man, and Cybernetics (SMC), 2013 IEEE International Conference on
Conference_Location :
Manchester
DOI :
10.1109/SMC.2013.483