Title :
Performance studies on KBANN
Author :
Bose, R. P Jagadeesh Chandra ; Nagaraja, G.
Author_Institution :
Appl. Res. Group, Satyam Comput. Services Ltd., Bangalore, India
Abstract :
Hybrid models combining the analytical (rule-based) and connectionist (artificial neural network (ANN)) paradigms are called knowledge based neural networks (KBNN). The knowledge based artificial neural network (KBANN) is one such model that makes use of the domain theory represented as propositional rules and training examples. In this article, we analyze the performance of KBANN and suggest some ideas of improving its capabilities. A study on the effect of inductive bias on KBANN, use of adaptive learning algorithms instead of the standard backpropagation to improve the training times and the use of regularization methods for improving generalization performance is presented. It is shown that for better performance, the initial weight assignment to links obtained by domain theory varies with the domain and the performance of KBANN is improved by using regularization methods like the weight decay along with Rprop training algorithm instead of the standard backpropagation.
Keywords :
backpropagation; generalisation (artificial intelligence); knowledge based systems; KBANN generalization performance studies; Rprop training algorithm; adaptive learning algorithms; analytical rule-based network; backpropagation; connectionist artificial neural network; hybrid models; inductive bias; knowledge based artificial neural network; propositional rules; regularization methods; Analytical models; Artificial neural networks; Backpropagation algorithms; Computer networks; Computer science; Knowledge engineering; Learning systems; Machine learning; Machine learning algorithms; Performance analysis;
Conference_Titel :
Hybrid Intelligent Systems, 2004. HIS '04. Fourth International Conference on
Print_ISBN :
0-7695-2291-2
DOI :
10.1109/ICHIS.2004.74