Sequential RBF function estimator: memory regression network

The neural-network training algorithm can be divided into 2 categories: (1) batch mode and (2) sequential mode. In this paper, a novel online RBF network called "memory regression network (MRN)" is proposed. Different from the previous approaches (de Freitas, N, et al., Aug. 1999), (Schiffman, W, et al., 1993), MRN involves two types of memories: experience and neuron, which handle short and long term memories respectively. By simulating human\´s learning behavior, a given function can be estimated without memorizing the whole training set. Two sets of function estimation experiments are examined in order to illustrate the performance of the proposed algorithm. The results show that MRN can effectively approximate the given function within a reasonable time and acceptable mean square error