On-line evolutionary learning of NN-MLP based on the attentional learning concept

To design the nearest neighbor based multilayer perceptron (NN-MLP) efficiently, the author has proposed a new evolutionary learning algorithm called the R⁴-rule. For off-line learning, the R⁴-rule can produce the smallest or nearly smallest networks with high generalization ability by iteratively performing four basic operations: recognition, remembrance, reduction and review. To apply the algorithm to on-line evolutionary learning of NN-MLP, this paper proposes some improvements for the R⁴-rule based on the attentional learning concept. The performance of the improved algorithm is verified by experimental results