Hybrid methods using evolutionary algorithms for on-line training

A novel hybrid evolutionary approach is presented in this paper for improving the performance of neural network classifiers in slowly varying environments. For this purpose, we investigate a coupling of differential evolution strategy and stochastic gradient descent, using both the global search capabilities of evolutionary strategies and the effectiveness of online gradient descent. The use of differential evolution strategy is related to the concept of evolution of a number of individuals from generation to generation and that of online gradient descent to the concept of adaptation to the environment by learning. The hybrid algorithm is tested in two real-life image processing applications. Experimental results suggest that the hybrid strategy is capable to train online effectively leading to networks with increased generalization capability