Title :
UKF-based training algorithm for feed-forward neural networks with application to XOR classification problem
Author :
Zhao, Xiaozhen ; Yu, Jiaxiang ; Li, Fuwei
Author_Institution :
Training Dept., Dalian Naval Acad., Dalian, China
Abstract :
This paper uses the recently developed unscented Kalman filter (UKF) to construct a new training algorithm for feed-forward neural networks. This UKF-based training algorithm has the merits of being more accurate and not calculating the derivatives when compared to the training algorithms based on the extended Kalman filter (EKF). Moreover, the UKF can converge more rapidly than the EKF, so the proposed UKF-based algorithm is more suitable for real-time implementation of neural training algorithms. At the end of the paper, the presented algorithm is applied to the XOR classification problem. The classification results demonstrate that the new UKF-based training algorithm performs well in solving the nonlinear XOR classification problem and has superiority over the EKF-based algorithm.
Keywords :
Kalman filters; feedforward neural nets; EKF-based algorithm; UKF-based training algorithm; extended Kalman filter; feedforward neural network; neural training algorithm; nonlinear XOR classification problem; unscented Kalman filter; Classification algorithms; Covariance matrix; Kalman filters; Mathematical model; Neural networks; Training; Vectors; XOR classification problem; extended Kalman filter; unscented Kalman filter;
Conference_Titel :
Natural Computation (ICNC), 2012 Eighth International Conference on
Conference_Location :
Chongqing
Print_ISBN :
978-1-4577-2130-4
DOI :
10.1109/ICNC.2012.6234549