Title :
Particle swarm optimization for convolved Gaussian process models
Author :
Gang Cao ; Lai, E.M.-K. ; Alam, F.
Author_Institution :
Sch. of Eng. & Adv. Technol., Massey Univ., Auckland, New Zealand
Abstract :
Convolved Gaussian process (CGP) is a type Gaussian process modelling technique applicable for multiple-input multiple-output systems. It employs convolution processes to construct a covariance function that models the correlation between outputs. Modelling using CGP involves learning the hyperparameters of the latent function and the smoothing kernel. Conventionally, learning involves the maximization of the log likelihood function of the training samples using conjugate gradient (CG) or particle swarm optimization (PSO) methods. We propose to use PSO to minimize the model error. In this way, a clearer direct indication of the quality of the current solution during the optimization process can be obtained. Simulation results on a dynamical system show that our method is able to learn appropriate CGP models and achieve better predictive performance compared with CG when the searching space is not well defined.
Keywords :
Gaussian processes; conjugate gradient methods; covariance matrices; particle swarm optimisation; search problems; CG; CGP models; PSO; conjugate gradient; convolution processes; convolved Gaussian process models; covariance function; latent function; log likelihood function; multiple-input multiple-output systems; particle swarm optimization; particle swarm optimization methods; predictive performance; searching space; smoothing kernel; Covariance matrices; Gaussian processes; Kernel; Optimization; Predictive models; Smoothing methods; Training;
Conference_Titel :
Neural Networks (IJCNN), 2014 International Joint Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4799-6627-1
DOI :
10.1109/IJCNN.2014.6889408