DocumentCode :
1763245
Title :
Bare Bones Particle Swarm Optimization With Scale Matrix Adaptation
Author :
Campos, Mario ; Krohling, Renato A. ; Enriquez, Ivan
Author_Institution :
Dept. of Stat., Fed. Univ. of Espirito Santo, Vitoria, Brazil
Volume :
44
Issue :
9
fYear :
2014
fDate :
Sept. 2014
Firstpage :
1567
Lastpage :
1578
Abstract :
Bare bones particle swarm optimization (BBPSO) is a swarm algorithm that has shown potential for solving single-objective unconstrained optimization problems over continuous search spaces. However, it suffers of the premature convergence problem that means it may get trapped into a local optimum when solving multimodal problems. In order to address this drawback and improve the performance of the BBPSO, we propose a variant of this algorithm, named by us as BBPSO with scale matrix adaptation (SMA), SMA-BBPSO for short reference. In the SMA-BBPSO, the position of a particle is selected from a multivariate t -distribution with a rule for adaptation of its scale matrix. We use the multivariate t -distribution in its hierarchical form, as a scale mixtures of normal distributions. The t -distribution has heavier tails than those of the normal distribution, which increases the ability of the particles to escape from a local optimum. In addition, our approach includes the normal distribution as a particular case. As a consequence, the t -distribution can be applied during the optimization process by maintaining the proper balance between exploration and exploitation. We also propose a simple update rule to adapt the scale matrix associated with a particle. Our strategy consists of adapting the scale matrix of a particle such that the best position found by any particle in its neighborhood is sampled with maximum likelihood in the next iteration. A theoretical analysis was developed to explain how the SMA-BBPSO works, and an empirical study was carried out to evaluate the performance of the proposed algorithm. The experimental results show the suitability of the proposed approach in terms of effectiveness to find good solutions for all benchmark problems investigated. Nonparametric statistical tests indicate that SMA-BBPSO shows a statistically significant improvement compared with other swarm algorithms.
Keywords :
matrix algebra; maximum likelihood estimation; normal distribution; particle swarm optimisation; statistical testing; SMA-BBPSO algorithm; bare bones particle swarm optimization; maximum likelihood estimation; multivariate t-distribution; nonparametric statistical tests; normal distribution; premature convergence problem; scale matrix adaptation; single-objective unconstrained optimization problems; swarm algorithms; Covariance matrices; Gaussian distribution; Optimization; Particle swarm optimization; Search problems; Standards; Vectors; Multivariate $t$ -distribution; Multivariate t-distribution; scale matrix adaptation (SMA); scale mixtures of normal distributions; swarm algorithms;
fLanguage :
English
Journal_Title :
Cybernetics, IEEE Transactions on
Publisher :
ieee
ISSN :
2168-2267
Type :
jour
DOI :
10.1109/TCYB.2013.2290223
Filename :
6670107
Link To Document :
بازگشت