Title :
Applying particle swarm optimization to determine the bandwidth parameter in probability density estimation
Author :
Liang, Hai-li ; Shen, Xian-min
Author_Institution :
Dept. of Inf. Sci. & Technol., Xingtai Univ., Xingtai, China
Abstract :
The determination of bandwidth parameter is a critical factor for the performance of probability density estimation method. The advanced parameter selection methods, such as the bootstrap method, the least-squares cross-validation (LSCV) method and the biased cross-validation (BCV) method, always need the help of the brute-force search or exhaustive search to find the optimal bandwidth parameters. In this paper, we apply five particle swarm optimization (PSO) algorithms-standard PSO (SPSO), PSO with a constriction factor (PSOCF), Gaussian PSO (GPSO), Gaussian PSO with Gaussian jump (GPSOGJ) and Gaussian PSO with Cauchy jump (GPSOCJ)-to determine the optimal bandwidths. In order to experimentally validate the feasibility and effectiveness of selecting the optimal parameters by using PSO algorithms, we carry out some numerical simulations on four univariate artificial datasets: Uniform dataset, Normal dataset, Exponential dataset and Rayleigh dataset. The finally comparative results show that our strategies are well-performed and Gaussian PSO with jump methods can obtain the better estimations than other PSO algorithms.
Keywords :
Gaussian processes; particle swarm optimisation; probability; search problems; Cauchy jump; Gaussian PSO; Gaussian jump; Rayleigh dataset; algorithms-standard PSO; biased cross-validation method; bootstrap method; brute-force search; constriction factor; exhaustive search; exponential dataset; least-squares cross-validation method; normal dataset; numerical simulation; optimal bandwidth parameter; parameter selection method; particle swarm optimization; probability density estimation; uniform dataset; univariate artificial dataset; Bandwidth; Cybernetics; Equations; Estimation; Kernel; Machine learning; Probability distribution; BCV; Bandwidth parameter; Bootstrap; GPSO; GPSOCJ; GPSOGJ; LSCV; PSOCF; Probability density estimation; SPSO;
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2011 International Conference on
Conference_Location :
Guilin
Print_ISBN :
978-1-4577-0305-8
DOI :
10.1109/ICMLC.2011.6016868