• DocumentCode
    23155
  • Title

    An Energy-Based Sampling Technique for Multi-Objective Restricted Boltzmann Machine

  • Author

    Vui Ann Shim ; Kay Chen Tan ; Chun Yew Cheong

  • Author_Institution
    Inst. for Infocomm Res., A*STAR, Singapore, Singapore
  • Volume
    17
  • Issue
    6
  • fYear
    2013
  • fDate
    Dec. 2013
  • Firstpage
    767
  • Lastpage
    785
  • Abstract
    Estimation of distribution algorithms are gaining increased research interest due to their advantage in exploiting linkage information. This paper examines the sampling techniques of a restricted Boltzmann machine-based multi-objective (MO) estimation of distribution algorithm (REDA). The behaviors of the sampling techniques in terms of energy levels are rigorously investigated, and a sampling mechanism that exploits the energy information of the solutions in a trained network is proposed to improve the search capability of the algorithm. The REDA is then hybridized, with a genetic algorithm and a local search based on an evolutionary gradient approach, to enhance the exploration and exploitation capabilities of the algorithm. Thirty-one benchmark test problems, which consist of different difficulties and characteristics, are used to examine the efficiency of the proposed algorithm. Empirical studies show that the proposed algorithm gives promising results in terms of inverted generational distance and nondominance ratio in most of the test problems.
  • Keywords
    Boltzmann machines; genetic algorithms; gradient methods; learning (artificial intelligence); sampling methods; search problems; distribution algorithm; energy-based sampling technique; genetic algorithm; inverted generational distance; local search algorithm; nondominance ratio; restricted Boltzmann machine-based multiobjective estimation; thirty-one benchmark test problems; Genetic algorithms; Optimization; Probabilistic logic; Probability distribution; Sociology; Statistics; Training; Estimation of distribution algorithms (EDAs); evolutionary gradient search; genetic algorithm (GA); multi-objective (MO) optimization; restricted Boltzmann machine; sampling technique;
  • fLanguage
    English
  • Journal_Title
    Evolutionary Computation, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1089-778X
  • Type

    jour

  • DOI
    10.1109/TEVC.2013.2241768
  • Filename
    6417021