Title :
An automatic setting for training restricted boltzmann machine
Author :
Chun-Yang Zhang ; Chen, C.L.P.
Author_Institution :
Dept. of Comput. & Inf. Sci., Univ. of Macau, Macau, China
Abstract :
Recently, deep learning techniques create much of a stir in machine learning. Its prominent performances can found in large number of applications in pattern recognition, such as image recognition, speech recognition and video processing. Most of the existing deep architectures are based on or related to restricted Boltzmann machine(RBM). However, the model selection problem in RBM and its deep architecture is very intractable since both their learning and inference are highly time-consuming. In this paper, we introduce an automatic setting for training a RBM, including structure design, log-likelihood approximation and batch learning design. We give a practical setting guide for training a RBM, which is deduced from the experiments on Bar-and-Stripe benchmark inpainting.
Keywords :
Boltzmann machines; learning (artificial intelligence); Bar-and-Stripe benchmark inpainting; RBM; automatic setting; batch learning design; deep architectures; deep learning techniques; log-likelihood approximation; machine learning; model selection problem; restricted Boltzmann machine; structure design; Algorithm design and analysis; Benchmark testing; Computer architecture; Joints; Pattern recognition; Probabilistic logic; Training;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6974564