Title :
Learning Bayesian networks with a hybrid convergent method
Author :
Liu, Jun ; Chang, Kuo-Chu ; Zhou, Jing
Author_Institution :
United Technol. Res. Center, East Hartford, CT, USA
fDate :
9/1/1999 12:00:00 AM
Abstract :
During the past few years, a variety of methods have been developed for learning probabilistic networks from data, among which the heuristic single link forward or backward searches are widely adopted to reduce the search space. A major drawback of these search heuristics is that they can not guarantee to converge to the right networks even if a sufficiently large data set is available. This motivates us to explore an algorithm that will not suffer from this problem. We first identify an asymptotic property of different score metrics, based on which we then present a hybrid learning method that can be proved to be asymptotically convergent. We show that the algorithm, when employing the information criterion and the Bayesian metric, guarantees to converge in a very general way and is computationally feasible. Evaluation of the algorithm with simulated data is given to demonstrate the capability of the algorithm
Keywords :
belief networks; convergence; learning (artificial intelligence); probability; Bayesian metric; Bayesian networks; asymptotic convergence; asymptotic property; heuristic single link; hybrid convergent method; hybrid learning method; information criterion; probabilistic networks; score metrics; Bayesian methods; Computational modeling; Convergence; Databases; Learning systems; Optimization methods; Probability distribution; Systems engineering and theory;
Journal_Title :
Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on
DOI :
10.1109/3468.784170