Title :
Robust max-product belief propagation
Author :
Ibrahimi, Morteza ; Javanmard, Adel ; Kanoria, Yashodhan ; Montanari, Andrea
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., Stanford, CA, USA
Abstract :
We study the problem of optimizing a graph-structured objective function under adversarial uncertainty. This problem can be modeled as a two-persons zero-sum game between an Engineer and Nature. The Engineer controls a subset of the variables (nodes in the graph), and tries to assign their values to maximize an objective function. Nature controls the complementary subset of variables and tries to minimize the same objective. This setting encompasses estimation and optimization problems under model uncertainty, and strategic problems with a graph structure. Von Neumann´s minimax theorem guarantees the existence of a (minimax) pair of randomized strategies that provide optimal robustness for each player against its adversary. We prove several structural properties of this strategy pair in the case of graph-structured payoff function. In particular, the randomized minimax strategies (distributions over variable assignments) can be chosen in such a way to satisfy the Markov property with respect to the graph. This significantly reduces the problem dimensionality. Finally we introduce a message passing algorithm to solve this minimax problem. The algorithm generalizes max-product belief propagation to this new domain.
Keywords :
belief maintenance; game theory; graph theory; message passing; minimax techniques; Von Neumann minimax theorem; adversarial uncertainty; engineer; estimation problems; graph-structured objective function optimization; graph-structured payoff function; message passing algorithm; model uncertainty; nature; optimization problems; robust max-product belief propagation; two-persons zero-sum game; Convergence; Game theory; Games; Graphical models; Optimization; Robustness; Vectors;
Conference_Titel :
Signals, Systems and Computers (ASILOMAR), 2011 Conference Record of the Forty Fifth Asilomar Conference on
Conference_Location :
Pacific Grove, CA
Print_ISBN :
978-1-4673-0321-7
DOI :
10.1109/ACSSC.2011.6189951