Title :
A Mean Field Game Synthesis of Initial Mean Consensus Problems: A Continuum Approach for Non-Gaussian Behavior
Author :
Nourian, Mojtaba ; Caines, Peter E. ; Malhame, Roland P.
Author_Institution :
Dept. of Electr. & Comput. Eng., McGill Univ., Montreal, QC, Canada
Abstract :
This technical note presents a continuum approach to a non-Gaussian initial mean consensus problem via Mean Field (MF) stochastic control theory. In this problem formulation: (i) each agent has simple stochastic dynamics with inputs directly controlling its state´s rate of change and (ii) each agent seeks to minimize by continuous state feedback its individual discounted cost function involving the mean of the states of all other agents. For this dynamic game problem, a set of coupled deterministic (Hamilton-Jacobi-Bellman and Fokker-Planck-Kolmogorov) equations is derived approximating the stochastic system of agents as the population size goes to infinity. In a finite population system (analogous to the MF LQG framework): (i) the resulting decentralized MF control strategies possess an εN-Nash equilibrium property where εN goes to zero as the population size N approaches infinity and (ii) these MF control strategies steer each individual´s state toward the initial state population mean which is reached asymptotically as time goes to infinity. Hence, the system with decentralized MF control strategies reaches mean-consensus on the initial state population mean asymptotically as time goes to infinity.
Keywords :
continuous systems; decentralised control; game theory; linear quadratic Gaussian control; state feedback; stochastic systems; εN-Nash equilibrium property; Fokker-Planck-Kolmogorov equation; Hamilton-Jacobi-Bellman equation; MF LQG framework; MF stochastic control theory; continuous state feedback; cost function; coupled deterministic equations; decentralized MF control strategy; dynamic game problem; finite population system; initial state population; mean field game synthesis; mean field stochastic control theory; mean-consensus; non-Gaussian behavior; non-Gaussian initial mean consensus problem; population size; stochastic dynamics; stochastic system; Consensus problems; Nash equilibria; continuum models; decentralized control; mean field control; stochastic optimal control;
Journal_Title :
Automatic Control, IEEE Transactions on
DOI :
10.1109/TAC.2013.2270867