Distributed correlated Q-learning for dynamic transmission control of sensor networks

Author

Huang, Jane Wei ; Zhu, Quanyan ; Krishnamurthy, Vikram ; Basar, Tamer

Author_Institution

Electr. & Comput. Eng. Dept., Univ. of British Columbia, Vancouver, BC, Canada

fYear

2010

fDate

14-19 March 2010

Firstpage

1982

Lastpage

1985

Abstract

This paper considers a Markovian dynamical game theoretic setting for distributed transmission control in a wireless sensor network. The available spectrum bandwidth is modeled as a Markov chain. A distributed algorithm named correlated Q-learning algorithm is proposed to obtain the correlated equilibrium policies of the system. This algorithm has the decentralized feature and is easily implementable in a real system. Numerical example is also provided to verify the performances of the proposed algorithms.

Keywords

Markov processes; distributed algorithms; game theory; wireless sensor networks; Markov chain; Markovian dynamical game theoretic setting; distributed algorithm; distributed correlated Q-learning; dynamic transmission control; spectrum bandwidth; wireless sensor network; Bandwidth; Batteries; Distributed algorithms; Game theory; Learning; Object detection; Sensor systems; Stochastic processes; Stochastic systems; Wireless sensor networks; Distributed Algorithms; Game Theory; Multisensor Systems; Stochastic games;

fLanguage

English

Publisher

ieee

Conference_Titel

Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on

Conference_Location

Dallas, TX

ISSN

1520-6149

Print_ISBN

978-1-4244-4295-9

Electronic_ISBN

1520-6149

Type

conf

DOI

10.1109/ICASSP.2010.5495265

Filename

5495265