Title :
Transmission control in cognitive radio as a Markovian dynamic game: Structural result on randomized threshold policies
Author :
Huang, Jane Wei ; Krishnamurthy, Vikram
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of British Columbia, Vancouver, BC, Canada
fDate :
1/1/2010 12:00:00 AM
Abstract :
This paper considers an uplink time division multiple access (TDMA) cognitive radio network where multiple cognitive radios (secondary users) attempt to access a spectrum hole. We assume that each secondary user can access the channel according to a decentralized predefined access rule based on the channel quality and the transmission delay of each secondary user. By modeling secondary user block fading channel qualities as a finite state Markov chain, we formulate the transmission rate adaptation problem of each secondary user as a general-sum Markovian dynamic game with a delay constraint. Conditions are given so that the Nash equilibrium transmission policy of each secondary user is a randomized mixture of pure threshold policies. Such threshold policies can be easily implemented. We then present a stochastic approximation algorithm that can adaptively estimate the Nash equilibrium policies and track such policies for non-stationary problems where the statistics of the channel and user parameters evolve with time.
Keywords :
Markov processes; cognitive radio; fading channels; game theory; telecommunication congestion control; time division multiple access; Markovian dynamic game; Nash equilibrium transmission policy; block fading channel; channel quality; cognitive radio network; finite state Markov chain; stochastic approximation algorithm; time division multiple access; transmission control; transmission delay; transmission rate adaptation problem; Approximation algorithms; Cognitive radio; Delay; Fading; Media Access Protocol; Nash equilibrium; Radio control; Resource management; Stochastic processes; Time division multiple access; Cognitive radio, general-sum Markovian dynamic game; randomized threshold policies; switching control game, Nash equilibrium;
Journal_Title :
Communications, IEEE Transactions on
DOI :
10.1109/TCOMM.2010.01.080157