Title :
Opportunistic Bandwidth Sharing Through Reinforcement Learning
Author :
Venkatraman, Pavithra ; Hamdaoui, Bechir ; Guizani, Mohsen
Author_Institution :
Sch. of Electr. Eng. & Comput. Sci., Oregon State Univ., Corvallis, OR, USA
fDate :
7/1/2010 12:00:00 AM
Abstract :
As an initial step toward solving the spectrum-shortage problem, the Federal Communications Commission (FCC) has started the so-called opportunistic spectrum access (OSA), which allows unlicensed users to exploit the unused licensed spectrum, but in a manner that limits interference to licensed users. Fortunately, technological advances have enabled cognitive radios, which have recently been recognized as the key enabling technology for realizing OSA. In this paper, we propose a machine-learning-based scheme that will exploit the cognitive radios´ capabilities to enable effective OSA, thus improving the efficiency of spectrum utilization. Our proposed learning technique requires no prior knowledge of the environment´s characteristics and dynamics, yet it can still achieve high performance by learning from interaction with the environment.
Keywords :
Markov processes; cognitive radio; decision theory; learning (artificial intelligence); radio spectrum management; telecommunication computing; Federal Communications Commission; Markov decision process; cognitive radios; machine-learning-based scheme; opportunistic bandwidth sharing; reinforcement learning technique; spectrum utilization efficiency; spectrum-shortage problem; Markov decision process; opportunistic spectrum access; reinforcement learning;
Journal_Title :
Vehicular Technology, IEEE Transactions on
DOI :
10.1109/TVT.2010.2048766