Title :
Spectrum bandit optimization
Author :
Lelarge, Marc ; Proutiere, Alexandre ; Talebi, M. Sadegh
Abstract :
We consider the problem of allocating radio channels to links in a wireless network. Links interact through interference, modelled as a conflict graph (i.e., two interfering links cannot be simultaneously active on the same channel). We aim at identifying the channel allocation maximizing the total network throughput over a finite time horizon. Should we know the average radio conditions on each channel and on each link, an optimal allocation would be obtained by solving an Integer Linear Program (ILP). When radio conditions are unknown a priori, we look for a sequential channel allocation policy that converges to the optimal allocation while minimizing on the way the throughput loss or regret due to the need for exploring suboptimal allocations. We formulate this problem as a generic linear bandit problem, and analyze it in a stochastic setting where radio conditions are driven by a i.i.d. stochastic process, and in an adversarial setting where radio conditions can evolve arbitrarily. We provide, in both settings, algorithms whose regret upper bounds outperform those of existing algorithms.
Keywords :
channel allocation; integer programming; linear programming; wireless channels; ILP; finite time horizon; generic linear bandit problem; integer linear program; radio channel allocation; sequential channel allocation policy; spectrum bandit optimization; total network throughput; wireless network; Channel allocation; Interference; Optimization; Radio transmitters; Resource management; Stochastic processes; Upper bound;
Conference_Titel :
Information Theory Workshop (ITW), 2013 IEEE
Conference_Location :
Sevilla
Print_ISBN :
978-1-4799-1321-3
DOI :
10.1109/ITW.2013.6691221