Beam scheduling for electronically scanned array tracking systems using multi-arm bandits

Author

Krishnamurthy, Vikram ; Mickova, Josipa ; Evans, Robin J.

Author_Institution

Dept. of Electr. & Electron. Eng., Melbourne Univ., Parkville, Vic., Australia

Volume

1

fYear

1999

fDate

1999

Firstpage

1039

Abstract

We derive optimal and sub-optimal beam scheduling algorithms for electronically scanned array tracking systems. We formulate the scheduling problem as a multi-arm bandit problem involving hidden Markov models. A finite dimensional optimal solution to this multi-arm bandit problem is presented. The key to solving any multi-arm bandit problem is to compute the Gittins index. We present, a finite dimensional algorithm which computes the Gittins index. Suboptimal algorithms for computing the Gittins index are also presented

Keywords

decision theory; dynamic programming; game theory; hidden Markov models; state estimation; target tracking; Gittins index; beam scheduling; electronically scanned array tracking systems; finite dimensional optimal solution; multi-arm bandits; scheduling problem; Aerospace electronics; Aircraft; Dynamic programming; Hidden Markov models; Job shop scheduling; Processor scheduling; Scheduling algorithm; State estimation; Target tracking; Time measurement;

fLanguage

English

Publisher

ieee

Conference_Titel

Decision and Control, 1999. Proceedings of the 38th IEEE Conference on

Conference_Location

Phoenix, AZ

ISSN

0191-2216

Print_ISBN

0-7803-5250-5

Type

conf

DOI

10.1109/CDC.1999.832932

Filename

832932