Temporal difference learning waveform selection

Author

Wang, Bin ; Wang, Jinkuan ; Song, Xin ; Han, Yinghua

Author_Institution

Coll. of Inf. Sci. & Eng., Northeastern Univ., Shenyang, China

Volume

4

fYear

2009

fDate

8-9 Aug. 2009

Firstpage

533

Lastpage

536

Abstract

The largest difference between cognitive radar and other adaptive radar is the adaptivity of transmitter in cognitive radar. How to optimally decide or select the radar waveform for next transmission based on the observation of past radar returns is one of the important issues. In this paper, with the stochastic dynamic programming model of waveform selection, we use the method of temporal difference learning to solve this problem and realize the adaptivity of waveform selection. The simulation results show that the uncertainty of state estimation using temporal difference learning is less than that using fixed waveform.

Keywords

adaptive radar; cognitive systems; dynamic programming; radar signal processing; state estimation; stochastic programming; adaptive radar; cognitive radar; state estimation; stochastic dynamic programming model; temporal difference learning method; waveform selection; Cost function; Doppler radar; Dynamic programming; Dynamic scheduling; Intelligent sensors; Radar antennas; Radar measurements; Spaceborne radar; Stochastic processes; Transmitters; cognitive radar; stochastic dynamic programming; temporal difference learning; waveform selection;

fLanguage

English

Publisher

ieee

Conference_Titel

Computing, Communication, Control, and Management, 2009. CCCM 2009. ISECS International Colloquium on

Conference_Location

Sanya

Print_ISBN

978-1-4244-4247-8

Type

conf

DOI

10.1109/CCCM.2009.5267516

Filename

5267516