DocumentCode
2444892
Title
Learning sensor-detection policies
Author
Malhotra, Ravish ; Blasch, Lt Erik P ; Johnson, Jeffery D.
Author_Institution
WL-AACF, WPAFB, OH, USA
Volume
2
fYear
1997
fDate
14-18 Jul 1997
Firstpage
769
Abstract
Tactical aircraft pilots frequently perform complex sequential support tasks to obtain accurate and timely integrated sensor information about the local environment. When workloads are heavy, offloading these sensor-support tasks to an automated sensor management system would enhance performance and situational awareness. Reinforcement learning, a family of machine learning techniques, offers a way to learn to conduct sensor-support tasks despite sensor complexities by mapping a situation to an action. This paper applies reinforcement learning to a simplified target-detection policy, compares simulated performances of the learned technique to that of an optimal and an uninformed detection policy, and draws conclusions for future research directions
Keywords
Markov processes; backpropagation; belief maintenance; decision theory; learning (artificial intelligence); military computing; radar computing; radar detection; radar signal processing; radar target recognition; radar tracking; sensor fusion; target tracking; temporal reasoning; uncertainty handling; automated sensor management system; backpropagation network; belief states; complex sequential support tasks; incremental reinforcement; index rule; integrated sensor information; local environment; machine learning; partially-observable Markov decision process; reinforcement learning; sensor fusion; sensor-detection policies; simplified target-detection policy; situational awareness; static target detection; supervised learning; tactical aircraft pilots; temporal difference learning; uncertainty; Aerospace electronics; Aircraft; Biosensors; Environmental management; Learning; Object detection; Optical sensors; Radar detection; Sensor fusion; Sensor systems;
fLanguage
English
Publisher
ieee
Conference_Titel
Aerospace and Electronics Conference, 1997. NAECON 1997., Proceedings of the IEEE 1997 National
Conference_Location
Dayton, OH
Print_ISBN
0-7803-3725-5
Type
conf
DOI
10.1109/NAECON.1997.622727
Filename
622727
Link To Document