• DocumentCode
    2444892
  • Title

    Learning sensor-detection policies

  • Author

    Malhotra, Ravish ; Blasch, Lt Erik P ; Johnson, Jeffery D.

  • Author_Institution
    WL-AACF, WPAFB, OH, USA
  • Volume
    2
  • fYear
    1997
  • fDate
    14-18 Jul 1997
  • Firstpage
    769
  • Abstract
    Tactical aircraft pilots frequently perform complex sequential support tasks to obtain accurate and timely integrated sensor information about the local environment. When workloads are heavy, offloading these sensor-support tasks to an automated sensor management system would enhance performance and situational awareness. Reinforcement learning, a family of machine learning techniques, offers a way to learn to conduct sensor-support tasks despite sensor complexities by mapping a situation to an action. This paper applies reinforcement learning to a simplified target-detection policy, compares simulated performances of the learned technique to that of an optimal and an uninformed detection policy, and draws conclusions for future research directions
  • Keywords
    Markov processes; backpropagation; belief maintenance; decision theory; learning (artificial intelligence); military computing; radar computing; radar detection; radar signal processing; radar target recognition; radar tracking; sensor fusion; target tracking; temporal reasoning; uncertainty handling; automated sensor management system; backpropagation network; belief states; complex sequential support tasks; incremental reinforcement; index rule; integrated sensor information; local environment; machine learning; partially-observable Markov decision process; reinforcement learning; sensor fusion; sensor-detection policies; simplified target-detection policy; situational awareness; static target detection; supervised learning; tactical aircraft pilots; temporal difference learning; uncertainty; Aerospace electronics; Aircraft; Biosensors; Environmental management; Learning; Object detection; Optical sensors; Radar detection; Sensor fusion; Sensor systems;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Aerospace and Electronics Conference, 1997. NAECON 1997., Proceedings of the IEEE 1997 National
  • Conference_Location
    Dayton, OH
  • Print_ISBN
    0-7803-3725-5
  • Type

    conf

  • DOI
    10.1109/NAECON.1997.622727
  • Filename
    622727