• DocumentCode
    3426941
  • Title

    Direct-comparison approach to continuous time Linear Quadratic Gaussian control problem

  • Author

    Wang, De-Xin ; Lu, Tao ; Cao, Xi-Ren

  • Author_Institution
    Dept. of Electron. & Comput. Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
  • fYear
    2009
  • fDate
    9-11 Dec. 2009
  • Firstpage
    81
  • Lastpage
    85
  • Abstract
    Recently, a direct-comparison approach has been developed to control and optimize the performance of a stochastic Markov system, see for discrete time case, and for continuous time case. Compared with dynamic programming, the standard approach for stochastic control problem, this alternative approach is simple and intuitive. It is based on the direct comparison of the system performance under two policies, and discounting is not needed when dealing with long-run average criterion. By directly applying this approach, we studied the continuous time linear quadratic Gaussian (LQG) control problem, obtained the optimal policy for the long run average criterion without introducing discounting. The well known algebraic Riccati equation for the optimal policy can be easily obtained by this direct-comparison approach. This paper servers as an example to show the effectiveness of direct-comparison approach for the continuous time case.
  • Keywords
    Markov processes; linear quadratic Gaussian control; stochastic systems; algebraic Riccati equation; continuous time case; continuous time linear quadratic Gaussian control problem; direct-comparison approach; discrete time case; dynamic programming; stochastic Markov system; Automatic control; Automation; Control systems; Dynamic programming; Optimal control; Riccati equations; Stochastic processes; Stochastic systems; Symmetric matrices; System performance;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Control and Automation, 2009. ICCA 2009. IEEE International Conference on
  • Conference_Location
    Christchurch
  • Print_ISBN
    978-1-4244-4706-0
  • Electronic_ISBN
    978-1-4244-4707-7
  • Type

    conf

  • DOI
    10.1109/ICCA.2009.5410326
  • Filename
    5410326