• DocumentCode
    1233294
  • Title

    Observable augmented systems for sensitivity analysis of Markov and semi-Markov processes

  • Author

    Cassandras, Christos G. ; Strickland, Stephen G.

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Massachusetts Univ., Amherst, MA, USA
  • Volume
    34
  • Issue
    10
  • fYear
    1989
  • fDate
    10/1/1989 12:00:00 AM
  • Firstpage
    1026
  • Lastpage
    1037
  • Abstract
    Previous work by the authors (1989) on sensitivity analysis of discrete-event systems (DESs), where an augmented chain approach for estimating performance sensitivities from a single nominal sample path was developed, is extended. In contrast to existing methods, this approach can be applied to cases involving discrete (e.g. integer-valued) parameters such as queue capacities or routing thresholds. However, the basic method is limited by some rather restrictive observability conditions. These conditions are relaxed through an observability transformation which generalizes the method´s applicability. Direct extensions to more general (non-Markovian) DES are also presented via a simplified generalized semi-Markov process reformulation of the approach. Experimental verification of the techniques is included
  • Keywords
    Markov processes; discrete systems; observability; queueing theory; sensitivity analysis; state estimation; augmented chain approach; discrete-event systems; observability conditions; observability transformation; performance sensitivities; queue capacities; routing thresholds; semi-Markov processes; sensitivity analysis; Computational modeling; Control systems; Discrete event systems; Markov processes; Observability; Performance analysis; Routing; Sensitivity analysis; State estimation; Stochastic processes;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.35272
  • Filename
    35272