• DocumentCode
    2613838
  • Title

    Model reduction of irreducible Markov chains

  • Author

    Kotsalis, Georgios ; Dahleh, Murither

  • Author_Institution
    Lab. for Inf. & Decision Syst., Massachusetts Inst. of Technol., Cambridge, MA, USA
  • Volume
    6
  • fYear
    2003
  • fDate
    9-12 Dec. 2003
  • Firstpage
    5727
  • Abstract
    We are interested in developing computational tools for reducing the state space of irreducible Markov chains. As means of decreasing the dimensionality of a given Markov chain we study the concept of aggregation. The approximation error between the original and the reduced order model is captured by a metric that penalizes the asymptotic deviation of the outputs of the two systems. For the case of nearly completely decomposable Markov chains we demonstrate how a decomposition approach can be used to derive a low order model of good fidelity.
  • Keywords
    Markov processes; reduced order systems; stochastic systems; aggregation; approximation error; decomposition approach; irreducible Markov chains; model reduction; Autonomous agents; Decision making; Distributed computing; Equations; Laboratories; Probability distribution; Reduced order systems; Space technology; State-space methods; Tin;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 2003. Proceedings. 42nd IEEE Conference on
  • ISSN
    0191-2216
  • Print_ISBN
    0-7803-7924-1
  • Type

    conf

  • DOI
    10.1109/CDC.2003.1271917
  • Filename
    1271917