• DocumentCode
    115094
  • Title

    Exact simulation of continuous time Markov jump processes with anticorrelated variance reduced Monte Carlo estimation

  • Author

    Maginnis, Peter A. ; West, Matthew ; Dullerud, Geir E.

  • Author_Institution
    Univ. Illinois, Urbana, IL, USA
  • fYear
    2014
  • fDate
    15-17 Dec. 2014
  • Firstpage
    3401
  • Lastpage
    3407
  • Abstract
    We provide an exact, continuous time extension to previous work in anticorrelated stochastic process simulation that was performed in an approximate, discrete time setting. These methods reduce the variance of continuous time Monte Carlo for Markov jump process systems. We rigorously construct antithetic Poisson processes and analytically prove the negative correlation between pairs. We then show how these anticorrelated Poisson processes can be used to drive Markov jump processes via a random time change representation. Finally, we provide a sufficient condition for variance reduction in the jump process context as well as demonstrate a simple example.
  • Keywords
    Markov processes; Monte Carlo methods; random processes; anticorrelated stochastic process simulation; anticorrelated variance reduced Monte Carlo estimation; antithetic Poisson processes; continuous time Markov jump processes; exact continuous time extension; negative correlation; random time change representation; Context; Correlation; Estimation; Markov processes; Monte Carlo methods; Random variables;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
  • Conference_Location
    Los Angeles, CA
  • Print_ISBN
    978-1-4799-7746-8
  • Type

    conf

  • DOI
    10.1109/CDC.2014.7039916
  • Filename
    7039916