• DocumentCode
    3003719
  • Title

    Optimal node visitation in acyclic stochastic digraphs

  • Author

    Bountourelis, Theologos ; Reveliotis, Spyros

  • Author_Institution
    Sch. of Ind. & Syst. Eng., Georgia Inst. of Technol., Atlanta, GA
  • fYear
    2006
  • fDate
    10-12 July 2006
  • Firstpage
    358
  • Lastpage
    365
  • Abstract
    Given a stochastic, acyclic, connected digraph with a single source node and a control agent that repetitively traverses this graph, each time starting from the source node, we want to define a control policy that will enable this agent to visit each of the graph terminal nodes a prespecified number of times, while minimizing the expected number of the graph traversals. We first formulate this problem as a specially structured discrete time Markov decision process, and we subsequently develop an asymptotically optimal randomized policy of polynomial complexity with respect to the problem size
  • Keywords
    Markov processes; computational complexity; graph theory; minimisation; acyclic stochastic digraphs; control agent; control policy; discrete time Markov decision process; graph traversals minimization; optimal node visitation; optimal randomized policy; polynomial complexity; Computational complexity; Control systems; Electrical equipment industry; Industrial control; Optimal control; Performance evaluation; Polynomials; Stochastic processes; Stochastic systems; Systems engineering and theory;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Discrete Event Systems, 2006 8th International Workshop on
  • Conference_Location
    Ann Arbor, MI
  • Print_ISBN
    1-4244-0053-8
  • Type

    conf

  • DOI
    10.1109/WODES.2006.382394
  • Filename
    4267645