DocumentCode
3003719
Title
Optimal node visitation in acyclic stochastic digraphs
Author
Bountourelis, Theologos ; Reveliotis, Spyros
Author_Institution
Sch. of Ind. & Syst. Eng., Georgia Inst. of Technol., Atlanta, GA
fYear
2006
fDate
10-12 July 2006
Firstpage
358
Lastpage
365
Abstract
Given a stochastic, acyclic, connected digraph with a single source node and a control agent that repetitively traverses this graph, each time starting from the source node, we want to define a control policy that will enable this agent to visit each of the graph terminal nodes a prespecified number of times, while minimizing the expected number of the graph traversals. We first formulate this problem as a specially structured discrete time Markov decision process, and we subsequently develop an asymptotically optimal randomized policy of polynomial complexity with respect to the problem size
Keywords
Markov processes; computational complexity; graph theory; minimisation; acyclic stochastic digraphs; control agent; control policy; discrete time Markov decision process; graph traversals minimization; optimal node visitation; optimal randomized policy; polynomial complexity; Computational complexity; Control systems; Electrical equipment industry; Industrial control; Optimal control; Performance evaluation; Polynomials; Stochastic processes; Stochastic systems; Systems engineering and theory;
fLanguage
English
Publisher
ieee
Conference_Titel
Discrete Event Systems, 2006 8th International Workshop on
Conference_Location
Ann Arbor, MI
Print_ISBN
1-4244-0053-8
Type
conf
DOI
10.1109/WODES.2006.382394
Filename
4267645
Link To Document