• DocumentCode
    3495446
  • Title

    Belief-node condensation for online POMDP algorithms

  • Author

    Rens, Gavin ; Ferrein, Alexander

  • Author_Institution
    Centre for Artificial Intell. Res., Meraka Inst., Pretoria, South Africa
  • fYear
    2013
  • fDate
    9-12 Sept. 2013
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    We consider online partially observable Markov decision processes (POMDPs) which compute policies by local look-ahead from the current belief-state. One problem is that belief-nodes deeper in the decision-tree increase in the number of states with non-zero probability they contain. Computation time of updating a belief-state is exponential in the number of states contained by the belief. Belief-update occurs for each node in a search tree. It would thus pay to reduce the size of the nodes while keeping the information they contain. In this paper, we compare four fast and frugal methods to reduce the size of belief-nodes in the search tree, hence improving the running-time of online POMDP algorithms.
  • Keywords
    Markov processes; decision trees; multi-agent systems; probability; tree searching; POMDP; agent next action selection; belief-node condensation; belief-state; belief-update; computation time; decision-tree; local look-ahead; nonzero probability; online POMDP algorithm; online partially observable Markov decision processes; search tree; Heuristic algorithms; Markov processes; Planning; Probability distribution; Robots; Sensors; Uncertainty;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    AFRICON, 2013
  • Conference_Location
    Pointe-Aux-Piments
  • ISSN
    2153-0025
  • Print_ISBN
    978-1-4673-5940-5
  • Type

    conf

  • DOI
    10.1109/AFRCON.2013.6757747
  • Filename
    6757747