Title :
Death and discounting
Author_Institution :
Fac. of Electr. Eng., Technion-Israel Inst. of Technol., Haifa, Israel
fDate :
4/1/2001 12:00:00 AM
Abstract :
Markov decision processes (MDP) with discounted cost are equivalent to processes with a finite-random duration, and, hence, the discount factor models a (random) time horizon for the life of the process. We elaborate on this idea, but show that an objective function which is a linear combination of several discounted costs (each with a different discount factor) does not, in general, model processes with several time scales, but rather processes with partial information
Keywords :
Markov processes; MDP; Markov decision processes; discount factor; discounted cost; discounted costs; finite-random duration; linear combination; objective function; random time horizon; Cost function; Extraterrestrial measurements; History; Markov processes; Probability distribution; Space technology; State-space methods;
Journal_Title :
Automatic Control, IEEE Transactions on