Optimal sequential-decisions in the presence of exogenous-inputs with structured variations

Contemporary decision-theoretic methodologies used to develop ldquooptimalrdquo sequential-decisions for dynamic-processes in industrial-applications rely on Markov-models of uncertain exogenous-inputs that act-on the underlying dynamic process. In this paper it is shown that, for some types of uncertain exogenous-inputs, a novel alternative to the classical Markov-model may be better suited for calculating optimal sequential-decisions. A specific, simple Example is worked to illustrate incorporation of the proposed alternative model of an uncertain exogenous-input into the Dynamic Programming ldquosolutionrdquo of an optimal sequential-decision problem.