Empirical estimation in average Markov control processes Original Research Article

This work concerns discrete-time Markov control processes with unbounded costs and unknown disturbance distribution θθ. Assuming observability of the random disturbance, we estimate θθ using its empirical estimator, which, combined with a variant of the vanishing discount factor approach, yields average cost optimal policies.