Approximating linear programming problems which arise in stochastic control

We study a general approximation scheme for infinite-dimensional linear programming (LP) problems which arise naturally in stochastic control. We prove that the optimal value of the approximating problems converges to the value of the original LP problem. For the controls, we show that if the approximating optimal controls converge, the limiting control is an optimal control for the original LP problem. As an application of this theory, we present numerical approximations to the LP formulation of a long-term average control problem in continuous time