Duality between cost and density in optimal control

A theorem on duality between cost functions and density functions in optimal control is derived using the Hahn-Banach theorem. The result puts focus on convexity aspects in control synthesis and the theory of almost global stability. In particular, it gives a new proof that existence of a density function is both necessary and sufficient for almost global stability in a nonlinear system.