Dynamic optimization flow control

In this paper, we introduce a class of flow control problems in a network which involves dynamic optimization. As opposed to the static flow control problem where the source rates are determined as a result of a static optimization problem, in our formulation the rates are adjusted according to the solution of an infinite-horizon discounted optimal control problem. The objective is to maximize the aggregate source utility over transmission rates, while at the same time keeping the buffer occupancies throughout the network at an acceptable level.