Branching bandits and Klimov´s problem: achievable region and side constraints

Considers the average cost branching bandits problem and its special case known as Klimov´s problem. The authors consider the vector n whose components are the mean number of bandits (or customers) of each type that are present. The authors characterize fully the achievable region, that is, the set of all possible vectors n that can be obtained by considering all possible policies. While the original description of the achievable region involves exponentially many constraints, the authors also develop an alternative description that involves only O(R ²) variables and constraints, where R is the number of bandit types (or customer classes). The authors then consider the problem of minimizing a linear function of n subject to L additional linear constraints on n. The authors show that optimal policies can be obtained by randomizing between L+1 strict priority policies that can be found efficiently (in polynomial time) using linear programming techniques