Common framework of certain reinforcement schedules

We investigate reinforcement algorithms in a context of feedforward networks with gradient learning which use the smoothed output gradient estimators. The reduced network is introduced to avoid output redundancy. The adaptive critic element can be viewed as a network with smoothed output gradients, and the associative search elements the reduced network with smoothed output gradients. In this context, the adaptive critic element becomes a regular member of the family of adaptive critic designs