CMAC-based adaptive critic self-learning control

A technique that integrates the cerebellar model articulation controller (CMAC) into a self-learning control scheme developed by A.G. Barto et al. (IEEE Trans. Syst. Man., Cybern., vol.SMC-13, p.834-46, Sept./Oct. 1983) is presented. Instead of reserving one input line (as a memory) for each quantized state, the integrated technique distributively stores learned information; this reduces the required memory and makes the self-learning control scheme applicable to problems of larger size. CMAC´s capability with regard to information interpolation also helps improve the learning speed