Quantised kernel least mean square with desired signal smoothing

The quantised kernel least mean square (QKLMS) is a simple yet efficient online learning algorithm, which reduces the computational cost significantly by quantising the input space to constrain the growth of network size. The QKLMS considers only the input space compression and assumes that the desired outputs of the quantised data are equal to those of the closest centres. In many cases, however, the outputs in a neighbourhood may have big differences, especially when the underlying system is disturbed by impulsive noises. Such fluctuation in desired outputs may seriously deteriorate the learning performance. To address this issue, a simple online method is proposed to smooth the desired signal within a neighbourhood corresponding to a quantisation region. The resulting algorithm is referred to as the QKLMS with desired signal smoothing. The desirable performance of the new algorithm is confirmed by Monte Carlo simulations.