• DocumentCode
    2172342
  • Title

    Estimation of the forgetting factor in kernel recursive least squares

  • Author

    Van Vaerenbergh, Steven ; Santamaría, Ignacio ; Lázaro-Gredilla, Miguel

  • Author_Institution
    Dept. of Commun. Eng., Univ. of Cantabria, Santander, Spain
  • fYear
    2012
  • fDate
    23-26 Sept. 2012
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    In a recent work we proposed a kernel recursive least-squares tracker (KRLS-T) algorithm that is capable of tracking in non-stationary environments, thanks to a forgetting mechanism built on a Bayesian framework. In order to guarantee optimal performance its parameters need to be determined, specifically its kernel parameters, regularization and, most importantly in non-stationary environments, its forgetting factor. This is a common difficulty in adaptive filtering techniques and in signal processing algorithms in general. In this paper we demonstrate the equivalence between KRLS-T´s recursive tracking solution and Gaussian process (GP) regression with a specific class of spatio-temporal covariance. This result allows to use standard hyperparameter estimation techniques from the Gaussian process framework to determine the parameters of the KRLS-T algorithm. Most notably, it allows to estimate the optimal forgetting factor in a principled manner. We include results on different benchmark data sets that offer interesting new insights.
  • Keywords
    Bayes methods; Gaussian processes; filtering theory; least squares approximations; regression analysis; signal processing; spatiotemporal phenomena; Bayesian framework; GP regression; Gaussian process; KRLS-T algorithm; adaptive filtering techniques; forgetting mechanism; kernel recursive least squares tracker; nonstationary environments; signal processing algorithms; spatio-temporal covariance; Bayesian methods; Doppler effect; Fading; Kernel; Signal processing algorithms; Standards; Vectors; Gaussian processes; adaptive filtering; forgetting factor; kernel recursive least squares;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Machine Learning for Signal Processing (MLSP), 2012 IEEE International Workshop on
  • Conference_Location
    Santander
  • ISSN
    1551-2541
  • Print_ISBN
    978-1-4673-1024-6
  • Electronic_ISBN
    1551-2541
  • Type

    conf

  • DOI
    10.1109/MLSP.2012.6349749
  • Filename
    6349749