Title :
A fast maximum likelihood estimation approach to LAD regression
Author :
Li, Yinbo ; Arce, Gonzalo R.
Author_Institution :
Dept. of Electr. & Comput. Eng., Delaware Univ., Newark, DE, USA
Abstract :
In this paper, we show that the optimization needed to solve the least absolute deviations (LAD) regression problem can be viewed as a sequence of maximum likelihood estimates (MLE) of location. The derived algorithm reduces to an iterative procedure where a simple coordinate transformation is applied during each iteration to direct the optimization procedure along edge lines of the cost surface, followed by a MLE estimate of location which is executed by a weighted median operation. Requiring weighted medians only, the new algorithm can be easily modularized for hardware implementation, as opposed to most of the other existing LAD methods which require complicated operations such as matrix entry manipulations. The new algorithm provides a better trade-off solution between convergence speed and implementation complexity compared to existing algorithms.
Keywords :
convergence of numerical methods; iterative methods; maximum likelihood estimation; regression analysis; LAD regression; MLE location estimates; convergence speed; coordinate transformation; cost surface edge lines; fast maximum likelihood estimation; implementation complexity; iterative procedure; least absolute deviations regression problem; optimization; robust regression methods; weighted median operation; Collaborative work; Cost function; Hardware; Iterative algorithms; Laplace equations; Least squares methods; Linear regression; Maximum likelihood estimation; Robustness; Statistics;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on
Print_ISBN :
0-7803-8484-9
DOI :
10.1109/ICASSP.2004.1326401