Title :
Fast computation of the L1-principal component of real-valued data
Author :
Kundu, Sandipan ; Markopoulos, P.P. ; Pados, Dimitris A.
Author_Institution :
Dept. of Electr. Eng., State Univ. of New York at Buffalo, Buffalo, NY, USA
Abstract :
Recently, Markopoulos et al. [1], [2] presented an optimal algorithm that computes the L1 maximum-projection principal component of any set of N real-valued data vectors of dimension D with complexity polynomial in N, O(ND). Still, moderate to high values of the data dimension D and/or data record size N may render the optimal algorithm unsuitable for practical implementation due to its exponential in D complexity. In this paper, we present for the first time in the literature a fast greedy single-bit-flipping conditionally optimal iterative algorithm for the computation of the L1 principal component with complexity O(N3). Detailed numerical studies are carried out demonstrating the effectiveness of the developed algorithm with applications to the general field of data dimensionality reduction and direction-of-arrival estimation.
Keywords :
computational complexity; direction-of-arrival estimation; learning (artificial intelligence); principal component analysis; L1 maximum-projection principal component; N real-valued data vectors; complexity polynomial; data dimensionality reduction; direction-of-arrival estimation; machine learning; optimal algorithm; outlier resistance; real-valued data; subspace signal processing; Complexity theory; Convergence; Direction-of-arrival estimation; Robustness; Signal processing algorithms; Vectors; Dimensionality reduction; L1 and L2 principal component; direction-of-arrival estimation; eigen-decomposition; machine learning; outlier resistance; subspace signal processing;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on
Conference_Location :
Florence
DOI :
10.1109/ICASSP.2014.6855164