DocumentCode
86036
Title
The Sparse Principal Component of a Constant-Rank Matrix
Author
Asteris, Megasthenis ; Papailiopoulos, Dimitris S. ; Karystinos, George N.
Author_Institution
Dept. of Electr. & Comput. Eng., Univ. of Texas at Austin, Austin, TX, USA
Volume
60
Issue
4
fYear
2014
fDate
Apr-14
Firstpage
2281
Lastpage
2290
Abstract
The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem NP-hard. In this paper, we prove that, if the matrix is positive semidefinite and its rank is constant, then its sparse principal component is polynomially computable. Our proof utilizes the auxiliary unit vector technique that has been recently developed to identify problems that are polynomially solvable. In addition, we use this technique to design an algorithm which, for any sparsity value, computes the sparse principal component with complexity O(ND+1), where N and D are the matrix size and rank, respectively. Our algorithm is fully parallelizable and memory efficient.
Keywords
computational complexity; eigenvalues and eigenfunctions; optimisation; principal component analysis; signal processing; NP-hard; auxiliary unit vector; constant-rank matrix; maximum eigenvalue; optimal submatrix; principal submatrix; sparse principal component; sparsity value; Complexity theory; Indexes; Optimization; Polynomials; Principal component analysis; Sparse matrices; Vectors; Eigenvalues and eigenfunctions; feature extraction; information processing; machine learning algorithms; principal component analysis; signal processing algorithms;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2014.2303975
Filename
6730662
Link To Document