Title :
Iterative orthonormalized partial least squares with sparsity constraints
Author :
Munoz-Romero, Sergio ; Arenas-Garcia, Jeronimo ; Gomez-Verdejo, Vanessa
Author_Institution :
Univ. Carlos III de Madrid, Madrid, Spain
Abstract :
Orthonormalized partial least squares (OPLS) is a popular multivariate analysis method to perform supervised feature extraction. In this paper, we propose a novel scheme to solve Orthonormalized Partial Least Squares (OPLS) that can be easily modified to include additional constraints over the input data projection vectors. This scheme is used to implement an OPLSmethod with sparsity constraints (SOPLS), which allows to obtain more interpretable projection vectors that depend only on a few of the original input variables. The discriminative power of the sparse features extracted by SOPLS is analyzed on a benchmark of classification problems, where the method shows very competitive performance in terms of classification error.
Keywords :
constraint theory; eigenvalues and eigenfunctions; feature extraction; image classification; iterative methods; least mean squares methods; statistical analysis; classification error; classification problem; data projection vector; iterative OPLS method; multivariate analysis method; orthonormalized partial least square; sparsity constraint; supervised feature extraction; Covariance matrices; Eigenvalues and eigenfunctions; Feature extraction; Kernel; Remote sensing; Satellites; Vectors; Partial least squares (PLS); feature extraction; lasso regularization; orthonormalized PLS; sparse solutions;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location :
Vancouver, BC
DOI :
10.1109/ICASSP.2013.6638286