Title :
A note on adaptive Lp regularization
Author :
He, Xiangnan ; Lu, Wenlian ; Chen, Tianping
Author_Institution :
Lab. of Math. for Nonlinear Sci., Fudan Univ., Shanghai, China
Abstract :
In this paper, the adaptive Lp regularization is proposed for parameter estimation and variable selection. In particular, we focus on the (0 <; p <; 1) case when the adaptive Lp regularizer has a nonconvex penalty. Besides some traditional properties for penalized linear regression model, such as unbiasedness and sparsity, we have shown that the adaptive Lp regularization also enjoy the oracle property. A modified iterative algorithm is utilized to solve the adaptive Lp. By comparing with ordinary least square, adaptive lasso and Lp, the numerical results show that the adaptive Lp is more accurate and sparse.
Keywords :
concave programming; iterative methods; parameter estimation; regression analysis; adaptive Lp regularization; iterative algorithm; nonconvex penalty; parameter estimation; penalized linear regression model; variable selection; Adaptation models; Educational institutions; Input variables; Iterative methods; Linear regression; Standards; Vectors;
Conference_Titel :
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location :
Brisbane, QLD
Print_ISBN :
978-1-4673-1488-6
Electronic_ISBN :
2161-4393
DOI :
10.1109/IJCNN.2012.6252583