DocumentCode :
83587
Title :
Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High Dimension
Author :
Blazere, Melanie ; Loubes, Jean-Michel ; Gamboa, F.
Author_Institution :
Inst. of Math. of Toulouse, Univ. Paul Sabatier, Toulouse, France
Volume :
60
Issue :
4
fYear :
2014
fDate :
Apr-14
Firstpage :
2303
Lastpage :
2318
Abstract :
We present a group lasso procedure for generalized linear models (GLMs) and we study the properties of this estimator applied to sparse high-dimensional GLMs. Under general conditions on the covariates and on the joint distribution of the pair covariates, we provide oracle inequalities promoting group sparsity of the covariables. We get convergence rates for the prediction and estimation error and we show the ability of this estimator to recover good sparse approximation of the true model. Then, we extend this procedure to the case of an elastic net penalty. At last, we apply these results to the so-called Poisson regression model (the output is modeled as a Poisson process whose intensity relies on a linear combination of the covariables). The group lasso method enables to select few groups of meaningful variables among the set of inputs.
Keywords :
estimation theory; regression analysis; sparse matrices; stochastic processes; Poisson process; Poisson regression model; elastic net penalty; estimation error; generalized linear model; group lasso procedure; group sparsity; high-dimensional GLM; linear covariable combination; oracle inequalities; sparse approximation; Biological system modeling; Covariance matrices; Estimation error; Indexes; Logistics; Predictive models; Generalized linear model; group lasso; groups of variables; high dimension; oracle inequalities; sparse model;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2014.2303121
Filename :
6729049
Link To Document :
بازگشت