DocumentCode
83587
Title
Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High Dimension
Author
Blazere, Melanie ; Loubes, Jean-Michel ; Gamboa, F.
Author_Institution
Inst. of Math. of Toulouse, Univ. Paul Sabatier, Toulouse, France
Volume
60
Issue
4
fYear
2014
fDate
Apr-14
Firstpage
2303
Lastpage
2318
Abstract
We present a group lasso procedure for generalized linear models (GLMs) and we study the properties of this estimator applied to sparse high-dimensional GLMs. Under general conditions on the covariates and on the joint distribution of the pair covariates, we provide oracle inequalities promoting group sparsity of the covariables. We get convergence rates for the prediction and estimation error and we show the ability of this estimator to recover good sparse approximation of the true model. Then, we extend this procedure to the case of an elastic net penalty. At last, we apply these results to the so-called Poisson regression model (the output is modeled as a Poisson process whose intensity relies on a linear combination of the covariables). The group lasso method enables to select few groups of meaningful variables among the set of inputs.
Keywords
estimation theory; regression analysis; sparse matrices; stochastic processes; Poisson process; Poisson regression model; elastic net penalty; estimation error; generalized linear model; group lasso procedure; group sparsity; high-dimensional GLM; linear covariable combination; oracle inequalities; sparse approximation; Biological system modeling; Covariance matrices; Estimation error; Indexes; Logistics; Predictive models; Generalized linear model; group lasso; groups of variables; high dimension; oracle inequalities; sparse model;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2014.2303121
Filename
6729049
Link To Document