• DocumentCode
    83587
  • Title

    Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High Dimension

  • Author

    Blazere, Melanie ; Loubes, Jean-Michel ; Gamboa, F.

  • Author_Institution
    Inst. of Math. of Toulouse, Univ. Paul Sabatier, Toulouse, France
  • Volume
    60
  • Issue
    4
  • fYear
    2014
  • fDate
    Apr-14
  • Firstpage
    2303
  • Lastpage
    2318
  • Abstract
    We present a group lasso procedure for generalized linear models (GLMs) and we study the properties of this estimator applied to sparse high-dimensional GLMs. Under general conditions on the covariates and on the joint distribution of the pair covariates, we provide oracle inequalities promoting group sparsity of the covariables. We get convergence rates for the prediction and estimation error and we show the ability of this estimator to recover good sparse approximation of the true model. Then, we extend this procedure to the case of an elastic net penalty. At last, we apply these results to the so-called Poisson regression model (the output is modeled as a Poisson process whose intensity relies on a linear combination of the covariables). The group lasso method enables to select few groups of meaningful variables among the set of inputs.
  • Keywords
    estimation theory; regression analysis; sparse matrices; stochastic processes; Poisson process; Poisson regression model; elastic net penalty; estimation error; generalized linear model; group lasso procedure; group sparsity; high-dimensional GLM; linear covariable combination; oracle inequalities; sparse approximation; Biological system modeling; Covariance matrices; Estimation error; Indexes; Logistics; Predictive models; Generalized linear model; group lasso; groups of variables; high dimension; oracle inequalities; sparse model;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2014.2303121
  • Filename
    6729049