PuSH - Publikationsserver des Helmholtz Zentrums München

Slawski, M.* ; zu Castell, W. ; Tutz, G.*

Feature selection guided by structural information.

Ann. Appl. Stat. 4, 1056-1080 (2010)
DOI Verlagsversion bestellen
Open Access Green möglich sobald Postprint bei der ZB eingereicht worden ist.
In generalized linear regression problems with an abundant number of features, lasso-type regularization which imposes an `1-constraint on the regression coefficients has become a widely established technique. Crucial deficiencies of the lasso were unmasked when Zhou and Hastie (2005) introduced the elastic net. In this paper, we propose to extend the elastic net by admitting general nonnegative quadratic constraints as second form of regularization. The generalized ridge-type constraint will typically make use of the known association structure of features, e.g. by using temporal- or spatial closeness. We study properties of the resulting ’structured elastic net’ regression estimation procedure, including basic asymptotics and the issue of model selection consistency. In this vein, we provide an analog to the so-called ’irrepresentable condition’ which holds for the lasso. An oracle property is established by incorporating a scaled `1-constraint. Moreover, we outline algorithmic solutions for the structured elastic net within the generalized linear model family. The rationale and the performance of our approach is illustrated by means of simulated and real world data.
Weitere Metriken?
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Schlagwörter Generalized linear model; Regularization; sparsity; p => n; Llasso; Elastic net; Random fields; Consistency; Epiconvergence; Model selection; Signal regression
ISSN (print) / ISBN 1932-6157
e-ISSN 1941-7330
Quellenangaben Band: 4, Heft: 2, Seiten: 1056-1080 Artikelnummer: , Supplement: ,
Verlag Institute of Mathematical Statistics (IMS)
Verlagsort Cleveland, OH
Begutachtungsstatus Peer reviewed