- Journal Article
Rights / licenseCreative Commons Attribution 4.0 International
Standard high-dimensional regression methods assume that the underlying coefficient vector is sparse. This might not be true in some cases, in particular in presence of hidden, confounding variables. Such hidden confounding can be represented as a high-dimensional linear model where the sparse coefficient vector is perturbed. For this model, we develop and investigate a class of methods that are based on running the Lasso on preprocessed data. The preprocessing step consists of applying certain spectral transformations that change the singular values of the design matrix. We show that, under some assumptions, one can achieve the usual Lasso ℓ1-error rate for estimating the underlying sparse coefficient vector, despite the presence of confounding. Our theory also covers the Lava estimator (Chernozhukov et al., 2017) for a special model class. The performance of the methodology is illustrated on simulated data and a genomic dataset. Show more
Journal / seriesJournal of Machine Learning Research
Pages / Article No.
PublisherJournal of Machine Learning Research (JMLR)
Subjectconfounding; data transformation; Lasso; latent variables; principal components
Organisational unit03502 - Bühlmann, Peter L. / Bühlmann, Peter L.
03990 - Meinshausen, Nicolai / Meinshausen, Nicolai
786461 - Statistics, Prediction and Causality for Large-Scale Data (EC)
MoreShow all metadata