Consistent parameter estimation for LASSO and approximate message passing
Date
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This paper studies the optimal tuning of the regularization parameter in LASSO or the threshold parameters in approximate message passing (AMP). Considering a model in which the design matrix and noise are zero-mean i.i.d. Gaussian, we propose a data-driven approach for estimating the regularization parameter of LASSO and the threshold parameters in AMP. Our estimates are consistent, that is, they converge to their asymptotically optimal values in probability as nn, the number of observations, and pp, the ambient dimension of the sparse vector, grow to infinity, while n/pn/p converges to a fixed number δδ. As a byproduct of our analysis, we will shed light on the asymptotic properties of the solution paths of LASSO and AMP.
Description
Advisor
Degree
Type
Keywords
Citation
Mousavi, Ali, Maleki, Arian and Baraniuk, Richard G.. "Consistent parameter estimation for LASSO and approximate message passing." The Annals of Statistics, 46, no. 1 (2018) Institute of Mathematical Statistics: 119-148. https://doi.org/10.1214/17-AOS1544.