A convex-nonconvex strategy for grouped variable selection

Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
Project Euclid
Abstract

This paper deals with the grouped variable selection problem. A widely used strategy is to augment the negative log-likelihood function with a sparsity-promoting penalty. Existing methods include the group Lasso, group SCAD, and group MCP. The group Lasso solves a convex optimization problem but suffers from underestimation bias. The group SCAD and group MCP avoid this estimation bias but require solving a nonconvex optimization problem that may be plagued by suboptimal local optima. In this work, we propose an alternative method based on the generalized minimax concave (GMC) penalty, which is a folded concave penalty that maintains the convexity of the objective function. We develop a new method for grouped variable selection in linear regression, the group GMC, that generalizes the strategy of the original GMC estimator. We present a primal-dual algorithm for computing the group GMC estimator and also prove properties of the solution path to guide its numerical computation and tuning parameter selection in practice. We establish error bounds for both the group GMC and original GMC estimators. A rich set of simulation studies and a real data application indicate that the proposed group GMC approach outperforms existing methods in several different aspects under a wide array of scenarios.

Description
Advisor
Degree
Type
Journal article
Keywords
Citation

Liu, X., Molstad, A. J., & Chi, E. C. (2023). A convex-nonconvex strategy for grouped variable selection. Electronic Journal of Statistics, 17(2), 2912–2961. https://doi.org/10.1214/23-EJS2167

Has part(s)
Forms part of
Rights
Except where otherwise noted, this work is licensed under a Creative Commons Attribution (CC BY) license. Permission to reuse, publish, or reproduce the work beyond the terms of the license or beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
Citable link to this page