Augmented Lagrangian Alternating Direction Method for Matrix Separation Based on Low-Rank Factorization

Date
2011-01
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

The matrix separation problem aims to separate a low-rank matrix and a sparse matrix from their sum. This problem has recently attracted considerable research attention due to its wide range of potential applications. Nuclear-norm minimization models have been proposed for matrix separation and proved to yield exact separations under suitable conditions. These models, however, typically require the calculation of a full or partial singular value decomposition (SVD) at every iteration that can become increasingly costly as matrix dimensions and rank grow. To improve scalability, in this paper we propose and investigate an alternative approach based on solving a non-convex, low-rank factorization model by an augmented Lagrangian alternating direction method. Numerical studies indicate that the effectiveness of the proposed model is limited to problems where the sparse matrix does not dominate the low-rank one in magnitude, though this limitation can be alleviated by certain data pre-processing techniques. On the other hand, extensive numerical results show that, within its applicability range, the proposed method in general has a much faster solution speed than nuclear-norm minimization algorithms, and often provides better recoverability.

Description
Advisor
Degree
Type
Technical report
Keywords
Citation

Shen, Yuan, Wen, Zaiwen and Zhang, Yin. "Augmented Lagrangian Alternating Direction Method for Matrix Separation Based on Low-Rank Factorization." (2011) https://hdl.handle.net/1911/102177.

Has part(s)
Forms part of
Published Version
Rights
Link to license
Citable link to this page