An alternating direction and projection algorithm for structure-enforced matrix factorization

dc.citation.firstpage333
dc.citation.issueNumber2
dc.citation.journalTitleComputational Optimization and Applications
dc.citation.lastpage362
dc.citation.volumeNumber68
dc.contributor.authorXu, Lijun
dc.contributor.authorYu, Bo
dc.contributor.authorZhang, Yin
dc.date.accessioned2017-11-14T18:08:24Z
dc.date.available2017-11-14T18:08:24Z
dc.date.issued2017
dc.description.abstractStructure-enforced matrix factorization (SeMF) represents a large class of mathematical models appearing in various forms of principal component analysis, sparse coding, dictionary learning and other machine learning techniques useful in many applications including neuroscience and signal processing. In this paper, we present a unified algorithm framework, based on the classic alternating direction method of multipliers (ADMM), for solving a wide range of SeMF problems whose constraint sets permit low-complexity projections. We propose a strategy to adaptively adjust the penalty parameters which is the key to achieving good performance for ADMM. We conduct extensive numerical experiments to compare the proposed algorithm with a number of state-of-the-art special-purpose algorithms on test problems including dictionary learning for sparse representation and sparse nonnegative matrix factorization. Results show that our unified SeMF algorithm can solve different types of factorization problems as reliably and as efficiently as special-purpose algorithms. In particular, our SeMF algorithm provides the ability to explicitly enforce various combinatorial sparsity patterns that, to our knowledge, has not been considered in existing approaches.
dc.identifier.citationXu, Lijun, Yu, Bo and Zhang, Yin. "An alternating direction and projection algorithm for structure-enforced matrix factorization." <i>Computational Optimization and Applications,</i> 68, no. 2 (2017) Springer: 333-362. https://doi.org/10.1007/s10589-017-9913-x.
dc.identifier.digitalrevised_SeMF
dc.identifier.doihttps://doi.org/10.1007/s10589-017-9913-x
dc.identifier.urihttps://hdl.handle.net/1911/98812
dc.language.isoeng
dc.publisherSpringer
dc.rightsThis is an author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by Springer.
dc.subject.keywordMatrix Factorization
dc.subject.keywordAlternating Direction Method
dc.subject.keywordProjection
dc.subject.keywordAdaptive Penalty Parameter
dc.subject.keywordSparse Optimization
dc.subject.keywordDictionary Learning
dc.titleAn alternating direction and projection algorithm for structure-enforced matrix factorization
dc.typeJournal article
dc.type.dcmiText
dc.type.publicationpost-print
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
revised_SeMF.pdf
Size:
790.31 KB
Format:
Adobe Portable Document Format