An alternating direction and projection algorithm for structure-enforced matrix factorization

dc.citation.firstpage333en_US
dc.citation.issueNumber2en_US
dc.citation.journalTitleComputational Optimization and Applicationsen_US
dc.citation.lastpage362en_US
dc.citation.volumeNumber68en_US
dc.contributor.authorXu, Lijunen_US
dc.contributor.authorYu, Boen_US
dc.contributor.authorZhang, Yinen_US
dc.date.accessioned2017-11-14T18:08:24Zen_US
dc.date.available2017-11-14T18:08:24Zen_US
dc.date.issued2017en_US
dc.description.abstractStructure-enforced matrix factorization (SeMF) represents a large class of mathematical models appearing in various forms of principal component analysis, sparse coding, dictionary learning and other machine learning techniques useful in many applications including neuroscience and signal processing. In this paper, we present a unified algorithm framework, based on the classic alternating direction method of multipliers (ADMM), for solving a wide range of SeMF problems whose constraint sets permit low-complexity projections. We propose a strategy to adaptively adjust the penalty parameters which is the key to achieving good performance for ADMM. We conduct extensive numerical experiments to compare the proposed algorithm with a number of state-of-the-art special-purpose algorithms on test problems including dictionary learning for sparse representation and sparse nonnegative matrix factorization. Results show that our unified SeMF algorithm can solve different types of factorization problems as reliably and as efficiently as special-purpose algorithms. In particular, our SeMF algorithm provides the ability to explicitly enforce various combinatorial sparsity patterns that, to our knowledge, has not been considered in existing approaches.en_US
dc.identifier.citationXu, Lijun, Yu, Bo and Zhang, Yin. "An alternating direction and projection algorithm for structure-enforced matrix factorization." <i>Computational Optimization and Applications,</i> 68, no. 2 (2017) Springer: 333-362. https://doi.org/10.1007/s10589-017-9913-x.en_US
dc.identifier.digitalrevised_SeMFen_US
dc.identifier.doihttps://doi.org/10.1007/s10589-017-9913-xen_US
dc.identifier.urihttps://hdl.handle.net/1911/98812en_US
dc.language.isoengen_US
dc.publisherSpringeren_US
dc.rightsThis is an author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by Springer.en_US
dc.subject.keywordMatrix Factorizationen_US
dc.subject.keywordAlternating Direction Methoden_US
dc.subject.keywordProjectionen_US
dc.subject.keywordAdaptive Penalty Parameteren_US
dc.subject.keywordSparse Optimizationen_US
dc.subject.keywordDictionary Learningen_US
dc.titleAn alternating direction and projection algorithm for structure-enforced matrix factorizationen_US
dc.typeJournal articleen_US
dc.type.dcmiTexten_US
dc.type.publicationpost-printen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
revised_SeMF.pdf
Size:
790.31 KB
Format:
Adobe Portable Document Format