Denoising-based Approximate Message Passing

Date
2014-12-05
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

A denoising algorithm seeks to remove perturbations or errors from a signal. The last three decades have seen extensive research devoted to this arena, and as a result, today's denoisers are highly optimized algorithms that effectively remove large amounts of additive white Gaussian noise. A compressive sensing (CS) reconstruction algorithm seeks to recover a structured signal acquired using a small number of randomized measurements. Typical CS reconstruction algorithms can be cast as iteratively estimating a signal from a perturbed observation. This thesis answers a natural question: How can one effectively employ a generic denoiser in a CS reconstruction algorithm? In response, in this thesis, I propose a denoising-based approximate message passing (D-AMP) algorithm that is capable of high-performance reconstruction. I demonstrate that, when used with a high performance denoiser, D-AMP offers state-of-the-art CS recovery performance for natural images while operating tens of times faster than the only competitive method. In addition, I explain the exceptional performance of D-AMP by analyzing some of its theoretical features. A critical insight into this approach is the use of an appropriate Onsager correction term in the D-AMP iterations, which coerces the signal perturbation at each iteration to be distributed approximately like the white Gaussian noise that denoisers are typically designed to remove. In doing so, this feature enables the algorithm to effectively use nearly any denoiser.

Description
Degree
Doctor of Philosophy
Type
Thesis
Keywords
Approximate Message Passing, Denoising, Onsager
Citation

Metzler, Chris A. "Denoising-based Approximate Message Passing." (2014) Diss., Rice University. https://hdl.handle.net/1911/87772.

Has part(s)
Forms part of
Published Version
Rights
Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
Link to license
Citable link to this page