Measurements vs. Bits: Compressed Sensing meets Information Theory

Abstract

Compressed sensing is a new framework for acquiring sparse signals based on the revelation that a small number of linear projections (measurements) of the signal contain enough information for its reconstruction. The foundation of Compressed sensing is built on the availability of noise-free measurements. However, measurement noise is unavoidable in analog systems and must be accounted for. We demonstrate that measurement noise is the crucial factor that dictates the number of measurements needed for reconstruction. To establish this result, we evaluate the information contained in the measurements by viewing the measurement system as an information theoretic channel. Combining the capacity of this channel with the rate-distortion function of the sparse signal, we lower bound the rate-distortion performance of a compressed sensing system. Our approach concisely captures the effect of measurement noise on the performance limits of signal reconstruction, thus enabling to benchmark the performance of specific reconstruction algorithms.

Description
Conference Paper
Advisor
Degree
Type
Conference paper
Keywords
Compressed sensing, information theory
Citation

S. Sarvotham, D. Baron and R. G. Baraniuk, "Measurements vs. Bits: Compressed Sensing meets Information Theory," 2006.

Has part(s)
Forms part of
Published Version
Rights
Link to license
Citable link to this page