Toward a theory of information processing
dc.citation.bibtexName | article | en_US |
dc.citation.journalTitle | Journal of the Franklin Institute | en_US |
dc.contributor.author | Sinanovic, Sinan | en_US |
dc.contributor.author | Johnson, Don | en_US |
dc.contributor.org | Digital Signal Processing (http://dsp.rice.edu/) | en_US |
dc.date.accessioned | 2007-10-31T01:06:14Z | en_US |
dc.date.available | 2007-10-31T01:06:14Z | en_US |
dc.date.issued | 2004-06-01 | en_US |
dc.date.modified | 2004-06-11 | en_US |
dc.date.submitted | 2002-06-06 | en_US |
dc.description | Journal Paper | en_US |
dc.description.abstract | Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler distance in particular, to quantify how well signals represent information. The ratio of distances calculated between two informationally different signals at a system's output and input quantifies the system's information processing properties. Using this approach, we derive the fundamental processing capabilities of simple system architectures that apply universally: the systems and the kinds of signals they process and produce don't affect our general results. Applications in array signal processing and in neural signal analysis illustrate how to apply the theory. | en_US |
dc.description.sponsorship | National Science Foundation | en_US |
dc.identifier.citation | S. Sinanovic and D. Johnson, "Toward a theory of information processing," <i>Journal of the Franklin Institute,</i> 2004. | en_US |
dc.identifier.doi | http://dx.doi.org/10.1016/j.sigpro.2006.11.005 | en_US |
dc.identifier.uri | https://hdl.handle.net/1911/20376 | en_US |
dc.language.iso | eng | en_US |
dc.subject | Information theory | en_US |
dc.subject | information processing | en_US |
dc.subject | Kullback-Leibler | en_US |
dc.subject.keyword | Information theory | en_US |
dc.subject.keyword | information processing | en_US |
dc.subject.keyword | Kullback-Leibler | en_US |
dc.subject.other | Information Processing | en_US |
dc.title | Toward a theory of information processing | en_US |
dc.type | Journal article | en_US |
dc.type.dcmi | Text | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Sin2002Jun1Towardathe.PDF
- Size:
- 783.88 KB
- Format:
- Adobe Portable Document Format