Toward a theory of information processing

dc.contributor.advisorJohnson, Don H.en_US
dc.creatorSinanovic, Sinanen_US
dc.date.accessioned2009-06-04T08:15:51Zen_US
dc.date.available2009-06-04T08:15:51Zen_US
dc.date.issued2000en_US
dc.description.abstractInformation processing is performed when a system preserves some aspects of the information encoded by its input while it suppresses others. To describe a system's information processing capability, input and output need to be compared in a way invariant to the signal's form and how it represents information. We describe an approach to quantify information processing based on applying controlled changes to the input and observing the corresponding output. Information-theoretic distance measures---those that reflect the data processing theorem---are calculated on the input and output separately and compared. The best candidate for the distance measure to describe signal processing is the information theoretic distance measure called the Kullback-Leibler distance (also known as the relative entropy). Properties of the resulting information transfer ratio are used to derive fundamental information processing properties of systems and interconnected systems.en_US
dc.format.extent35 p.en_US
dc.format.mimetypeapplication/pdfen_US
dc.identifier.callnoTHESIS E.E. 2000 SINANOVICen_US
dc.identifier.citationSinanovic, Sinan. "Toward a theory of information processing." (2000) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/17380">https://hdl.handle.net/1911/17380</a>.en_US
dc.identifier.urihttps://hdl.handle.net/1911/17380en_US
dc.language.isoengen_US
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.en_US
dc.subjectElectronicsen_US
dc.subjectElectrical engineeringen_US
dc.titleToward a theory of information processingen_US
dc.typeThesisen_US
dc.type.materialTexten_US
thesis.degree.departmentElectrical Engineeringen_US
thesis.degree.disciplineEngineeringen_US
thesis.degree.grantorRice Universityen_US
thesis.degree.levelMastersen_US
thesis.degree.nameMaster of Scienceen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
1399307.PDF
Size:
1.17 MB
Format:
Adobe Portable Document Format