Seeing the Invisible: Next-generation vision systems leveraging polarization and time-of-flight of light
| dc.contributor.advisor | Veeraraghavan, Ashok | en_US |
| dc.creator | Dave, Akshat | en_US |
| dc.date.accessioned | 2023-09-01T19:52:41Z | en_US |
| dc.date.created | 2023-08 | en_US |
| dc.date.issued | 2023-08-11 | en_US |
| dc.date.submitted | August 2023 | en_US |
| dc.date.updated | 2023-09-01T19:52:42Z | en_US |
| dc.description | EMBARGO NOTE: This item is embargoed until 2024-08-01 | en_US |
| dc.description.abstract | The visual world is a complex interplay of light, encompassing a wealth of information beyond what we perceive with the human eye. Conventional cameras, inspired by human vision, are limited to measuring light intensity and color, thereby constraining our ability to capture the visual environment. The intensity and color of a scene are intricate functions of the scene's geometry, material properties, and lighting. Extracting these properties from RGB images alone is ill-posed limiting today's AR/VR and industrial monitoring systems. Moreover, the intensity captured is dominated by direct reflections constraining automotive and robotics systems to line-of-sight and making them susceptible to blind corners. This thesis aims to transcend the limitations of traditional RGB imaging by delving into the underexplored potential of two additional light dimensions: polarization and time-of-flight. By incorporating polarization imaging, valuable insights into an object's surface properties and structural characteristics can be uncovered, enabling a deeper understanding of the visual scene. By leveraging time-of-flight distribution, objects hidden from the line of sight can be revealed, expanding the scope of vision systems. By employing emerging polarization and time-of-flight sensors, this thesis develops practical systems to uncover hidden information and enhance scene understanding. The first part of this thesis focuses on the polarization-based vision. Techniques will be presented that leverage polarization of surface reflections to recover surface geometry and separate reflectance components. These techniques lead to accurate lighting estimation, novel view synthesis, and appearance editing. The second part of this thesis explores techniques utilizing the time-of-flight distribution, also called transients, for imaging objects hidden from line-of-sight. The wide array of applications demonstrated includes real-time change detection from a hidden region of interest at a rapid rate of 10 Hz, high-accuracy 3D imaging of the hidden region at centimeter-scale resolution, detection of specular targets in the concealed scene, and estimation of the material properties of hidden objects. This thesis advocates the development of practical computational imaging systems utilizing emerging polarization and time-of-flight sensors. By harnessing additional dimensions of light, these systems have the potential to uncover hidden information and significantly enhance our understanding of complex visual environments. | en_US |
| dc.embargo.lift | 2024-08-01 | en_US |
| dc.embargo.terms | 2024-08-01 | en_US |
| dc.format.mimetype | application/pdf | en_US |
| dc.identifier.citation | Dave, Akshat. "Seeing the Invisible: Next-generation vision systems leveraging polarization and time-of-flight of light." (2023) Diss., Rice University. https://hdl.handle.net/1911/115242. | en_US |
| dc.identifier.uri | https://hdl.handle.net/1911/115242 | en_US |
| dc.language.iso | eng | en_US |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | en_US |
| dc.subject | computational imaging | en_US |
| dc.subject | polarization | en_US |
| dc.subject | transients | en_US |
| dc.subject | non-line-of-sight imaging | en_US |
| dc.subject | appearance capture | en_US |
| dc.title | Seeing the Invisible: Next-generation vision systems leveraging polarization and time-of-flight of light | en_US |
| dc.type | Thesis | en_US |
| dc.type.material | Text | en_US |
| thesis.degree.department | Electrical and Computer Engineering | en_US |
| thesis.degree.discipline | Engineering | en_US |
| thesis.degree.grantor | Rice University | en_US |
| thesis.degree.level | Doctoral | en_US |
| thesis.degree.name | Doctor of Philosophy | en_US |
Files
Original bundle
1 - 1 of 1