EDoF-ToF: extended depth of field time-of-flight imaging

Simple item page
dc.citation.firstpage38540
dc.citation.issueNumber23
dc.citation.journalTitleOptics Express
dc.citation.lastpage38556
dc.citation.volumeNumber29
dc.contributor.authorTan, Jasper
dc.contributor.authorBoominathan, Vivek
dc.contributor.authorBaraniuk, Richard
dc.contributor.authorVeeraraghavan, Ashok
dc.date.accessioned2021-12-02T15:09:26Z
dc.date.available2021-12-02T15:09:26Z
dc.date.issued2021
dc.description.abstractConventional continuous-wave amplitude-modulated time-of-flight (CWAM ToF) cameras suffer from a fundamental trade-off between light throughput and depth of field (DoF): a larger lens aperture allows more light collection but suffers from significantly lower DoF. However, both high light throughput, which increases signal-to-noise ratio, and a wide DoF, which enlarges the system’s applicable depth range, are valuable for CWAM ToF applications. In this work, we propose EDoF-ToF, an algorithmic method to extend the DoF of large-aperture CWAM ToF cameras by using a neural network to deblur objects outside of the lens’s narrow focal region and thus produce an all-in-focus measurement. A key component of our work is the proposed large-aperture ToF training data simulator, which models the depth-dependent blurs and partial occlusions caused by such apertures. Contrary to conventional image deblurring where the blur model is typically linear, ToF depth maps are nonlinear functions of scene intensities, resulting in a nonlinear blur model that we also derive for our simulator. Unlike extended DoF for conventional photography where depth information needs to be encoded (or made depth-invariant) using additional hardware (phase masks, focal sweeping, etc.), ToF sensor measurements naturally encode depth information, allowing a completely software solution to extended DoF. We experimentally demonstrate EDoF-ToF increasing the DoF of a conventional ToF system by 3.6 ×, effectively achieving the DoF of a smaller lens aperture that allows 22.1 × less light. Ultimately, EDoF-ToF enables CWAM ToF cameras to enjoy the benefits of both high light throughput and a wide DoF.
dc.identifier.citationTan, Jasper, Boominathan, Vivek, Baraniuk, Richard, et al.. "EDoF-ToF: extended depth of field time-of-flight imaging." <i>Optics Express,</i> 29, no. 23 (2021) Optical Society of America: 38540-38556. https://doi.org/10.1364/OE.441515.
dc.identifier.digitaloe-29-23-38540
dc.identifier.doihttps://doi.org/10.1364/OE.441515
dc.identifier.urihttps://hdl.handle.net/1911/111728
dc.language.isoeng
dc.publisherOptical Society of America
dc.rightsPublished under the terms of the under the terms of the OSA Open Access Publishing Agreement
dc.rights.urihttps://www.osapublishing.org/library/license_v1.cfm#VOR-OA
dc.titleEDoF-ToF: extended depth of field time-of-flight imaging
dc.typeJournal article
dc.type.dcmiText
dc.type.publicationpublisher version
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
oe-29-23-38540.pdf
Size:
10.99 MB
Format:
Adobe Portable Document Format
Download
Collections
Faculty Publications
ECE Publications