RobustPPG: camera-based robust heart rate estimation using motion cancellation

dc.citation.firstpage5447en_US
dc.citation.issueNumber10en_US
dc.citation.journalTitleBiomedical Optics Expressen_US
dc.citation.lastpage5467en_US
dc.citation.volumeNumber13en_US
dc.contributor.authorMaity, Akash Kumaren_US
dc.contributor.authorMaity, Akash Kumaren_US
dc.contributor.authorWang, Jianen_US
dc.contributor.authorWang, Jianen_US
dc.contributor.authorWang, Jianen_US
dc.contributor.authorSabharwal, Ashutoshen_US
dc.contributor.authorSabharwal, Ashutoshen_US
dc.contributor.authorNayar, Shree K.en_US
dc.contributor.authorNayar, Shree K.en_US
dc.date.accessioned2022-10-28T17:43:07Zen_US
dc.date.available2022-10-28T17:43:07Zen_US
dc.date.issued2022en_US
dc.description.abstractCamera-based heart rate measurement is becoming an attractive option as a non-contact modality for continuous remote health and engagement monitoring. However, reliable heart rate extraction from camera-based measurement is challenging in realistic scenarios, especially when the subject is moving. In this work, we develop a motion-robust algorithm, labeled RobustPPG, for extracting photoplethysmography signals (PPG) from face video and estimating the heart rate. Our key innovation is to explicitly model and generate motion distortions due to the movements of the person’s face. We use inverse rendering to obtain the 3D shape and albedo of the face and environment lighting from video frames and then render the human face for each frame. The rendered face is similar to the original face but does not contain the heart rate signal; facial movements alone cause pixel intensity variation in the generated video frames. Finally, we use the generated motion distortion to filter the motion-induced measurements. We demonstrate that our approach performs better than the state-of-the-art methods in extracting a clean blood volume signal with over 2 dB signal quality improvement and 30% improvement in RMSE of estimated heart rate in intense motion scenarios.en_US
dc.identifier.citationMaity, Akash Kumar, Maity, Akash Kumar, Wang, Jian, et al.. "RobustPPG: camera-based robust heart rate estimation using motion cancellation." <i>Biomedical Optics Express,</i> 13, no. 10 (2022) Optica Publishing Group: 5447-5467. https://doi.org/10.1364/BOE.465143.en_US
dc.identifier.digitalboe-13-10-5447en_US
dc.identifier.doihttps://doi.org/10.1364/BOE.465143en_US
dc.identifier.urihttps://hdl.handle.net/1911/113770en_US
dc.language.isoengen_US
dc.publisherOptica Publishing Groupen_US
dc.rightsPublished under the terms of the Optica Open Access Publishing Agreementen_US
dc.rights.urihttps://opg.optica.org/library/license_v2.cfm#VOR-OAen_US
dc.titleRobustPPG: camera-based robust heart rate estimation using motion cancellationen_US
dc.typeJournal articleen_US
dc.type.dcmiTexten_US
dc.type.publicationpublisher versionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
boe-13-10-5447.pdf
Size:
39.47 MB
Format:
Adobe Portable Document Format