AmbianceCount: An Objective Social Ambiance Measure from Unconstrained Day-long Audio Recordings

Simple item page
dc.contributor.advisorSabharwal, Ashutosh
dc.creatorChen, Wenwan
dc.date.accessioned2020-12-10T17:33:56Z
dc.date.available2020-12-10T17:33:56Z
dc.date.created2020-12
dc.date.issued2020-12-07
dc.date.submittedDecember 2020
dc.date.updated2020-12-10T17:33:56Z
dc.description.abstractMeasuring social ambiance in unconstrained environments is of significant importance in mental health due to the association between sociability and psychological outcome. However, it has been challenging to quantify social ambiance since existing objective methods fail to capture the transient ambiance patterns in unconstrained environments. In this thesis, I present AmbianceCount, an automatic and objective method that extracts social ambiance from unconstrained audio recordings by estimating the number of concurrent speakers. AmbianceCount consists of a supervised deep neural network (DNN) embedding extractor to differentiate speech mixtures, and a scoring system for estimation and improving generalization. The performance of Am- bianceCount is compared with baseline and evaluated on several synthesized datasets. Lastly, I utilize AmbianceCount to evaluate data from a sociability pilot, with audio data from depression and psychosis patients as well as age-matched healthy controls. Our analysis shows that extracted social ambiance patterns are significantly different across three groups. Besides, it is observed that captured social ambiance patterns are associated with psychometric and personality scores, which is consistent with clinical diagnosis.
dc.format.mimetypeapplication/pdf
dc.identifier.citationChen, Wenwan. "AmbianceCount: An Objective Social Ambiance Measure from Unconstrained Day-long Audio Recordings." (2020) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/109640">https://hdl.handle.net/1911/109640</a>.
dc.identifier.urihttps://hdl.handle.net/1911/109640
dc.language.isoeng
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
dc.subjectAmbiance
dc.subjectSpeech
dc.titleAmbianceCount: An Objective Social Ambiance Measure from Unconstrained Day-long Audio Recordings
dc.typeThesis
dc.type.materialText
thesis.degree.departmentElectrical and Computer Engineering
thesis.degree.disciplineEngineering
thesis.degree.grantorRice University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
CHEN-DOCUMENT-2020.pdf
Size:
8.42 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.84 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.6 KB
Format:
Plain Text
Description:
Download
Collections
Rice University Electronic Theses and Dissertations