Kortum, Philip2023-09-012023-09-012023-082023-08-09August 202Shanklin, Roslyn Ayanna. "Measuring Usability by Watching Others With Directed Attention and Curated Instruction." (2023) Diss., Rice University. https://hdl.handle.net/1911/115245.https://hdl.handle.net/1911/115245Usability assessment is an important part of the product design process that helps ensure people can easily use a product to accomplish their goals. There are several well developed usability assessment methods, but a need exists for remotely testing physical products. Watching Others Using Video (WOUV) is a potential remote testing solution, wherein people watch videos of another person using a product and then rate its usability. However, previous studies have shown that this method yields inflated usability scores compared to in-person testing. The purpose of this dissertation was to increase the accuracy of Watching Others Using Video and assess how it can best be used as a viable usability scoring and comparison tool. To this end, the current research adapted WOUV to increase the viewer’s acquisition of information critical to accurate usability assessment, as important details may be missed through video. The first experiment established a diverse product selection which was used to evaluate the WOUV adaptations. A second experiment evaluated visually directed attention adaptations of WOUV, which highlighted and explained experience information in several product interactions (e.g., success, error recovery, and failure). The third experiment assessed instructional adaptations of WOUV, which showed how to use a product and demonstrated errors with explanation. For both WOUV adaptation experiments, participants watched videos of several products being used and rated them with the System Usability Scale. The results showed comparable usability ratings between WOUV adaptations and in-person testing for several products when adequate information was provided (i.e., showing and describing errors), but significant score inflation for products with low usability. WOUV adaptations did not reliably maintain relative differences between products compared to in-person testing, though rank order comparison was supported. Practical implications and future directions of Watching Others Using Video are discussed.application/pdfengCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.Usabilitysubjective usabilityvideo usabilitywatching othersThesis2023-09-01