Browsing by Author "Yang, Minmin"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    A multi-faceted model of the consequences of sample size choice in usability testing
    (2008) Yang, Minmin; Lane, David M.
    A multi-faceted model is developed to demonstrate the consequences of sample size choice in usability testing. This model takes into account the severity levels of user performance, the distribution of severity levels, the impact of usability problems, the benefit of improving user interface components, and the decision-making regarding which usability problems to solve. A large-scale usability test (N=103) of two products (Connexions and Snapfish) was carried out to provide real-world empirical data for the multi-faceted model. Simulations based on both the empirical data and other possible situations in usability testing were done to demonstrate the sample size influence on the estimation of severity, impact, and benefit given various types of parameters. The results showed that there were great risks in using small samples in various situations, especially when the shapes of the distributions of severity levels were positively skewed or bimodal. The results also indicated that user distributions at different severity levels and the impact weights of the usability problems had the most influence whereas the improvement factors and the improvement schemes had little influence on the sample size requirements. In addition, the user distribution data from the empirical study were transformed to dichotomous data. The analysis of the dichotomous data, together with the simulations based on the dichotomous data and the binomial model used frequently by the previous researchers, showed that the assumptions of usability problem independence and homogeneous users for the binomial model were seriously violated in such a way as to greatly overestimate the rate of problem detection.
  • Thumbnail Image
    Item
    Perception of randomness: Bias, learning and transfer
    (2006) Yang, Minmin; Lane, David M.
    People are often biased in their perception of randomness in that they tend to see patterns in random distributions. This is a serious problem because the accurate perception of randomness can be important in decision-making. This research presents three experiments investigating (a) the generality of this bias in randomness perception and (b) the trainability and transfer of the ability to judge randomness. The three experiments replicated the finding that people tend to judge random sequences as systematic. However, no evidence was obtained that the same bias occurs in judging lottery outcomes, thus calling into question the generality of the bias. No evidence was found for reducing people's perception bias with a short period of training. No evidence was found for far transfer though near transfer did occur.