Several methods for improving the job analysis process were examined using the Position Analysis Questionnaire (PAQ). Holistic ratings of PAQ dimensions for four jobs were obtained from 63 non-experts, nine graduate students who were familiar with the PAQ, and three professional job analysts who were very familiar with the PAQ. Holistic ratings were compared to a traditional score profile obtained from professional job analysts. For all groups, holistic ratings of the dimensions were not similar to the traditional score profiles; consequently, rating PAQ dimensions holistically is probably not a viable alternative to reducing the effort required in the job analysis process. Additionally, a comparison of three rating scales in the holistic condition showed that they were moderately correlated. Future research investigating rating scales that yield independent information should be conducted. The potential benefits of a detailed item training session for job analysts are also discussed.