Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Design parameters of rating scales for Web sites
Van Schaik P., Ling J.  ACM Transactions on Computer-Human Interaction 14 (1): 4-es, 2007. Type: Article
Date Reviewed: Jun 28 2007

With the increasing popularity of the Internet, more and more online questionnaires are being conducted. However, little research is being done on their construction, in particular on their design. The authors of this paper have conducted such a study, within the scope of rating scales for Web sites; however, their conclusions are of interest for a broader range of applications.

The authors studied the influence of three design parameters (response format, questionnaire layout, and interaction mechanism) on users’ behavior on rating scales, determined through perceived ease of use, perceived usefulness, disorientation, and flow. In parallel, the concepts of factor structure, reliability, validity, and sensitivity are introduced. However, their relation with perceived ease of use, perceived usefulness, disorientation, and flow remains fuzzy throughout the paper. Moreover, the relation between these concepts and the design parameters is not convincing. Hence, the psychometric properties of the research are questionable.

Through two experiments, the authors found that, first, visual analogue and discrete Likert scales are equally good, and, second, a design that supports direct interaction (with radio buttons) and one item per page is preferred by users over indirect interaction (with drop-down boxes) and all items on one page. This finding was despite the fact that responses were faster with all items on one page.

The research report is preceded by a thorough literature overview, and accompanied by a vast amount of analysis. Regrettably, the result is a 35-page paper, which makes the authors’ important message less accessible.

Reviewer:  Egon L. van den Broek Review #: CR134483 (0806-0604)
Bookmark and Share
  Featured Reviewer  
Human Factors (H.1.2 ... )
Human Information Processing (H.1.2 ... )
Screen Design (H.5.2 ... )
Software Psychology (H.1.2 ... )
Style Guides (H.5.2 ... )
Web-Based Interaction (H.5.3 ... )
Would you recommend this review?
Other reviews under "Human Factors": Date
Widar2.0: passive human tracking with a single Wi-Fi link
Qian K., Wu C., Zhang Y., Zhang G., Yang Z., Liu Y.  MobiSys 2018 (Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, Munich, Germany,  Jun 10-15, 2018) 350-361, 2018. Type: Proceedings
Jun 22 2021
Rehumanized crowdsourcing: a labeling framework addressing bias and ethics in machine learning
Barbosa N., Chen M.  CHI 2019 (Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK,  May 4-9, 2019) 1-12, 2019. Type: Proceedings
Jun 1 2021
Networks and religion: ties that bind, loose, build-up, and tear down
Everton S.,  Cambridge University Press, New York, NY, 2018. 412 pp. Type: Book (978-1-108404-07-5)
Sep 22 2020

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright © 2000-2021 ThinkLoud, Inc.
Terms of Use
| Privacy Policy