Evaluating Usability Evaluation Methods: Criteria, Method and a Case Study

1. Andre, T.S, Hartson, H.R., Belzand, S.M., McCreary, F.A.: The user action framework: a reliable foundation for usability engineering support tools. Int. J. Human-Computer Studies 54, 107–136 (2001)

   Article  MATH  Google Scholar 

2. Cockton, G., Woolrych, A.: Understanding inspection methods. In: Blandford, A., Vanderdonckt, J., Gray, P.D. (eds.) People and Computer, vol. XV, pp. 171–192. Springer, Heidelberg (2001)

   Google Scholar 

3. Doubleday, A., Ryan, M., Springett, M., Sutcliffe, A.: A comparison of usability techniques for evaluating design. In: Proceedings of Designing interactive systems (1997)

   Google Scholar 

4. Hartson, H.R., Andre, T.S., Williges, R.C.: Criteria for evaluating usability evaluation methods. International Journal of Human-Computer Interaction 15, 145–181 (2003)

   Article  Google Scholar 

5. Hertzum, M., Jacobsen, N.E.: The Evaluator Effect: A Chilling Fact about Usability Evaluation Methods. International Journal of Human-Computer Interaction 13(4), 421–443 (2001)

   Article  Google Scholar 

6. Jacobsen, N.E., Hertzum, M., John, B.E.: The evaluator effect in usability tests. In: Summary Proceedings of the ACM CHI 1998 Conference, pp. 255–256. ACM Press, New York (1998)

   Google Scholar 

7. John, B.E., Marks, S.J.: Tracking the effectiveness of usability evaluation methods. Behaviour and Information Technology, 16(4/5), 188–202 (1997)

   Google Scholar 

8. Law, E.L-C., Hvannberg, E.T.: Analysis of strategies for estimating and improving the effectiveness of heuristic evaluation. In: Proceedings of Nordi CHI 2004, Tampere, Finland (2004)

   Google Scholar 

9. Molich, R., Ede, M.R., Kaasgaard, K., Karyukin, B.: Comparative usability evaluation. Behaviour and Information Technology 23(1), 65–74 (2004)

   Article  Google Scholar 

10. Nielsen, J.: Finding Usability Problems Through Heuristic Evaluation. In: Proceedings of CHI Conference on Human Factors in Computing Systems, pp. 373–380. ACM, New York (1992)

    Google Scholar 

11. Nielsen, J.: Usability Engineering. Academic Press, San Diego (1993)

    MATH  Google Scholar 

12. Nielsen, J.: Usability Inspection Methods. In: CHI 1994, Boston, Massachusetts (1994)

    Google Scholar 

13. Öörni, K.: What do we know about usability evaluation? - A critical view. In: Conference on Users in the Electronic Information Environments, September 8 - 9, 2003 Espoo, Finland (2003)

    Google Scholar 

14. Rosson, M.B., Caroll, J.M.: Usability Engineering: Scenario-Based Development of Human-Computer Interaction. Morgan-Kaufmann, San Francisco (2002)

    Google Scholar 

15. Rubin, J.: Handbook of Usability Testing. John Wiley & Sons, Inc., New York (1994)

    Google Scholar 

16. Sears, A.: Heuristic Walkthroughs: Finding the Problems Without the Noise. International Journal of Human-Computer Interaction 9(3), 213–234 (1997)

    Article  Google Scholar 

17. Van den Haak, M.J., De Jong, M.D.T., Schellens, P.J.: Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interacting with Computers 16, 1153–1170 (2004)

    Article  Google Scholar 

Download references