Michael Quade
Marc Halbrügge
ABSTRACT
Adaptive user interfaces (UI) offer the opportunity to adapt to changes in the context, but this also poses the challenge of evaluating the usability of many different versions of the resulting UI. Consequently, usability evaluations tend to become very complex and time-consuming. We describe an approach that combines model-based usability evaluation with development models of adaptive UIs. In particular, we present how a cognitive user behavior model can be created automatically from UI development models and thus save time and costs when predicting task execution times. With the help of two usability studies, we show that the resulting predictions can be further improved by using information encoded in the UI development models.
- Abrahão, S., Iborra, E., and Vanderdonckt, J. Usability evaluation of user interfaces generated with a model-driven architecture tool. In Maturing Usability, Human-Computer Interaction Series, Springer London (2008), 3--32.Google Scholar
- Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. An integrated theory of the mind. Psychological review 111, 4 (2004), 1036--1060.Google Scholar
- Blumendorf, M., Lehmann, G., and Albayrak, S. Bridging models and systems at runtime to build adaptive user interfaces. In Proceedings of the 2Nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS '10, ACM (New York, NY, USA, 2010), 9--18. Google ScholarDigital Library
- Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., and Vanderdonckt, J. A unifying reference framework for multi-target user interfaces. Interacting with Computers 15, 3 (2003), 289--308.Google ScholarCross Ref
- Card, S. K., Moran, T. P., and Newell, A. The Psychology of Human-Computer Interaction. Erlbaum Associates, Hillsdale, New Jersey, 1983. Google ScholarDigital Library
- Fitts, P. M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381--391.Google ScholarCross Ref
- González-Calleros, J. M., Osterloh, J. P., Feil, R., and Lüdtke, A. Automated ui evaluation based on a cognitive architecture and usixml. Science of Computer Programming Journal In Press (05 2013).Google Scholar
- Gram, C., and Cockton, G., Eds. Design principles for interactive software. Chapman & Hall, Ltd., London, UK, 1997. Google ScholarDigital Library
- Ivory, M. Y., and Hearst, M. A. The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv. 33, 4 (2001), 470--516. Google ScholarDigital Library
- John, B. E., and Jastrzembski, T. S. Exploration of costs and benefits of predictive human performance modeling for design. In Proceedings of the 10th International Conference on Cognitive Modeling, Philadelphia, PA (2010), 115--120.Google Scholar
- John, B. E., and Kieras, D. E. The goms family of user interface analysis techniques: Comparison and contrast. ACM Trans. Comput.-Hum. Interact. 3, 4 (1996), 320--351. Google ScholarDigital Library
- John, B. E., and Salvucci, D. D. Multipurpose prototypes for assessing user interfaces in pervasive computing systems. Pervasive Computing, IEEE 4, 4 (2005), 27--34. Google ScholarDigital Library
- John, B. E., and Suzuki, S. Toward cognitive modeling for predicting usability. In Human-Computer Interaction. New Trends, J. Jacko, Ed., vol. 5610 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2009, 267--276. Google ScholarDigital Library
- Kieras, D. Model-based evaluation. In The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, A. Sears and J. A. Jacko, Eds. Lawrence Erlbaum Assoctiates, Mahwaw, NJ, 2007. Google ScholarDigital Library
- Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., and López-Jaquero, V. Usixml: A language supporting multi-path development of user interfaces. In Engineering Human Computer Interaction and Interactive Systems, R. Bastide, P. Palanque, and J. Roth, Eds., vol. 3425 of Lecture Notes in Computer Science. Springer-Verlag, Berlin, Heidelberg, 2005, 200--220. Google ScholarDigital Library
- Luo, L., and John, B. E. Predicting task execution time on handheld devices using the keystroke-level model. In Extended Abstracts Proceedings of the 2005 Conference on Human Factors in Computing Systems, G. C. van der Veer and C. Gale, Eds., ACM (Portland, OR, 2005), 1605--1608. Google ScholarDigital Library
- Mori, G., Patern'o, F., and Santoro, C. Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Softw. Eng. 30, 8 (2004), 507--520. Google ScholarDigital Library
- Nielsen, J. Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993. Google ScholarDigital Library
- Patern'o, F. Model-based tools for pervasive usability. Interacting with Computers 17, 3 (2005), 291--315.Google Scholar
- Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., and R Core Team. nlme: Linear and Nonlinear Mixed Effects Models, 2013. R package version 3.1--113.Google Scholar
- Polson, P. G., Lewis, C., Rieman, J., and Wharton, C. Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies 36, 5 (1992), 741--773. Google ScholarDigital Library
- Quade, M., Lehmann, G., Engelbrecht, K.-P., Roscher, D., and Albayrak, S. Automated usability evaluation of model-based adaptive user interfaces for users with special and specific needs by simulating user interaction. In User Modeling and Adaptation for Daily Routines, E. Martín, P. A. Haya, and R. M. Carro, Eds., Human-Computer Interaction Series. Springer, London, 2013, 219--247.Google ScholarCross Ref
- Quade, M., Rieger, A., and Albayrak, S. Requirements for applying simulation-based automated usability evaluation to model-based adaptive user interfaces for smart environments. In Distributed, Ambient, and Pervasive Interactions, N. Streitz and C. Stephanidis, Eds., vol. 8028 of Lecture Notes in Computer Science. Springer, Berlin, 2013, 235--244.Google Scholar
- Stewart, T. C., and West, R. L. Testing for equivalence: a methodology for computational cognitive modelling. Journal of Artificial General Intelligence 2, 2 (2010), 69--87.Google ScholarCross Ref
- Wilcox, R. R. Comparing medians: An overview plus new results on dealing with heavy-tailed distributions. The Journal of experimental education 73, 3 (2005), 249--263.Google Scholar
- Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., and Sloetjes, H. ELAN: a professional framework for multimodality research. In Proceedings of LREC, vol. 2006 (2006).Google Scholar
Index Terms
- Predicting task execution times by deriving enhanced cognitive models from user interface development models
Recommendations
Predicting user error for ambient systems by integrating model-based UI development and cognitive modeling
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingWith the move to ubiquitous computing, user interfaces (UI) are no longer bound to specific devices. While this problem can be tackled using the model-based UI development (MBUID) process, the usability of the device-specific interfaces is still an open ...
Task models as basis for requirements engineering and software execution
TAMODIA '04: Proceedings of the 3rd annual conference on Task models and diagramsIn this paper we discuss an approach linking GUI specifications to abstract dialog models. Both specifications are based on task models describing behavioral features. It will be shown how first prototypes of interactive systems, which are generated ...
The Usability of Multimedia Interface Based on User's Mental Models
ICAT '06: Proceedings of the 16th International Conference on Artificial Reality and Telexistence--WorkshopsThe mental model is the root of usabilities of user interfaces. This article, by introducing the methods of Cognitive Psychology and Usabitlity Engineering, makes experiments to explore whether users could encounter difficulties in the mobile phone's ...
Comments