Joe Tullio
ABSTRACT
In order to develop intelligent systems that attain the trust of their users, it is important to understand how users perceive such systems and develop those perceptions over time. We present an investigation into how users come to understand an intelligent system as they use it in their daily work. During a six-week field study, we interviewed eight office workers regarding the operation of a system that predicted their managers' interruptibility, comparing their mental models to the actual system model. Our results show that by the end of the study, participants were able to discount some of their initial misconceptions about what information the system used for reasoning about interruptibility. However, the overarching structures of their mental models stayed relatively stable over the course of the study. Lastly, we found that participants were able to give lay descriptions attributing simple machine learning concepts to the system despite their lack of technical knowledge. Our findings suggest an appropriate level of feedback for user interfaces of intelligent systems, provide a baseline level of complexity for user understanding, and highlight the challenges of making users aware of sensed inputs for such systems.
- Antifakos, S. Kern, N., Schiele, B., Schwaninger, A., (2005) Towards improving trust in context-aware systems by displaying system confidence. In Proc. MobileHCI 2005, pp. 9--14. Google Scholar
Digital Library
- Bellotti, V. and Edwards, W.K. (2001) Intelligibility and Accountability: Human Considerations in Context-Aware Systems, Human-Computer Interaction, 16(2--4):193--212. Google ScholarDigital Library
- Birnbaum, L., Horvitz, E., Kurlander, D., Lieberman, H., Marks, J., and Roth, S. (1997). Compelling intelligent user interfaces--how much AI? In Proc. of IUI'97, pp. 173--175. Google ScholarDigital Library
- Borgman, C. (1986) The User's Mental Model of an Information Retrieval System. 'Int'l Journal of Man-Machine Studies 24(1):47--64. Google ScholarDigital Library
- Cannon-Bowers, J.E., Salas, E., and Converse, S. (1993) Shared Mental Models in Expert Team Decision-Making," In Individual and Group Decision-Making: Current Issues, J. Castellan, (ed.), Hillsdale, NJ: Erlbaum.Google Scholar
- Chi, M.T.H. (2000). Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In R. Glaser (Ed.), Advances in Instructional Psychology, Hillsdale, NJ: Erlbaum. pp. 161--238.Google Scholar
- Dourish, P. (1995). Accounting for System Behaviour: Representation, Reflection and Resourceful Action. In Proc. of Conference on Computers in Context CIC'95, pp. 145--170. Google ScholarDigital Library
- Dzindolet, M., Peterson, S., Pomranky, S. Pierce, L. and Beck, H. (2003) The role of trust in automation reliance, 'Int'l Journal of Human-Computer Studies, 58(6):697--718. Google ScholarDigital Library
- Fogarty, J., Hudson, S.E., and Lai, J. (2004). Examining the Robustness of Sensor-Based Statistical Models of Human Interruptibility. In Proc. ofallCHI 2004, pp. 207--214. Google ScholarDigital Library
- Fogarty, J. and Hudson, S.E. (2007) Toolkit Support for Developing and Deploying Sensor-Based Statistical Models of Human Situations. To Appear, CHI 2007. Google ScholarDigital Library
- Herlocker , J., Konstan , and J., Riedl, J. (2000) Explaining collaborative filtering recommendations, In Proc. of CSCW 2000, pp.241--250. Google ScholarDigital Library
- Johnson, H. and Johnson, P. (1993) Explanation facilities and interactive systems. In Proc. of IUI'93, pp. 159--166. Google ScholarDigital Library
- Johnson-Laird, P. N. (1983) Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. Cambridge, MA: Harvard Press. Google ScholarDigital Library
- Kempton, W. (1987) Two theories of home heat control. In N. Quinn & D. Holland (Eds.) Cultural Models in Language and Thought, Cambridge University Press.Google ScholarCross Ref
- Kendon, A. and Ferber, A. (1973) A description of some human greetings. In R. Michael and J. Crook (Eds.), Comparative Ecology and Behavior of Primates, pp. 591--668. New York: Academic Press.Google Scholar
- Kohavi, R. and John, G.H. (1997) Wrappers for Feature Subset Selection, Artificial Intelligence 97(1--2):273--324. Google ScholarDigital Library
- Maes, P. (1994) Agents that Reduce Work and Information Overload. Communications of the ACM, 37(7):31--40. Google ScholarDigital Library
- Moray, N. (1987) Intelligent Aids, Mental Models, and the Theory of Machines. 'Int'l Journal of Man-Machine Studies, 27 (5):619--629. Google ScholarDigital Library
- Morgan, M.G., Fischhoff, B., Bostrom, A. and Atman, C.J. (2002) Risk Communication: A Mental Models Approach. Cambridge, UK: Cambridge University Press.Google Scholar
- Muir, B. (1994) Trust in automation Part I: Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37(11):1905--1922.Google ScholarCross Ref
- Muramatsu, J. and Pratt, W. (2001) Transparent Queries: Investigating Users' Mental Models of Search Engines, In Proc. of SIGIR 2001, pp. 217--224. Google ScholarDigital Library
- Norman, D.A. (1983). Some observations on mental models. In D. Gentner & A.Stevens (Eds.) Mental Models, pp. 7--15. Hillsdale, NJ: Erlbaum.Google Scholar
- Suermondt, J. and Cooper, G. (1992) An Evaluation of Explanations of Probabilistic Inference. In Proc. Computer Applications in Medical Care, pp. 579--585.Google Scholar
- Tversky, A. and Kahneman, D. (1974) Judgment under Uncertainty: Heuristics and Biases, Science 185(4157):1124--1131.Google ScholarCross Ref
- Williams, M.D., Hollan, J.D., and Stevens, A.L. (1983) Human Reasoning about a Simple Physical System. In D. Gentner & A. Stevens (Eds.) Mental Models, pp. 131--154. Hillsdale, NJ: Erlbaum.Google Scholar
Index Terms
- How it works: a field study of non-technical users interacting with an intelligent system
Recommendations
Older Adults and Free/Open Source Software: A Diary Study of First-Time Contributors
OpenSym '14: Proceedings of The International Symposium on Open CollaborationThe global population is aging rapidly, and older adults are becoming increasingly technically savvy. This paper explores ways to engage these individuals to contribute to free/open source software (FOSS) projects. We conducted a pilot diary study to ...
Attitudes and Perceptions of Older Chinese People in Hong Kong Towards Silver Gaming
Human Aspects of IT for the Aged Population. Applications in Health, Assistance, and EntertainmentAbstractThis preliminary study aimed to explore the perceptions and attitudes of older Chinese people (over 60 years of age) in Hong Kong towards gaming by adopting a qualitative research method and to investigate the factors that motivate them to ...
Investigating the Roles of Knowledge and Cognitive Abilities in Older Adult Information Seeking on the Web
This study investigated the influences of knowledge, particularly Internet, Web browser, and search engine knowledge, as well as cognitive abilities on older adult information seeking on the Internet. The emphasis on aspects of cognition was informed by ...
Comments