Jennifer Mankoff
Anind K. Dey
Julie Kientz
ABSTRACT
We present a technique for evaluating the usability and effectiveness of ambient displays. Ambient displays are abstract and aesthetic peripheral displays portraying non-critical information on the periphery of a user's attention. Although many innovative displays have been published, little existing work has focused on their evaluation, in part because evaluation of ambient displays is difficult and costly. We adapted a low-cost evaluation technique, heuristic evaluation, for use with ambient displays. With the help of ambient display designers, we defined a modified set of heuristics. We compared the performance of Nielsen's heuristics and our heuristics on two ambient displays. Evaluators using our heuristics found more, severe problems than evaluators using Nielsen's heuristics. Additionally, when using our heuristics, 3-5 evaluators were able to identify 40--60% of known usability issues. This implies that heuristic evaluation is an effective technique for identifying usability issues with ambient displays.
- K. Baker, et al. Empirical development of a heuristic evaluation methodology for shared workspace groupware. In Proc. of CSCW 2002, pp. 96--105. ACM Press, 2002.]] Google Scholar
Digital Library
- C. Chafe and G. Niemeyer. Oxygen flute. Installation by Artists, San Jose Museum of Art, October 13-2001 - June, 2002.]]Google Scholar
- A. Chang, et al. Lumitouch: An emotional communication device. In Proc. of CHI 2001, pp. 313--314. ACM Press, 2001.]] Google ScholarDigital Library
- C. Chewar and D. S. McCrickard. Adapting UEMS for notification systems. Accepted to Ubicomp 2002 Workshop 9, September 2002.]]Google Scholar
- W. D. Gray and M. C. Salzman. Damaged merchandise? A review of experiments that compare usability evaluation methods. Human-Computer Interaction, 13(3):203--261, 1998.]]Google ScholarDigital Library
- L. Hallnäs and J. Redström. Slow technology; designing for reflection. Personal and Ubiquitous Computing, 5(3):201--212, 2001.]] Google ScholarDigital Library
- J. M. Heiner et al. The information percolator: Ambient information display in a decorative object. In Proc. of UIST 1999, pp. 141--148. ACM Press, 1999.]] Google ScholarDigital Library
- H. Ishii, et al. Pinwheels: Visualizing information flow in architectural space. In Proc. of CHI 2001, pp. 111--112. ACM Press, 2001.]] Google ScholarDigital Library
- H. Ishii and B. Ullmer. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. of CHI 1997. ACM Press, 1997.]] Google ScholarDigital Library
- H. Ishii, et al. Ambient displays: Turning architectural space into an interface between people and digital information. In Proc. of CoBuild 1998. Springer-Verlag, 1998.]] Google ScholarDigital Library
- E. H. M. van Dantzich, et al. Scope: Providing awareness of multiple notifications at a glance. In Proc. of AVI 2002. ACM Press, 2002.]]Google Scholar
- B. MacIntyre, et al. Support for multitasking and background awareness using interactive peripheral displays. In Proc. of UIST 2001, pp. 41--50. ACM Press, 2001.]] Google ScholarDigital Library
- E. Mynatt, et al. Designing Audio Aura. In Proc. of CHI 1998. ACM Press, 1998.]] Google ScholarDigital Library
- E. Mynatt, et al. Digital family portraits: Providing peace of mind for extended family members. In Proc. of CHI 2001, pp. 333--340. ACM Press, 2001.]] Google ScholarDigital Library
- J. Nielsen. Ten usability heuristics. http://www.useit.com/papers/heuristic/heuristic_list.html, accessed on August 20, 2002.]]Google Scholar
- J. Nielsen. Noncommand user interfaces. Communications of the ACM, 36(4):83--99, Apr. 1993.]] Google ScholarDigital Library
- J. Nielsen and T. K. Landauer. A mathematical model of the finding of usability problems. In Proc. of ACM INTERCHI 1993, pp. 206--213, 1993.]] Google ScholarDigital Library
- J. Nielsen and R. Molich. Heuristic evaluation of user interfaces. In Proc of CHI 1990, pp. 249--256. ACM Press, 1990.]] Google ScholarDigital Library
- J. Nielsen and the Nielsen Norman Group. Internet: http://www.useit.com/papers/heuristic/, 2002.]]Google Scholar
- D. Tessendorf, et al. An ordering of secondary task display attributes. In Proc. of CHI 2002, pp. 600--601. ACM Press, 2002.]] Google ScholarDigital Library
- K. Vredenburg, et al. A survey of user-centered design practice. In Proc. of CHI 2002, pp. 471--478. ACM Press, 2002.]] Google ScholarDigital Library
- M. Weiser and J. S. Brown. Designing calm technology. Internet: http://www.ubiq.com/weiser/calmtech/calmtech.htm, 1995.]]Google Scholar
- T. White and D. Small. An interactive poetic garden. In Proc. of CHI 1998. ACM Press, 1998.]] Google ScholarDigital Library
- A. Woolrych and G. Cockton. Why and when five test users aren't enough. In Proceedings of IHM-HCI 2001 Conference, volume 2, pp. 105--108, 2001.]]Google Scholar
Index Terms
- Heuristic evaluation of ambient displays
Recommendations
Evaluating an ambient display for the home
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsWe present our experiences with evaluating an ambient display for the home using two different evaluation techniques: the recently proposed 'Heuristic Evaluation of Ambient Displays' and an in situ, 3-week long, Wizard of Oz evaluation. We compare the ...
Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technologyWe develop design principles and an interaction framework for sharable, interactive public ambient displays that support the transition from implicit to explicit interaction with both public and personal information. A prototype system implementation ...
Finding usability problems through heuristic evaluation
CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsUsability specialists were better than non-specialists at performing heuristic evaluation, and “double experts” with specific expertise in the kind of interface being evaluated performed even better. Major usability problems have a higher probability ...
Comments