Eric P.S. Baumer
Vera Khovanskaya
ABSTRACT
Designers have demonstrated an increased interest in designing for reflection. However, that work currently occurs under a variety of diverse auspices. To help organize and investigate this literature, this paper present a review of research on systems designed to support reflection. Key findings include that most work in this area does not actually define the concept of reflection. We also find that most evaluations do not focus on reflection per se rather but on some other outcome arguably linked to reflection. Our review also describes the relationship between reflection and persuasion evidenced implicitly by both rhetorical motivations for and implementation details of system design. After discussing the significance of our findings, we conclude with a series of recommendations for improving research on and design for reflection.
- André, P., Schraefel, M.C., Dix, A., and White, R.W. (2011). Expressing well-being online: towards selfreflection and social awareness. Proc iConference, 114121. Google Scholar
Digital Library
- Arias, E., Eden, H., Fischer, G., Gorman, A., and Scharff, E. (2000). Transcending the individual human mind-creating shared understanding through collaborative design. ToCHI, 84--113. Google ScholarDigital Library
- Bannon, L. J. (1991). From Human Factors to Human Actors. In J. Greenbaum & M. Kyng (Eds.), Design at Work, 25--44. Mahwah, NJ: Lawrence Earlbaum Assoc. Google ScholarDigital Library
- Bannon, L. (2006). Forgetting as a feature, not a bug. CoDesign, 2(1), 3--15.Google ScholarCross Ref
- Bardzell, J., & Bardzell, S. (2013). What is "critical" about critical design? Proc CHI, 3297--3306. Google ScholarDigital Library
- Bateman, S., Teevan, J., and White, R.W. (2012). The search dashboard: how reflection and comparison impact search behavior. Proc CHI, 1785--1794. Google ScholarDigital Library
- Bell, G. (2006). No More SMS From Jesus: Ubicomp, Religion and Techno-Spiritual Practices. Proc Ubicomp, 141--158. Google ScholarDigital Library
- Bjork, R. A. (1998). Intentional forgetting in perspective. In J. M. Golding & C. MacLeod (Eds.), Intentional forgetting: Interdisciplinary approaches, 453--481. Hillsdale, NJ: Erlbaum.Google Scholar
- Bohøj, M., Borchorst, N.G., Bødker, S., Korn, M., and Zander, P.-O. (2011). Public deliberation in municipal planning: supporting action and reflection with mobile technology. Proc C&T, 88--97. Google ScholarDigital Library
- Bolter, J., and Gromala, D. (2006). Transparency and Reflectivity: Digital art and the aesthetics of interface Design. In: Fishwick, P. (ed.). Aesthetic Computing. Cambridge, MA: MIT Press.Google Scholar
- Bødker, S. (2006). When second wave HCI meets third wave challenges. Proc NordiCHI, 1--8. Google ScholarDigital Library
- Brade, M., Schneider, F., Salmen, A., and Groh, R. (2013). OntoSketch: Towards Digital Sketching as a Tool for Creating and Extending Ontologies for NonExperts. Proc i-Know, Article 9. Google ScholarCross Ref
- Branham, S.M, Harrison, S.H., and Hirsch, T. (2012). Expanding the design space for intimacy: supporting mutual reflection for local partners. Proc DIS, 220--223. Google ScholarDigital Library
- Brown, A.R. (2010). Visualizing digital media interactions. Proc OZCHI, 196--199. Google ScholarDigital Library
- Bull, S., Mabbott, A., and Abu Issa, A.S. (2007). UMPTEEN: Named and Anonymous Learner Model Access for Instructors and Peers. Int. J. Artif. Intell. Ed., 17(3), 227--253. Google ScholarDigital Library
- Carr, N. and Chambers, D.P. (2006). Cultural and organisational issues facing online learning communities of teachers. Education and Information Technologies, 11(3--4), 269--282. Google ScholarDigital Library
- Chen, Z.-H., Chou, C.-Y., Deng, Y.-C., and Chan, T.-K. (2007). Active Open Learner Models as Animal Companions. Int. J. Artif. Intell. Ed., 17(2), 145--167. Google ScholarDigital Library
- Cheng, J, Bapat, A., Thomas, G., Tse, K., Nawathe, N., Crockett, J., and Leshed, G. (2011). GoSlow: designing for slowness, reflection and solitude. Proc CHI Ext. Abst., 429--438. Google ScholarDigital Library
- Dalsgaard, P, Halskov, K., and Harrison, S. (2012). Supporting reflection in and on design processes. Proc DIS, 803--804. Google ScholarDigital Library
- Dewey, J. (1933). How We Think. A restatement of the relation of reflective thinking to the educative process. Boston: D. C. Heath.Google Scholar
- DiSalvo, C., Sengers, P., & Brynjarsdóttir, H. (2010). Mapping the landscape of sustainable HCI. Proc CHI, 1975--1984. Google ScholarDigital Library
- Fleck R. and Fitzpatrick G. (2009). Teachers' and tutors' social reflection around SenseCam images. Int. J. Hum.Comput. Stud., 67, 1024--1036. Google ScholarDigital Library
- Fleck, R., & Fitzpatrick, G. (2010). Reflecting on Reflection: Framing a Design Landscape. Proc OZCHI, 216--223. Google ScholarDigital Library
- Fogg, B. J. (2003). Persuasive technology. San Francisco: Morgan Kaufmann.Google ScholarCross Ref
- Frost, J. and Smith, B.K. (2003). Visualizing health: imagery in diabetes education. Proc DUX, 1--14. Google ScholarDigital Library
- Gao, F. (2012). Design for reflection on health behavior change. Proc IUI Doct. Cons., 379--382. Google ScholarDigital Library
- Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine De Gruyter.Google Scholar
- Gongora, L. (2011). Exploring the body and mind connection via improvisation in the design process. Proc DESIRE, 427--428. Google ScholarDigital Library
- Gongora, L. (2012). RePlay: a workshop exploring creativity in action. Proc TEI, 355--358. Google ScholarDigital Library
- Govaerts, S., Verbert, K., Duval, E., and Pardo, A. (2012). The student activity meter for awareness and self-reflection. Proc CHI Ext. Abst., 869--884. Google ScholarDigital Library
- Grimes, A., Landry, B.M., and Grinter, R.E. (2010). Characteristics of shared health reflections in a local community. Proc CSCW, 435--444. Google ScholarDigital Library
- Grudin, J. (1990). The Computer Reaches Out: the Historical Continuity of Interface Design. Proc CHI, 261--268. Google ScholarDigital Library
- Hailpern, J., Hinterbichler, E., Leppert, C., Cook, D., and Bailey, B.P. (2007). TEAM STORM: demonstrating an interaction model for working with multiple ideas during creative group work. Proc C&C, 193--202. Google ScholarDigital Library
- Hansen, N.B. and Dalsgaard, P. (2012). The productive role of material design artefacts in participatory design events. Proc NordiCHI, 665--674. Google ScholarDigital Library
- Harrison, S., Sengers, P., & Tatar, D. (2011). Making epistemological trouble: Third-paradigm HCI as successor science. Interacting with Computers, 23(5), 385--392. Google ScholarDigital Library
- Hebert, M.G. (2009). Vehicle #3: heliotropic furniture an autonomous installation. Proc C&C, 465--466. Google ScholarDigital Library
- Hummels, C. and Frens, J. (2009). The reflective transformative design process. Proc CHI Ext. Abst., 2655--2658. Google ScholarDigital Library
- Hutchins, E. (1995). Cognition in the Wild. Cambridge, MA: MIT Press.Google Scholar
- Intille, S., Kukla, C., and Ma, X. (2002). Eliciting user preferences using image-based experience sampling and reflection. Proc CHI Ext. Abst., 738--739. Google ScholarDigital Library
- Intille, S.S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. (2003). A context-aware experience sampling tool. Proc CHI Ext. Abst., 972--973. Google ScholarDigital Library
- Irani, L., Vertesi, J., Dourish, P., Philip, K., & Grinter, R. E. (2010). Postcolonial computing: a lens on design and development. Proc CHI, 1311--1320. Google ScholarDigital Library
- Isaacs, E., Konrad, A., Walendowski, A., Lennig, T, Hollis, V, and Whittaker, S. (2013). Echoes from the past: how technology mediated reflection improves well-being. Proc CHI, 1071--1080. Google ScholarDigital Library
- Johnston, A., Amitani, S., and Edmonds, E. (2005). Amplifying reflective thinking in musical performance. Proc C&C, 166--175. Google ScholarDigital Library
- Jones, J., Hall, S., Gentis, M., Reynolds, C., Gadwal, C., Hurst, A., Ronch, J., and Neylan, C. (2012). Visualizations for self-reflection on mouse pointer performance for older adults. Proc ASSETS, 287--288. Google ScholarDigital Library
- Joslyn, S. L., & Oakes, M. A. (2005). Directed forgetting of autobiographical events. Memory & Cognition, 33(4), 577--587.Google ScholarCross Ref
- Kannabiran, G., Bardzell, J., & Bardzell, S. (2011). How HCI Talks about Sexuality. Proc CHI, 695--704. Google ScholarDigital Library
- Kant, I. (1790). Critique of the Power of Judgment. (P. Guyer, Ed.). Cambridge: Cambridge University Press.Google ScholarCross Ref
- Kharrufa, A., Leat, D., and Olivier, P. (2010). Digital mysteries: designing for learning at the tabletop. Proc ITS, 197--206. Google ScholarDigital Library
- Kriplean, T., Morgan, J., Freelon, D., Borning, A., and Bennett, L. (2012). Supporting reflective public thought with ConsiderIt. Proc CSCW, 265--274. Google ScholarDigital Library
- Lamberty, K.K., Adams, S., Biatek, J., Froiland, K., and Lapham, J. (2011). Using a large display in the periphery to support children learning through design. Proc IDC, 62--71. Google ScholarDigital Library
- Lamberty, K.K. and Kolodner, J.L. (2005). Camera talk: making the camera a partial participant. Proc CHI, 839848. Google ScholarDigital Library
- Lee, M.L. and Dey, A.K. (2011). Reflecting on pills and phone use. Proc CHI, 2095--2104. Google ScholarDigital Library
- Leijen, Í., Lam, I., Wildschut, L., Simons, P.R-J., and Admiraal, W. (2009). Streaming video to enhance students' reflection in dance education. Comput. Educ., 52(1), 169--176. Google ScholarDigital Library
- Leong, T. W., & Brynskov, M. (2009). CO2nfession: Engaging with values through urban conversations. Proc OZCHI (pp. 209--216). Melbourne, Australia. Google ScholarDigital Library
- Li, I., Dey, A.K., & Forlizzi, J. (2010). A Stage-Based Model of Personal Informatics Systems. Proc CHI, 557--566. Google ScholarDigital Library
- Li, I., Dey, A.K., & Forlizzi, J. (2011). Understanding my data, myself: supporting self-reflection with ubicomp technologies. Proc UbiComp, 405--414. Google ScholarDigital Library
- Li, I., Forlizzi, J., and Dey, A.K. (2010). Know thyself: monitoring and reflecting on facets of one's life. Proc CHI Ext. Abst., 4489--4492. Google ScholarDigital Library
- Li, I., Froehlich, J., Larsen, J.E., Grevet, C., and Ramirez, E. (2013). Personal informatics in the wild. Proc CHI Ext. Abst., 3179--3182. Google ScholarDigital Library
- Li, I., Medynskiy, Y., Froehlich, J., and Larsen, J.E. (2012). Personal informatics in practice. Proc CHI Ext. Abst., 2799--2802. Google ScholarDigital Library
- Lindley, S.E., Harper, R., and Sellen, A. (2009). Desiring to be in touch in a changing communications landscape. Proc CHI, 1693--1702. Google ScholarDigital Library
- Loke, L. and Robertson, T. (2009). Design representations of moving bodies for interactive, motion-sensing spaces. Int. J. Hum.-Comput. Stud., 67(4), 394--410. Google ScholarDigital Library
- Malacria, S., Scarr, J., Cockburn, A., Gutwin, C., and Grossman, T. (2013). Skillometers: reflective widgets that motivate and help users to improve performance. Proc UIST, 321--330. Google ScholarDigital Library
- Mamykina, L., Miller, A.D., Mynatt, E.D., and Greenblatt, D. (2010). Constructing identities through storytelling in diabetes management. Proc CHI, 12031212. Google ScholarDigital Library
- Mamykina, L., Mynatt, E.D., Davidson, P.R., and Greenblatt, D. (2008). MAHI: Investigation of Social Scaffolding for Reflective Thinking in Diabetes Management. Proc CHI, 477--486. Google ScholarDigital Library
- Mathur P. and Karahalios, K. (2009). Using bookmark visualizations for self-reflection and navigation. Proc CHI Ext. Abst., 4657--4662. Google ScholarDigital Library
- Mendels, P., Frens, J., and Overbeeke, K. (2011). Freed: a system for creating multiple views of a digital collection during the design process. Proc CHI, 14811490. Google ScholarDigital Library
- Moon, J. (1999). Reflection in Learning & Professional Development. Abingdon, Oxon: RoutledgeFalmer.Google Scholar
- Müller, L. 2013. Pervasive monitoring to support reflective learning. Proc UbiComp Adjunct, 349--354. Google ScholarDigital Library
- Nakakoji, K., Yamamoto, Y., Takada, S., and Reeves, B.N. (2000). Two-dimensional spatial positioning as a means for reflection in design. Proc DIS, 145--154. Google ScholarDigital Library
- Nelson, E.J. and Freier, N.G. (2008). Push-me, pull-me: describing and designing technologies for varying degrees of reflection and invention. Proc IDC, 129--132. Google ScholarDigital Library
- Norman, D. A. (1993). Things That Make Us Smart. New York: Perseus Group.Google ScholarDigital Library
- Pirzadeh, A., He, L., and Stolterman, E. (2013). Personal informatics and reflection: a critical examination of the nature of reflection. Proc CHI Ext. Abst., 1979--1988. Google ScholarDigital Library
- Prilla, M., Degeling, M., and Herrmann, T.. (2012). Collaborative reflection at work. Proc GROUP, 55--64. Google ScholarDigital Library
- Rojas, I. and Ju, W. (2009). Visualization and empowerment. Proc C&C, 401--402. Google ScholarDigital Library
- Sas, C., & Dix, A. (2009). Designing for reflection on experience. Proc CHI Ext. Abst., 4741--4744. Boston, MA. Google ScholarDigital Library
- Schön, D. A. (1983). The Reflective Practitioner: How Professionals Think in Action. New York: Basic Books.Google Scholar
- Santos, J.L, Govaerts, S., Verbert, K., and Duval, E. (2012). Goal-oriented visualizations of activity tracking. Proc LAK, 143--152. Google ScholarDigital Library
- Santos, J.L., Verbert, K., Govaerts, S., and Duval, E. (2013). Addressing learner issues with StepUp!: an evaluation. Proc LAK, 14--22. Google ScholarDigital Library
- Sedig, K, Klawe, M., and Westrom, M.. (2001). Role of interface manipulation style and scaffolding on cognition and concept learning in learnware. ToCHI, 8(1), 34--59. Google ScholarDigital Library
- Seevinck, J., Candy, L., and Edmonds, E.A. (2006). Exploration and reflection in interactive art: glass pond. Proc OZCHI, 143--150. Google ScholarDigital Library
- Sengers, P., Boehner, K., David, S., & Kaye, J. "Jofish." (2005). Reflective Design. Proc Critical Computing, 49--58. Aarhus, Denmark. Google ScholarDigital Library
- Sengers, P., Boehner, K., Mateas, M., & Gay, G. (2007). The disenchantment of affect. Personal and Ubiquitous Computing, 12(5), 347--358. Google ScholarDigital Library
- Sharmin, M. and Bailey, B.P. (2011). "I reflect to improve my design": investigating the role and process of reflection in creative design. Proc C&C, 389--390. Google ScholarDigital Library
- Sharmin, M. and Bailey, B.P. (2013). ReflectionSpace: an interactive visualization tool for supporting reflection-on-action in design. Proc C&C, 83--92. Google ScholarDigital Library
- Shklovski, I., Vertesi, J., Troshynski, E., & Dourish, P. (2009). The Commodification of Location: Dynamics of Power in Location-Based Systems. Proc Ubicomp, 11--20). Orlando, FL. Google ScholarDigital Library
- Smith, B.N., Xu, A., and Bailey, B.P. (2010). Improving interaction models for generating and managing alternative ideas during early design work. Proc GI, 121--128. Google ScholarDigital Library
- Sosik, V. S., Zhao, X., & Cosley, D. (2012). See Friendship, Sort of: How Conversation and Digital Traces Might Support Reflection on Friendships. Proc CSCW, 1145--1154. Bellevue, WA. Google ScholarDigital Library
- Sumison, J. and Fleet, A. (1996). Reflection: Can we assess it? Should we assess it? Assessment and evaluation in higher education, 21, 121--130.Google Scholar
- Taylor, A. S., & Swan, L. (2005). Artful systems in the home. Proc CHI, 641--650. Google ScholarDigital Library
- Tchetagni, J., Nkambou, R., and Bourdeau, J. (2007). Explicit Reflection in Prolog-Tutor. Int. J. Artif. Intell. Ed., (17)2, 169--215. Google ScholarDigital Library
- Thieme, A., Comber, R., Miebach, J., Weeden, J., Kraemer, N., Lawson, S., and Olivier, P. (2012). "We've bin watching you": designing for reflection and social persuasion to promote sustainable lifestyles. Proc CHI, 2337--2346. Google ScholarDigital Library
- Tomico, O., Frens, J.W., and Overbeeke, K.C.J. (2009). Co-reflection: user involvement for highly dynamic design processes. Proc CHI Ext. Abst., 2695--2698. Google ScholarDigital Library
- Tseng, T. and Bryant, C. (2013). Design, reflect, explore: encouraging children's reflections with mechanix. Proc CHI Ext. Abst., 619--624. Google ScholarDigital Library
- Valkanova, N., Jorda, S., Tomitsch, M., and Moere, A.V. (2013). Reveal-it!: the impact of a social visualization projection on public awareness and discourse. Proc CHI, 3461--3470. Google ScholarDigital Library
- van Dijk, J., van der Roest, J., van der Lugt, R., and Overbeeke, K.C.J. 2011. NOOT: a tool for sharing moments of reflection during creative meetings. Proc C&C, 157--164. Google ScholarDigital Library
- Vygotsky, L. S. (1978). Mind and Society. Cambridge, MA: Harvard University Press.Google Scholar
- Wallace, J., Wright, P.C., McCarthy, J., Green, D.P., Thomas, J., and Olivier, P. (2013). A design-led inquiry into personhood in dementia. Proc CHI, 2617--2626. Google ScholarDigital Library
- Webb, A.M., Linder, R., Kerne, A., Lupfer, N., Qu, Y., Poffenberger, B., and Revia, C. (2013). Promoting reflection and interpretation in education: curating rich bookmarks as information composition. Proc C&C, 5362. Google ScholarDigital Library
- Webster, J. D. (1993). Construction and Validation of the Reminiscence Functions Scale. Journals of Gerontology, 48, 256--262.Google ScholarCross Ref
- Wiggins, G. (2006). A preliminary framework for description, analysis and comparison of creative systems. Journal of Knowledge Based Systems, 19(7), 449--458. Google ScholarDigital Library
- Wyche, S. P., Aoki, P. M., & Grinter, R. E. (2008). Re-placing faith: reconsidering the secular-religious use divide in the United States and Kenya. Proc CHI, 11--20. Google ScholarDigital Library
- Yoo, D., Huldtgren, A., Woelfer, J.P., Hendry, D.G., and Friedman, B. (2013). A value sensitive actionreflection model: evolving a co-design space with stakeholder and designer prompts. Proc CHI, 419--428. Google ScholarDigital Library
- Zhao, O.J., Ng, T., and Cosley, D. (2012). No forests without trees: particulars and patterns in visualizing personal communication. Proc iConference, 25--32. Google ScholarDigital Library
Index Terms
- Reviewing reflection: on the use of reflection in interactive system design
Recommendations
Reflective Informatics: Conceptual Dimensions for Designing Technologies of Reflection
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsDespite demonstrated interest in designing for reflection, relatively little work provides a detailed explication of what exactly is meant by reflection or how to design around it. This paper fills that gap by reviewing and engaging with conceptual and ...
Designing for Night-Time Reflection: How to Support Night-Time Reflection Through Non-Digital Means
SIGDOC '21: Proceedings of the 39th ACM International Conference on Design of CommunicationSelf-reflection allows people to communicate with themselves and evaluate their actions and behavior. Engaging in reflection can help professionals improvise in unfamiliar situations by making decisions based on their implicit knowledge and experience [...
Reflecting on reflection: framing a design landscape
OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human InteractionDesigning for reflection is becoming of increasing interest to HCI researchers, especially as digital technologies move to supporting broader professional and quality of life issues. However, the term 'reflection' is being used and designed for in ...
Comments