Zhen Yue
ABSTRACT
The Experience Sampling Method (ESM) enables researchers to capture information about participants' experiences in the moment. Adding an end-of-day retrospective survey also allows participants to elaborate on those experiences. Although the use of photos in retrospective interviews and surveys for memory elicitation is well known, little research has investigated the use of photos in ESM studies. As smartphone adoption increases facilitating ESM studies and making photo sharing easier, researchers need to continuously evaluate the method and investigate the role of photos in such studies. We conducted a large-scale ESM and retrospective survey study via Android smartphones with more than 1,000 US participants, and analyzed participants' photo submissions, including how photo use correlated with participants' data quality and what, if any, value photos added for researchers. Our study sheds light on the role of photos in ESM and retrospective studies that researchers can reference when constructing future study designs.
- Blumenstock, J.E. Size matters: word count as a measure of quality on wikipedia. Proceeding of the 17th international conference on World Wide Web WWW '08, ACM Press (2008), 1095--1096. Google Scholar
Digital Library
- Carter, S. and Mankoff, J. When participants do the capturing: The Role of Media in Diary Studies. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '05, ACM Press (2005), 899--908. Google ScholarDigital Library
- Collier, J. Photography in anthropology: a report on two experiments. American Anthropologist 59, 5 (1957), 843--859.Google Scholar
- Consolvo, S. and Walker, M. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (2003), 24--31. Google ScholarDigital Library
- Csikszentmihalyi, M., Larson, R., and Prescott, S. The ecology of adolescent activity and experience. Journal of Youth and Adolescence 6, 3 (1977), 281--294.Google ScholarCross Ref
- Fanning, S. Visual Methodologies: PhotoElicitation in the University Classroom. The Proceedings of the 10th European Conference on Research Methodology for Business and Management Studies, (2011).Google Scholar
- Fischer, J.E. and Benford, S. Inferring player engagement in a pervasive experience. Proceedings of the 27th international conference on Human factors in computing systems CHI 09, ACM Press (2009), 1903--1906. Google ScholarDigital Library
- Gabridge, T., Gaskell, M., and Stout, A. Information seeking through students' eyes : The MIT photo diary study. College & Research Libraries 69, 6 (2006), 510--523.Google Scholar
- Grady, J. Working with visual evidence: an invitation and some practical advice. In Picturing the social landscape: visual methods and the sociological imagination. Routledge, London, 2004, 18--32.Google Scholar
- Hargittai, E. and Walejko, G. The Participation Divide: Content creation and sharing in the digital age. Information, Communication & Society 11, 2 (2008), 239--256.Google ScholarCross Ref
- Hargittai, E. Beyond logs and surveys: In-depth measures of people's web use skills. Journal of the American Society for Information Science and Technology 53, 14 (2002), 1239--1244. Google ScholarDigital Library
- Harper, D. Meaning and work: A study in photo elicitation. Current Sociology 34, 3 (1986), 24--46.Google ScholarCross Ref
- Husserl, E. Logical Investigations, volume 1. Routledge, New York, 2001.Google Scholar
- Intille, S., Kukla, C., and Ma, X. Eliciting user preferences using image-based experience sampling and reflection. CHI '02 extended abstracts on Human factors in computing systems CHI '02, ACM Press (2002), 738--739. Google ScholarDigital Library
- Jakobsen, M.R. and Hornbæk, K. Fisheyes in the field: Using Method Triangulation to Study the Adoption and Use of Souce Code Visulization. Proceedings of the 27th international conference on Human factors in computing systems CHI 09, ACM Press (2009), 1579--1588. Google ScholarDigital Library
- James, W. The Principles of Psychology, 2 vols. Henry, New York, 1890.Google Scholar
- Jansen, B.J. and Spink, A. How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Information Processing & Management 42, 1 (2006), 248--263. Google ScholarDigital Library
- Landis, J.R. and Koch, G.G. The measurement of observer agreement for categorical data. biometrics, (1977), 159--174.Google Scholar
- Lee, M.L. and Dey, A.K. Using lifelogging to support recollection for people with episodic memory impairment and their caregivers. Proceedings of the 2nd International Workshop on Systems and Networking Support for Health Care and Assisted Living Environments, (2008), 1--3. Google ScholarDigital Library
- Litt, E. Measuring users' internet skills: A review of past assessments and a look toward the future. New Media & Society 15, 4 (2013), 612--630.Google ScholarCross Ref
- Madden, M. Online photo services. 2005. http://www.pewinternet.org/Commentary/2005/Dec ember/Online-Photo-Services.aspx.Google Scholar
- Meschtscherjakov, A., Reitberger, W., and Tscheligi, M. MAESTRO: Orchestrating User Behavior Driven and Context Triggered Experience Sampling. Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, ACM Press (2010), 1--4. Google ScholarDigital Library
- Miller, A.D. and Edwards, W.K. Give and take: A study of consumer photo-sharing culture and practice. CHI '07, ACM Press (2007), 347--356. Google ScholarDigital Library
- Noland, C.M. Auto-Photography as Research Practice : Identity and Self-Esteem Research. Jounal of Research Practice 2, 1 (2006), 1--19.Google Scholar
- Pew Research Center's Internet & American Life Project. SNS and Facebook survey 2010. Washington D.C., 2010.Google Scholar
- Rainie, L., Brenner, J., and Purcell, K. Photos and videos as social currency online. 2013.Google Scholar
- Russell, D.M. and Oren, M. Retrospective Cued Recall : A method for accurately recalling previous user behaviors. (2009), 1--9. Google ScholarDigital Library
- Scollon, C.N. and Kim-Prieto, C. Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses. Journal of Happiness Studies 4, 1 (2003), 5--34.Google ScholarCross Ref
- Shiffman, S., Stone, A.A., and Hufford, M.R. Ecological Momentary Assessment. Annual Review of Clinical Psychology 4, 1 (2008), 1--32.Google ScholarCross Ref
- Sohn, T., Li, K.A., Griswold, W.G., and Hollan, J.D. A diary study of mobile information needs. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, ACM Press (2008), 433--442. Google ScholarDigital Library
- Stawarczyk, D., Majerus, S., Michalina Maj, M.V. der L., and D'Argembeau, A. Mind-wandering: phenomenology and function as assessed with a novel experience sampling method. Acta Psychologica, (2011), 370--381.Google Scholar
- Stefanone, M.A. and Lackaff, D. Reality television as a model for online behavior: Blogging, photo, and video sharing. Journal of Computer-Mediated Communication 14, 4 (2009), 964--987.Google ScholarCross Ref
- Tagg, J. The Burden of Representation: Essays on Photographies and Histories. The University of Massachusetts Press, Boston, MA, 1988.Google Scholar
- Thelwall, M. Privacy and gender in the social web. In S. Trepte and L. Reinecke, eds., Privacy Online. Springer, Berlin, Heidelberg, 2011, 251--265.Google Scholar
Index Terms
- Photographing information needs: the role of photos in experience sampling method-style research
Recommendations
Gamification of Mobile Experience Sampling Improves Data Quality and Quantity
The Experience Sampling Method is used to capture high-quality in situ data from study participants. This method has become popular in studies involving smartphones, where it is often adapted to motivate participation through the use of gamification ...
A large-scale study of daily information needs captured in situ
The goal of this work is to provide a fundamental understanding of the daily information needs of people through a large-scale, in-depth, quantitative investigation. To this end, we have conducted one of the most comprehensive studies of information ...
MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsCurrent activity tracking technologies are largely trained on younger adults’ data, which can lead to solutions that are not well-suited for older adults. To build activity trackers for older adults, it is crucial to collect training data with them. To ...
Comments