Sandra Servia-Rodríguez
Cecilia Mascolo
ABSTRACT
Measuring mental well-being with mobile sensing has been an increasingly active research topic. Pervasiveness of smartphones combined with the convenience of mobile app distribution platforms (e.g., Google Play) provide a tremendous opportunity to reach out to millions of users. However, the studies at the confluence of mental health and mobile sensing have been longitudinally limited, controlled, or confined to a small number of participants. In this paper we report on what we believe is the largest longitudinal in-the-wild study of mood through smartphones. We describe an Android app to collect participants' self-reported moods and system triggered experience sampling data while passively measuring their physical activity, sociability, and mobility via their device's sensors. We report the results of a large-scale analysis of the data collected for about three years from 18,000 users.
The paper makes three primary contributions. First, we show how we used physical and software sensors in smartphones to automatically and accurately identify routines. Then, we demonstrate the strong correlation between these routines and users' personality, well-being perception, and other psychological variables. Finally, we explore predictability of users' mood using their passive sensing data. Our findings show that, especially for weekends, mobile sensing can be used to predict users' mood with an accuracy of about 70%. These results have the potential to impact the design of future mobile apps for mood/behavior tracking and interventions.
- Australian bureau of statistics (2009). http://www.abs.gov.au/ausstats/[email protected]/mf/4326.0.Google Scholar
- Mappiness. http://www.mappiness.org.uk.Google Scholar
- Mental disorders - who. http://www.who.int/mediacentre/factsheets/fs396/en/.Google Scholar
- Mental health uk. https://www.mentalhealth.org.uk/statistics/mental-health-statistics-uk-and-worldwide.Google Scholar
- Nih - any mental illness (ami) among u.s. adults. http://www.nimh.nih.gov/health/statistics/prevalence/any-mental-illness-ami-among-us-adults.shtml.Google Scholar
- Theano deep learning. http://deeplearning.net/software/theano.Google Scholar
- Aharony, N., Pan, W., Ip, C., Khayal, I., and Pentland, A. Social fmri: Investigating and shaping social mechanisms in the real world. Pervasive Mob. Comput. 7, 6 (2011). Google ScholarDigital Library
- Bemdt, D. J., and Clifford, J. Using dynamic time warping to find patterns in time series, 1994.Google Scholar
- Böhmer, M., Hecht, B., Schöning, J., Krüger, A., and Bauer, G. Falling asleep with angry birds, facebook and kindle: A large scale study on mobile application usage. In MobileHCI '11, ACM (2011).Google ScholarDigital Library
- Canzian, L., and Musolesi, M. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. In UbiComp'15, ACM (2015), 1293--1304. Google ScholarDigital Library
- Carter, S., Mankoff, J., and Heer, J. Momento: Support for situated ubicomp experimentation. In CHI '07, ACM (2007). Google ScholarDigital Library
- Choudhury, T., Borriello, G., Consolvo, S., Haehnel, D., Harrison, B., Hemingway, B., Hightower, J., Klasnja, P. ., Koscher, K., LaMarca, A., Landay, J. A., LeGrand, L., Lester, J., Rahimi, A., Rea, A., and Wyatt, D. The mobile sensing platform: An embedded activity recognition system. IEEE Pervasive Computing (2008). Google ScholarDigital Library
- Choudhury, T., and Pentland, A. Sensing and modeling human networks using the sociometer. In Proceedings of the 7th IEEE International Symposium on Wearable Computers, ISWC '03, IEEE Computer Society (2003). Google ScholarDigital Library
- Consolvo, S., McDonald, D. W., Toscos, T., Chen, M. Y., Froehlich, J., Harrison, B., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., Smith, I., and Landay, J. A. Activity sensing in the wild: A field trial of ubifit garden. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '08, ACM (New York, NY, USA, 2008), 1797--1806. Google ScholarDigital Library
- Csikszentmihalyi, M., and Larson, R. Flow and the Foundations of Positive Psychology: The Collected Works of Mihaly Csikszentmihalyi. Springer Netherlands, Dordrecht, 2014, ch. Validity and Reliability of the Experience-Sampling Method.Google ScholarCross Ref
- Diener, E., and Seligman, M. E. Beyond money: Toward an economy of well-being. Psychological Science in the Public Interest 5, 1 (2004), 1--31.Google ScholarCross Ref
- Do, T. M. T., Blom, J., and Gatica-Perez, D. Smartphone usage in the wild: A large-scale analysis of applications and context.Google Scholar
- Ferreira, D., Kostakos, V., and Dey, A. Aware: mobile context instrumentation framework. Frontiers in ICT 2 (2015).Google Scholar
- Foley, D., Ancoli-Israel, S., Britz, P., and Walsh, J. Sleep disturbances and chronic disease in older adults: Results of the 2003 national sleep foundation sleep in america survey. Journal of Psychosomatic Research 56, 5 (2004), 497--502.Google ScholarCross Ref
- Fox, K. R. The influence of physical activity on mental well-being. Public Health Nutrition 2 (3 1999), 411--418.Google ScholarCross Ref
- Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., and Landay, J. A. Myexperience: A system for in situ tracing and capturing of user feedback on mobile phones. In MobiSys '07, ACM (2007). Google ScholarDigital Library
- Girardello, A., and Michahelles, F. Appaware: Which mobile applications are hot? In MobileHCI '10, ACM (2010). Google ScholarDigital Library
- Goldberg, L. R. The development of markers for the big-five factor structure. Psychological Assessment (1992).Google Scholar
- Hernandez, J., Hoque, M. E., Drevo, W., and Picard, R. W. Mood meter: Counting smiles in the wild. In UbiComp '12, ACM (2012). Google ScholarDigital Library
- Hinton, G. A practical guide to training restricted boltzmann machines. Momentum 9, 1 (2010), 926.Google Scholar
- Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. A context-aware experience sampling tool. In CHI '03 Extended Abstracts on Human Factors in Computing Systems, ACM (2003). Google ScholarDigital Library
- Isaacman, S., Becker, R., Cáceres, R., Kobourov, S., Martonosi, M., Rowland, J., and Varshavsky, A. Identifying important places in people's lives from cellular network data. In Pervasive'11 (2011). Google ScholarDigital Library
- Kruskal, W. H., and Wallis, W. A. Use of ranks in one-criterion variance analysis. Journal of the American statistical Association 47, 260 (1952), 583--621.Google Scholar
- Lamminmaki, E., Parkka, J., Hermersdorf, M., Kaasinen, J., Samposalo, K., Vainio, J., Kolari, J., Kulju, M., Lappalainen, R., and Korhonen, I. Wellness diary for mobile phones. In In Proc. EMBEC '05. (2005).Google Scholar
- Lane, N. D., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., and Campbell, A. T. Bewell: A smartphone application to monitor, model and promote wellbeing. In Pervasive Computing Technologies for Healthcare (2011).Google ScholarCross Ref
- Lane, N. D., Xu, Y., Lu, H., Hu, S., Choudhury, T., Campbell, A. T., and Zhao, F. Enabling large-scale human activity inference on smartphones using community similarity networks (csn). In UbiComp'11, ACM (2011), 355--364. Google ScholarDigital Library
- Lathia, N., Rachuri, K., Mascolo, C., and Roussos, G. Open source smartphone libraries for computational social science. In UbiComp '13 Adjunct, ACM (2013). Google ScholarDigital Library
- Lathia, N., Sandstrom, G. M., Mascolo, C., and Rentfrow, P. J. Happier people live more active lives: Using smartphones to link happiness and physical activity. PLoS ONE (2017).Google Scholar
- LiKamWa, R., Liu, Y., Lane, N. D., and Zhong, L. Moodscope: Building a mood sensor from smartphone usage patterns. In MobiSys '13, ACM (2013). Google ScholarDigital Library
- Liu, P., Tov, W., Kosinski, M., Stillwell, D. J., and Qiu, L. Do facebook status updates reflect subjective well-being? Cyberpsychology, Behavior, and Social Networking (2015).Google Scholar
- Lu, H., Frauendorfer, D., Rabbi, M., Mast, M. S., Chittaranjan, G. T., Campbell, A. T., Gatica-Perez, D., and Choudhury, T. Stresssense: Detecting stress in unconstrained acoustic environments using smartphones. In UbiComp '12, ACM (2012). Google ScholarDigital Library
- Mehl, M. R., Pennebaker, J. W., Crow, D. M., Dabbs, J., and Price, J. H. The electronically activated recorder (ear): A device for sampling naturalistic daily activities and conversations. Behavior Research Methods, Instruments, & Computers 33, 4 (2001), 517--523.Google Scholar
- Miller Jr, R. G. Beyond ANOVA: basics of applied statistics. CRC Press, 1997.Google ScholarCross Ref
- Nair, V., and Hinton, G. E. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10) (2010), 807--814.Google ScholarDigital Library
- Napa Scollon, C., Prieto, C.-K., and Diener, E. Assessing Well-Being: The Collected Works of Ed Diener. Springer Netherlands, Dordrecht, 2009, ch. Experience Sampling: Promises and Pitfalls, Strength and Weaknesses, 157--180.Google Scholar
- Noulas, A., Scellato, S., Mascolo, C., and Pontil, M. An empirical study of geographic user activity patterns in foursquare. In Proc. of the 5th Int'l AAAI Conference on Weblogs and Social Media (2011).Google Scholar
- Oliver, E. A., and Keshav, S. An empirical approach to smartphone energy level prediction. In UbiComp '11, ACM (2011). Google ScholarDigital Library
- Parate, A., Chiu, M.-C., Chadowitz, C., Ganesan, D., and Kalogerakis, E. Risq: Recognizing smoking gestures with inertial sensors on a wristband. In MobiSys '14, ACM (2014). Google ScholarDigital Library
- Penedo, F. J., and Dahn, J. R. Exercise and well-being: a review of mental and physical health benefits associated with physical activity. Current Opinion in Psychiatry 18, 2 (2005), 189--193.Google ScholarCross Ref
- Rachuri, K. K., Musolesi, M., Mascolo, C., Rentfrow, P. J., Longworth, C., and Aucinas, A. Emotionsense: a mobile phones based adaptive platform for experimental social psychology research. In UbiComp '10, ACM (2010). Google ScholarDigital Library
- Ravi, N., Dandekar, N., Mysore, P., and Littman, M. L. Activity recognition from accelerometer data. In IAAI'05 (2005). Google ScholarDigital Library
- Russell, J. A., Weiss, A., and Mendelsohn, G. A. Affect grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology (1989).Google Scholar
- Sandstrom, G. M., Lathia, N., Mascolo, C., and Rentfrow, P. J. Putting mood in context: Using smartphones to examine how people feel in different locations. Journal of Research in Personality (2016).Google Scholar
- Wagner, D. T., Rice, A., and Beresford, A. R. Mobile and Ubiquitous Systems: Computing, Networking, and Services. Springer International Publishing, 2014, ch. Device Analyzer: Understanding Smartphone Usage.Google Scholar
- Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., and Campbell, A. T. Studentlife: Assessing mental health, academic performance and behavioral trends of college students using smartphones. In UbiComp '14, ACM (2014). Google ScholarDigital Library
Index Terms
- Mobile Sensing at the Service of Mental Well-being: a Large-scale Longitudinal Study
Recommendations
Remember to smile: design of a mobile affective technology to help promote individual happiness through smiling
PervasiveHealth '17: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for HealthcareWellbeing plays a central role in quality of life and encompasses aspects pertaining to mental and social wellbeing, as well as physical wellbeing and the absence of disease. Building upon the natural human understanding that smiling is an expression of ...
Mobile Sensing and Engagement Features in Arabic Mental Well-Being Apps: Systematic Search and Analysis
UbiComp/ISWC '23 Adjunct: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable ComputingVarious mobile apps have been released to track and promote mental health and well-being. Despite the high interest in developing these apps, they suffer from high attrition rates. These apps have limited utility if they are delivered in a manner that ...
A school survey on use and knowledge of apps and websites for promoting mental wellbeing
HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction ConferenceMental wellbeing is the combination of feeling good and functioning well. Digital technology widens the opportunities for promoting mental wellbeing, particularly among those young people for whom technology is an ordinary part of life. This paper ...
Comments