skip to main content
10.1145/2968219.2968299acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
extended-abstract

Towards multi-modal anticipatory monitoring of depressive states through the analysis of human-smartphone interaction

Published:12 September 2016Publication History

ABSTRACT

Remarkable advances in smartphone technology, especially in terms of passive sensing, have enabled researchers to passively monitor user behavior in real-time and at a granularity that was not possible just a few years ago. Recently, different approaches have been proposed to investigate the use of different sensing and phone interaction features, including location, call, SMS and overall application usage logs, to infer the depressive state of users. In this paper, we propose an approach for monitoring of depressive states using multi-modal sensing via smartphones. Through a brief literature review we show the sensing modalities that have been exploited in the past studies for monitoring depression. We then present the initial results of an ongoing study to demonstrate the association of depressive states with the smartphone interaction features. Finally, we discuss the challenges in predicting depression through multimodal mobile sensing.

References

  1. Saeed Abdullah, Mark Matthews, Ellen Frank, Gavin Doherty, Geri Gay, and Tanzeem Choudhury. 2016. Automatic Detection of Social Rhythms in Bipolar Disorder. Journal of the American Medical Informatics Association 23, 3 (2016), 538--543.Google ScholarGoogle ScholarCross RefCross Ref
  2. Jorge Alvarez-Lozano, Venet Osmani, Oscar Mayora, Mads Frost, Jakob Bardram, Maria Faurholt-Jepsen, and Lars Vedel Kessing. 2014. Tell me your apps and I will tell you your mood: correlation of apps usage with bipolar disorder state. In PETRA'14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jakob E Bardram, Mads Frost, Károly Szántó, Maria Faurholt-Jepsen, Maj Vinberg, and Lars Vedel Kessing. 2013. Designing Mobile Health Technology for Bipolar Disorder: a Field Trial of the Monarca System. In CHI'13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Luca Canzian and Mirco Musolesi. 2015. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. In UbiComp'15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Tanzeem Choudhury, Sunny Consolvo, Beverly Harrison, Jeffrey Hightower, Anthony LaMarca, Louis LeGrand, Ali Rahimi, Adam Rea, Gaetano Borriello, Bruce Hemingway, Predrag Klasnja, Karl Koscher, James A. Landay, Jonathan Lester, Danny Wyatt, and Dirk Haehnel. 2008. The Mobile Sensing Platform: An Embedded Activity Recognition System. IEEE Pervasive Computing 7, 2 (2008), 32--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sunny Consolvo, David W McDonald, Tammy Toscos, Mike Y Chen, Jon Froehlich, Beverly Harrison, Predrag Klasnja, Anthony LaMarca, Louis LeGrand, Ryan Libby, and others. 2008. Activity Sensing in the Wild: a Field Trial of UbiFit Garden. In CHI'08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. N. Eagle, A. Clauset, and J. Quinn. 2009. Location Segmentation, Inference and Prediction for Anticipatory Computing. In AAAI'09.Google ScholarGoogle Scholar
  8. Agnes Grünerbl, Patricia Oleksy, Gernot Bahle, Christian Haring, Jens Weppner, and Paul Lukowicz. 2012. Towards smart phone based monitoring of bipolar disorder. In mHealthSys'12.Google ScholarGoogle Scholar
  9. Kurt Kroenke, Robert L Spitzer, Janet B. W. Williams, and Bernd Löwe. 2010. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. General hospital psychiatry 32, 4 (2010), 345--359.Google ScholarGoogle Scholar
  10. Kurt Kroenke, Tara W. Strine, Robert L Spitzer, Janet B. W. Williams, Joyce T. Berry, and Ali H. Mokdad. 2009. The PHQ-8 as a measure of current depression in the general population. Journal of Affective Disorders 114, 1 (2009), 163--173.Google ScholarGoogle ScholarCross RefCross Ref
  11. Nicholas D. Lane, Mashfiqui Mohammod, Mu Lin, Xiaochao Yang, Hong Lu, Shahid Ali, Afsaneh Doryab, Ethan Berke, Tanzeem Choudhury, and Andrew Campbell. 2011. Bewell: A Smartphone Application to Monitor, Model and Promote Wellbeing. In PervasiveHealth'11.Google ScholarGoogle Scholar
  12. Robert LiKamWa, Yunxin Liu, Nicholas D Lane, and Lin Zhong. 2013. Moodscope: Building a mood sensor from smartphone usage patterns. In MobiSys'13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hong Lu, Wei Pan, Nicholas D. Lane, Tanzeem Choudhury, and Andrew T. Campbell. 2009. SoundSense: Scalable Sound Sensing for People-centric Applications on Mobile Phones. In MobiSys'09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Abhinav Mehrotra, Mirco Musolesi, Robert Hendley, and Veljko Pejovic. 2015. Designing Content-driven Intelligent Notification Mechanisms for Mobile Applications. In UbiComp'15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My Phone and Me: Understanding User's Receptivity to Mobile Notifications. In CHI'16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Abhinav Mehrotra, Jo Vermeulen, Veljko Pejovic, and Mirco Musolesi. 2015. Ask, But Don't Interrupt: The Case for Interruptibility-Aware Mobile Experience Sampling. In UbiComp'15 Adjunct. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Abhinav Parate, Matthias Böhmer, David Chu, Deepak Ganesan, and Benjamin M. Marlin. 2013. Practical prediction and prefetch for faster access to applications on mobile phones. In UbiComp'13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Veljko Pejovic and Mirco Musolesi. 2014. Anticipatory Mobile Computing for Behaviour Change Interventions. In UbiComp'14 Adjunct. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Veljko Pejovic and Mirco Musolesi. 2015. Anticipatory Mobile Computing: A Survey of the State of the Art and Research Challenges. ACM Computing Surveys 47, 3 (2015), 1--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Martin Pielot, Rodrigo de Oliveira, Haewoon Kwak, and Nuria Oliver. 2014. Didn't you see my message?: predicting attentiveness to mobile instant messages. In CHI'14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jonathan Posner, James A Russell, and Bradley S Peterson. 2005. The Circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 (2005), 715--734.Google ScholarGoogle Scholar
  22. Kiran K. Rachuri, Mirco Musolesi, Cecilia Mascolo, Jason Rentfrow, Chris Longworth, and Andrius Aucinas. 2010. EmotionSense: A Mobile Phones based Adaptive Platform for Experimental Social Psychology Research. In UbiComp'10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Fani Tsapeli and Mirco Musolesi. 2015. Investigating causality in human behavior from smartphone sensor data: a quasi-experimental approach. EPJ Data Science 4, 1 (2015), 1--15.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Towards multi-modal anticipatory monitoring of depressive states through the analysis of human-smartphone interaction

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct
        September 2016
        1807 pages
        ISBN:9781450344623
        DOI:10.1145/2968219

        Copyright © 2016 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 12 September 2016

        Check for updates

        Qualifiers

        • extended-abstract

        Acceptance Rates

        Overall Acceptance Rate764of2,912submissions,26%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader