Abstract
Purpose of Review
Ecological momentary assessment (EMA) is a recently introduced approach to patient evaluation that consists of asking patients questions in real time and in their usual habitat. This method seeks to contribute to suicide prevention by providing psychiatrists with detailed information about suicidal thoughts and behavior, how these fluctuate over short periods of time, and the short-term risk factors presented by patients. We conducted a systematic review of published research using EMA to study suicidal thoughts and behavior.
Recent Findings
Several systematic reviews of EMA in mental health have been conducted to date, and the literature contains numerous theoretical papers and compilations on EMA and suicide phenomena. To date, however, no systematic reviews have explored the use of this tool to study suicidal thoughts and behavior.
Summary
We performed a systematic review of five databases (i.e., PubMed, Embase, Scopus, Web of Science, and PsycINFO) to identify studies on EMA and suicidal thoughts and behavior. An initial search revealed 544 articles. Following the study selection process, 35 studies were included in the review. Almost three-quarters of the studies were published in the last 4 years. The studies reviewed concluded that EMA was generally feasible and well accepted. EMA findings correlated well with the results of a retrospective assessment, though tended to over-represent symptom severity. Our review points to important aspects of suicidal thoughts and behavior, such as its wide fluctuation over short periods of time. Negative affect and disturbed sleep, among others, emerged as short-term predictors of suicidal thoughts and behavior. Therefore, EMA is a potentially useful tool in clinical practice, although not without drawbacks, such as participant fatigue with questionnaires and ethical concerns.
Similar content being viewed by others
References
Papers of particular interest, published recently, have been highlighted as: • Of importance
World Health Organization 2020 (2020) WHO | Suicide. In: https://www.who.int/news-room/fact-sheets/detail/suicide. .
Borges G, Nock MK, Haro Abad JM, Hwang I, Sampson NA, Alonso J, et al. Twelve-month prevalence of and risk factors for suicide attempts in the World Health Organization World Mental Health Surveys. J Clin Psychiatr. 2010;71:1617–28.
Liu RT, Bettis AH, Burke TA. Characterizing the phenomenology of passive suicidal ideation: a systematic review and meta-analysis of its prevalence, psychiatric comorbidity, correlates, and comparisons with active suicidal ideation. Psychol Med. 2020;50:367–83.
Bostwick JM, Pabbati C, Geske JR, McKean AJ. Suicide attempt as a risk factor for completed suicide: even more lethal than we knew. Am J Psychiatry. 2016;173:1094–100.
Hubers AAM, Moaddine S, SHM P, Stijnen T, van Duijn E, van der Mast RC, et al. Suicidal ideation and subsequent completed suicide in both psychiatric and non-psychiatric populations: a meta-analysis. Epidemiol Psychiatr Sci. 2018;27:186–98.
Van Spijker BAJ, van Straten A, Kerkhof AJFM, Hoeymans N, Smit F. Disability weights for suicidal thoughts and non-fatal suicide attempts. J Affect Disord. 2011;134:341–7.
Shepard DS, Gurewich D, Lwin AK, Reed GA, Silverman MM. Suicide and suicidal attempts in the United States: costs and policy implications. Suicide Life Threat Behav. 2016;46:352–62.
Kinchin I, Doran CM. The economic cost of suicide and non-fatal suicide behavior in the Australian workforce and the potential impact of a workplace suicide prevention strategy. Int J Environ Res Public Health. 2017;14. https://doi.org/10.3390/ijerph14040347.
WHO | Comprehensive mental health action plan 2013–2020-2030. In: WHO. http://www.who.int/mental_health/action_plan_2013/en/. .
Franklin JC, Ribeiro JD, Fox KR, Bentley KH, Kleiman EM, Huang X, et al. Risk factors for suicidal thoughts and behaviors: a meta-analysis of 50 years of research. Psychol Bull. 2017;143:187–232.
O’Connor RC, Portzky G. Looking to the future: a synthesis of new developments and challenges in suicide research and prevention. Front Psychol. 2018;9:2139.
Schmier JK, Halpern MT. Patient recall and recall bias of health state and health status. Expert Rev Pharmacoecon Outcomes Res. 2004;4:159–63.
Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.
Burke LE, Shiffman S, Music E, Styn MA, Kriska A, Smailagic A, et al. Ecological momentary assessment in behavioral research: addressing technological and human participant challenges. J Med Internet Res. 2017;19:e77.
Eaton LG, Funder DC. Emotional experience in daily life: valence, variability, and rate of change. Emotion. 2001;1:413–21.
Colombo D, Fernández-Álvarez J, Patané A, Semonella M, Kwiatkowska M, García-Palacios A, et al. Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: a systematic review. J Clin Med. 2019;8. https://doi.org/10.3390/jcm8040465.
Yim SJ, Lui LMW, Lee Y, Rosenblat JD, Ragguett RM, Park C, et al. The utility of smartphone-based, ecological momentary assessment for depressive symptoms. J Affect Disord. 2020;274:602–9.
Walz LC, Nauta MH, Aan Het Rot M. Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: a systematic review. J Anxiety Disord. 2014;28:925–37.
Bell IH, Lim MH, Rossell SL, Thomas N. Ecological momentary assessment and intervention in the treatment of psychotic disorders: a systematic review. Psychiatr Serv Wash DC. 2017;68:1172–81.
Mote J, Fulford D. Ecological momentary assessment of everyday social experiences of people with schizophrenia: a systematic review. Schizophr Res. 2020;216:56–68.
Russell MA, Gajos JM. Annual research review: ecological momentary assessment studies in child psychology and psychiatry. J Child Psychol Psychiatry. 2020;61:376–94.
Serre F, Fatseas M, Swendsen J, Auriacombe M. Ecological momentary assessment in the investigation of craving and substance use in daily life: a systematic review. Drug Alcohol Depend. 2015;148:1–20.
Bertz JW, Epstein DH, Preston KL. Combining ecological momentary assessment with objective, ambulatory measures of behavior and physiology in substance-use research. Addict Behav. 2018;83:5–17.
Davidson CL, Anestis MD, Gutierrez PM. Ecological momentary assessment is a neglected methodology in suicidology. Arch Suicide Res. 2017;21:1–11.
Glenn CR, Kleiman EM, Kearns JC, Santee AC, Esposito EC, Conwell Y, et al. Feasibility and acceptability of ecological momentary assessment with high-risk suicidal adolescents following acute psychiatric care. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div. 2020;53:1–17.
Oquendo MA, Galfalvy HC, Choo T-H, Kandlur R, Burke AK, Sublette ME, et al. Highly variable suicidal ideation: a phenotypic marker for stress induced suicide risk. Mol Psychiatry. 2020. https://doi.org/10.1038/s41380-020-0819-0This is an EMA study in suicide research with the longest follow-up period (2 years), although EMA assessment was not continuous (it consisted on 6 non-consecutive weeks over the course of 2 years).
Peters EM, Dong LY, Thomas T, Khalaj S, Balbuena L, Baetz M, et al. Instability of suicidal ideation in patients hospitalized for depression: an exploratory study using smartphone ecological momentary assessment. Arch suicide res off J Int Acad suicide res. 2020:1–14.
Porras-Segovia A, Molina-Madueño RM, Berrouiguet S, et al. Smartphone-based ecological momentary assessment (EMA) in psychiatric patients and student controls: a real-world feasibility study. J Affect Disord. 2020;274:733–41 Among EMA studies in suicide research, this study has the largest sample size (457 participants for active EMA), and the longest continuous EMA assessment period (60 days).
Vine V, Victor SE, Mohr H, Byrd AL, Stepp SD. Adolescent suicide risk and experiences of dissociation in daily life. Psychiatry Res. 2020;287:112870.
Gratch I, Choo T-H, Galfalvy H, Keilp JG, Itzhaky L, Mann JJ, et al. Detecting suicidal thoughts: the power of ecological momentary assessment. Depress Anxiety. 2020. https://doi.org/10.1002/da.23043One of the most recent studies on EMA and suicide, this paper shows that EMA can reveal suicidal ideation in real time that patients do not report retrospectively.
Rodríguez-Blanco L, Carballo JJ, Baca-García E. Use of ecological momentary assessment (EMA) in non-suicidal self-injury (NSSI): a systematic review. Psychiatry Res. 2018;263:212–9.
Spangenberg L, Glaesmer H, Hallensleben N, Rath D, Forkmann T. (In)stability of capability for suicide in psychiatric inpatients: longitudinal assessment using ecological momentary assessments. Suicide Life Threat Behav. 2019;49:1560–72.
Kleiman EM, Nock MK. Real-time assessment of suicidal thoughts and behaviors. Curr Opin Psychol. 2018;22:33–7.
Torous J, Larsen ME, Depp C, Cosco TD, Barnett I, Nock MK, et al. Smartphones, sensors, and machine learning to advance real-time prediction and interventions for suicide prevention: a review of current progress and next steps. Curr Psychiatr Rep. 2018;20:51.
Chaïb LS, Segovia AP, Baca-Garcia E, Lopez-Castroman J. Ecological studies of sleep disturbances during suicidal crises. Curr Psychiatr Rep. 2020;22:34.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.
Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5:210.
Nock MK, Prinstein MJ, Sterba SK. Revealing the form and function of self-injurious thoughts and behaviors: a real-time ecological assessment study among adolescents and young adults. J Abnorm Psychol. 2009;118:816–27.
Czyz EK, King CA, Nahum-Shani I. Ecological assessment of daily suicidal thoughts and attempts among suicidal teens after psychiatric hospitalization: lessons about feasibility and acceptability. Psychiatry Res. 2018a;267:566–74.
Czyz EK, Horwitz AG, Arango A, King CA. Short-term change and prediction of suicidal ideation among adolescents: a daily diary study following psychiatric hospitalization. J Child Psychol Psychiatry. 2018b;60:732–41.
Czyz EK, Glenn CR, Busby D, King CA. Daily patterns in nonsuicidal self-injury and coping among recently hospitalized youth at risk for suicide. Psychiatry Res. 2019;281:112588.
Rizk MM, Choo T-H, Galfalvy H, Biggs E, Brodsky BS, Oquendo MA, et al. Variability in suicidal ideation is associated with affective instability in suicide attempters with borderline personality disorder. Psychiatry. 2019;82:173–8.
Victor SE, Scott LN, Stepp SD, Goldstein TR. I want you to want me: interpersonal stress and affective experiences as within-person predictors of nonsuicidal self-injury and suicide urges in daily life. Suicide Life Threat Behav. 2019;49:1157–77.
Humber N, Emsley R, Pratt D, Tarrier N. Anger as a predictor of psychological distress and self-harm ideation in inmates: a structured self-assessment diary study. Psychiatry Res. 2013;210:166–73.
Ben-Zeev D, Young MA. Accuracy of hospitalized depressed patientsʼ and healthy controlsʼ retrospective symptom reports: an experience sampling study. J Nerv Ment Dis. 2010;198:280–5.
Ben-Zeev D, Young MA, Depp CA. Real-time predictors of suicidal ideation: mobile assessment of hospitalized depressed patients. Psychiatry Res. 2012;197:55–9.
Links PS, Eynan R, Heisel MJ, Barr A, Korzekwa M, McMain S, et al. Affective instability and suicidal ideation and behavior in patients with borderline personality disorder. J Personal Disord. 2007;21:72–86 Published in 2007, this is a study exploring the use EMA to assess suicidal ideation.
Links PS, Eynan R, Heisel MJ, Nisenbaum R. Elements of affective instability associated with suicidal behaviour in patients with borderline personality disorder. Can J Psychiatr. 2008;53:112–6.
Littlewood DL, Kyle SD, Carter L-A, Peters S, Pratt D, Gooding P. Short sleep duration and poor sleep quality predict next-day suicidal ideation: an ecological momentary assessment study. Psychol Med. 2019;49:403–11.
Crowe E, Daly M, Delaney L, Carroll S, Malone KM. The intra-day dynamics of affect, self-esteem, tiredness, and suicidality in major depression. Psychiatry Res. 2019;279:98–108.
Husky M, Olié E, Guillaume S, Genty C, Swendsen J, Courtet P. Feasibility and validity of ecological momentary assessment in the investigation of suicide risk. Psychiatry Res. 2014;220:564–70.
Husky M, Swendsen J, Ionita A, Jaussent I, Genty C, Courtet P. Predictors of daily life suicidal ideation in adults recently discharged after a serious suicide attempt: a pilot study. Psychiatry Res. 2017;256:79–84.
Law MK, Furr RM, Arnold EM, Mneimne M, Jaquett C, Fleeson W. Does assessing suicidality frequently and repeatedly cause harm? A randomized control study. Psychol Assess. 2015;27:1171–81.
Kleiman EM, Coppersmith DDL, Millner AJ, Franz PJ, Fox KR, Nock MK. Are suicidal thoughts reinforcing? A preliminary real-time monitoring study on the potential affect regulation function of suicidal thinking. J Affect Disord. 2018;232:122–6.
Torous J, Staples P, Shanahan M, Lin C, Peck P, Keshavan M, et al. Utilizing a personal smartphone custom app to assess the Patient Health Questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Ment Health. 2015. https://doi.org/10.2196/mental.3889Similar to the findings of Gratch et al. (2020), in this study, it was found that patients tend to score higher in questionnaires assessed through EMA than in traditional retrospective questionnaires.
Ben-Zeev D, Scherer EA, Brian RM, Mistler LA, Campbell AT, Wang R. Use of multimodal technology to identify digital correlates of violence among inpatients with serious mental illness: a pilot study. Psychiatr Serv. 2017;68:1088–92.
Kleiman EM, Turner BJ, Fedor S, Beale EE, Huffman JC, Nock MK. Examination of real-time fluctuations in suicidal ideation and its risk factors: results from two ecological momentary assessment studies. J Abnorm Psychol. 2017;126:726–38.
Kleiman EM, Turner BJ, Fedor S, Beale EE, Picard RW, Huffman JC, et al. Digital phenotyping of suicidal thoughts. Depress Anxiety. 2018;35:601–8.
Coppersmith DDL, Kleiman EM, Glenn CR, Millner AJ, Nock MK. The dynamics of social support among suicide attempters: a smartphone-based daily diary study. Behav Res Ther. 2019;120:103348.
Mou D, Kleiman EM, Fedor S, Beck S, Huffman JC, Nock MK. Negative affect is more strongly associated with suicidal thinking among suicidal patients with borderline personality disorder than those without. J Psychiatr Res. 2018;104:198–201.
Hallensleben N, Spangenberg L, Forkmann T, Rath D, Hegerl U, Kersting A, et al. Investigating the dynamics of suicidal ideation: preliminary findings from a study using ecological momentary assessments in psychiatric inpatients. Crisis. 2018;39:65–9.
Forkmann T, Spangenberg L, Rath D, Hallensleben N, Hegerl U, Kersting A, et al. Assessing suicidality in real time: a psychometric evaluation of self-report items for the assessment of suicidal ideation and its proximal risk factors using ecological momentary assessments. J Abnorm Psychol. 2018;127:758–69.
Hadzic A, Spangenberg L, Hallensleben N, Forkmann T, Rath D, Strauß M, et al. The association of trait impulsivity and suicidal ideation and its fluctuation in the context of the interpersonal theory of suicide. Compr Psychiatry. 2020;98:152158.
Hallensleben N, Glaesmer H, Forkmann T, Rath D, Strauss M, Kersting A, et al. Predicting suicidal ideation by interpersonal variables, hopelessness and depression in real-time. An ecological momentary assessment study in psychiatric inpatients with depression. Eur Psychiatr. 2019;56:43–50.
Rath D, de Beurs D, Hallensleben N, Spangenberg L, Glaesmer H, Forkmann T. Modelling suicide ideation from beep to beep: application of network analysis to ecological momentary assessment data. Internet Interv. 2019;18:100292.
Bishop TM, Maisto SA, Britton PC, Pigeon WR. Considerations in the use of interactive voice recording for the temporal assessment of suicidal ideation and alcohol use: a case series. Crisis. 2016;37:370–6.
Aan het Rot M, Hogenelst K, Schoevers RA. Mood disorders in everyday life: a systematic review of experience sampling and ecological momentary assessment studies. Clin Psychol Rev. 2012;32:510–23.
Laura Silver. Smartphone ownership is growing rapidly around the world, but not always equally. Pew Res. Cent. Glob. Attitudes Proj. 2019. https://www.pewresearch.org/global/2019/02/05/smartphone-ownership-is-growing-rapidly-around-the-world-but-not-always-equally/.
Wiklander M, Samuelsson M, Asberg M. Shame reactions after suicide attempt. Scand J Caring Sci. 2003;17:293–300.
Wilson TD. Know thyself. Perspect Psychol Sci J Assoc Psychol Sci. 2009;4:384–9.
Dunkley C, Borthwick A, Bartlett R, Dunkley L, Palmer S, Gleeson S, et al. Hearing the suicidal patient’s emotional pain. Crisis. 2018;39:267–74.
Nock MK, Park JM, Finn CT, Deliberto TL, Dour HJ, Banaji MR. Measuring the suicidal mind: implicit cognition predicts suicidal behavior. Psychol Sci. 2010;21:511–7.
Tello N, Harika-Germaneau G, Serra W, Jaafari N, Chatard A. Forecasting a fatal decision: direct replication of the predictive validity of the suicide-implicit association test. Psychol Sci. 2020;31:65–74.
Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. Compliance and retention with the experience sampling method over the continuum of severe mental disorders: meta-analysis and recommendations. J Med Internet Res. 2019;21:e14475. https://doi.org/10.2196/14475.
Singer E, Couper MP. Do incentives exert undue influence on survey participation? Experimental evidence. J Empir Res Hum Res Ethics JERHRE. 2008;3:49–56.
Groth SW. Honorarium or coercion: use of incentives for participants in clinical research. J N Y State Nurses Assoc. 2010;41:11–3 quiz 22.
Ashcroft RE. Personal financial incentives in health promotion: where do they fit in an ethic of autonomy? Health Expect Int J Public Particip Health Care Health Policy. 2011;14:191–200.
Asselbergs J, Ruwaard J, Ejdys M, Schrader N, Sijbrandij M, Riper H. Mobile phone-based unobtrusive ecological momentary assessment of day-to-day mood: an explorative study. J Med Internet Res. 2016;18:e72.
Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, et al. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J Med Internet Res. 2015;17:e175. https://doi.org/10.2196/jmir.4273.
Raugh IM, James SH, Gonzalez CM, Chapman HC, Cohen AS, Kirkpatrick B, et al. Geolocation as a digital phenotyping measure of negative symptoms and functional outcome. Schizophr Bull. 2020. https://doi.org/10.1093/schbul/sbaa121.
Torous J, Roberts LW. The ethical use of mobile health technology in clinical psychiatry. J Nerv Ment Dis. 2017;205:4–8.
McKernan LC, Clayton EW, Walsh CG. Protecting life while preserving liberty: ethical recommendations for suicide prevention with artificial intelligence. Front Psychiatr. 2018;9. https://doi.org/10.3389/fpsyt.2018.00650.
Gründahl M, Deckert J, Hein G. Three questions to consider before applying ecological momentary interventions (EMI) in psychiatry. Front Psychiatr. 2020;11:333.
Acknowledgements
The editors would like to thank Dr. Mark Larsen for taking the time to review this manuscript. The authors would like to thank Oliver Shaw, who helped in editing this article.
Availability of Data and Material
Under request.
Code Availability
Not applicable.
Funding
This study received grant support from Instituto de Salud Carlos III (ISCIII PI13/02200; PI16/01852; CM19/00026), the American Foundation for Suicide Prevention (LSRG-1-005-16), the Spanish Ministry of Science, Innovation, and Universities (RTI2018-099655-B-I00; TEC2017-92552-EXP), the regional government of Madrid (Y2018/TCS-4705, PRACTICO-CM, PEJD-2018-PRE/SAL-8417), and the program providing financial support for the hiring of predoctoral and postdoctoral researchers, co-funded by the European Social Fund through the Operational Program on Youth Employment and the Youth Employment Initiative (YEI) (PEJD-2018-PRE/SAL-8417).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Alba Sedano-Capdevila, Alejandro Porras-Segovia, Hugo J. Bello, and María Luisa Barrigón each declare no potential conflicts of interest.
Enrique Baca-García designed the MEmind application, an Ecological Momentary Assessment tool.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Ethics Approval
Not applicable.
Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Mood Disorders
Rights and permissions
About this article
Cite this article
Sedano-Capdevila, A., Porras-Segovia, A., Bello, H.J. et al. Use of Ecological Momentary Assessment to Study Suicidal Thoughts and Behavior: a Systematic Review. Curr Psychiatry Rep 23, 41 (2021). https://doi.org/10.1007/s11920-021-01255-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s11920-021-01255-7