Validity of the Adult ADHD Self-Report Scale (ASRS) as a screener for adult ADHD in treatment seeking substance use disorder patients
Introduction
Substance use disorders (SUDs) account for a substantial proportion of the global public health burden (World Health Organisation, 2010) and are associated with adverse outcomes. Compared to those without SUD, individuals with SUD have poorer physical and psychological health, greater financial problems, increased violent behavior, higher rates of criminality and incarceration, and a greater risk of mortality (Darke et al., 2007). The course and treatment of SUD is complicated by the high comorbidity with other psychiatric disorders (Teesson and Proudfoot, 2003, Mills et al., 2010, Grant et al., 2005).
Attention deficit hyperactivity disorder (ADHD) is consistently over-represented in epidemiological and clinical samples of SUD populations. General population surveys indicate an average prevalence of 3–4% adult ADHD (Kessler et al., 2006, Fayyad et al., 2007, Faraone and Biederman, 2005) with a pooled estimated prevalence of 2.5% (Simon et al., 2009), whereas in clinical samples of treatment seeking adult SUD patients, the prevalence of adult ADHD is substantially higher, ranging from 10% to 46% (Van Emmerik-van Oortmerssen et al., 2012, Levin et al., 1998, Clure et al., 1999, King et al., 1999, Schubiner et al., 2007, Wilens, 2004, Yewers et al., 2005, Matsumoto et al., 2005). This wide range of prevalence rates is probably related to a combination of factors, including the use of different diagnostic criteria, the use of different instruments and assessors, and the study of different populations (Van Emmerik-van Oortmerssen et al., 2012). The diagnosis of adult ADHD is rather time consuming and even if the prevalence of ADHD is as high as 46%, screening can be cost-effective to identify those who are likely the have ADHD.
However, screening for adult ADHD is not routine practice in drug and alcohol treatment services (McAweeny et al., 2010). This is unfortunate, because SUD patients with a comorbid diagnosis of adult ADHD have poorer treatment outcome and higher risk of relapse than SUD patients without ADHD (McAweeny et al., 2010, Upadhyaya, 2007, Wilens and Upadhyaya, 2007). In addition, patients with co-occurring ADHD and SUD have higher rates of other psychiatric disorders (Wilens et al., 2005), which may further jeopardize successful outcomes. Identification and treatment of ADHD in treatment seeking SUD patients may improve overall treatment outcome and thus a valid screening instrument that enhances the identification of this patient population is a critical first step.
Several instruments are available for the screening of adult ADHD. For this study the shortest available instrument was chosen, the 6-item version of the World Health Organization Adult ADHD Self-Report Scale V 1.1 (ASRS) symptom checklist. This version was developed to have optimal concordance with the clinical classification. In a population survey, the ASRS had moderate sensitivity of 68.7% and high specificity of 99.5% (Kessler et al., 2005). In addition, the ASRS has demonstrated high internal consistency (Adler et al., 2006) and good test-retest reliability (Matza et al., 2011).
However, the psychometric properties and utility of this instrument have not been adequately tested in treatment seeking SUD patients. Existing studies in substance abusers are small and often provide only some and not all of the reliability and validity indicators of the ASRS. Given the limited data so far (Daigre Blanco et al., 2009, Dakwar et al., 2012, Pérez Pedrero and Puerta García, 2007, Adler et al., 2009, Chiasson et al., 2012), there is a need for more validation data on the ASRS using a large and heterogeneous sample of SUD patients.
In order to assess the validity of a screening instrument for ADHD, it needs to be compared to a “gold standard” for the diagnosis of ADHD. While the gold standard can be a diagnosis obtained by expert consensus (West et al., 2003), this is unwieldy, particularly for larger studies. The preferred method is to use a reliable and valid structured interview that can be applied across various types of treatment settings (Wittchen et al., 1991, Kessler et al., 2005). To date, there is only limited data establishing the psychometric characteristics of ADHD screening instruments using structured clinical interviews for assessing ADHD in substance-abusing adults. Two studies have used the Conners’ ADHD Adult Diagnostic Interview for DSM-IV (CAADID; Epstein et al., 2001) as the gold standard to evaluate the utility of the ASRS (Daigre Blanco et al., 2009, Dakwar et al., 2012). However, as noted before, samples were small and not al validity indicators were established due to limitation in the design and thus rigorous evaluation of the ASRS, using the CAADID as the “gold-standard” is still needed.
In the methods paper for their international prevalence study of adult ADHD in treatment seeking substance use disorder patients, Van de Glind et al. (in press) mentioned that both DSM-IV-TR and the proposed criteria for adult ADHD in DSM-5 should be studied. While the “strict DSM-IV-TR” criteria as the gold standard comparator needs to be studied, the psychometric properties of the ASRS should also be evaluated using the slightly looser DSM-5 criteria (DSM-5 website, August 2012). Moreover, the range of prevalence rates in treatment seeking SUD patients (Van Emmerik-van Oortmerssen et al., 2012) might be related to differences in gender, the primary drug of abuse and treatment setting. Hence these differences might also affect the psychometric features of the ASRS and therefore the validity of the ASRS should be established separately in these sub-populations.
Interestingly in another study in a population of US managed care subscribers, both sensitivity and specificity of the ASRS greatly improved (from 39.1 to 64.9 and from 88.3 to 94.0, respectively) by using an alternative scoring algorithm of the 6-item version of the ASRS (Kessler et al., 2007). This alternative scoring algorithm might also improve ASRS validity in the population of treatment seeking SUD patients.
It is well known that active substance abuse and withdrawal can mimic ADHD symptoms (Levin et al., 2009). It is therefore important to know to what extent the timing of the ASRS assessment in clinical practice influences its validity. We hypothesized that the ASRS would have better sensitivity and specificity when used in a more stable situation compared to when administered at initial admission when patients are still experiencing the acute effects of intoxication or withdrawal.
Finally, given the reported high comorbidity with other externalizing disorders (Cerdá et al., 2008, Couwenbergh et al., 2006), it is important to see to what extend the ASRS differentiates between ADHD and other externalizing disorders (discriminant validity).
In sum, the goals of the current study are: to test the performance of the Adult ADHD Self-Report Scale V 1.1 (ASRS) for adult ADHD in an international sample of treatment seeking SUD patients for DSM-IV and the proposed DSM-5 criteria for adult ADHD, for different subpopulations based on gender, primary substance of abuse and treatment setting, at intake and 1–2 weeks after intake, using different scoring algorithms; and using different externalizing disorders as external criterion, including adult ADHD, bipolar disorder (BD), antisocial personality disorder (APD) and borderline personality disorder (BPD).
Section snippets
Design
This validation study uses data from the International ADHD in Substance use disorders Prevalence (IASP) study (Van de Glind et al., in press). The IASP is a two-staged study evaluating SUD treatment seeking patients for ADHD and comorbid APD, BPD, major depression (MD) and BD. The study design is presented in Fig. 1.
Stage 1 includes questions about demographics, substance use and the ASRS. All patients from stage 1 were invited to participate in stage 2 (t2). Stage 2 included a second
Preliminary analyses
Ten countries participated in the IASP study: Australia, Belgium, France, Hungary, the Netherlands, Norway, Spain, Sweden, Switzerland, and the United States (USA). Seven of these participated in both t1 and t2: France, Hungary, The Netherlands, Norway, Spain, Sweden and Switzerland. In Table 1 the most important characteristics of the included sample are listed and compared to the original larger sample.
Of all 1138 subjects, 625 (55%) scored negative on the ASRS both at t1 and t2 and 328 (29%)
Discussion
The prevalence of adult ADHD in the current study was 13%. The overall positive predictive value (PPV) of the ASRS was 0.26 and the negative predictive value (NPV) was 0.97. The sensitivity (0.84) and specificity (0.66) measured at admission were similar to the sensitivity (0.88) and specificity (0.67) measured 1–2 weeks after admission. Sensitivity was similar, but specificity was significantly better in patients with alcohol compared to (illicit) drugs as the primary substance of abuse (0.76
Role of funding source
The funding sources did not have influence on: who participated as an author in this study; the research protocol; the sampling of data; the topics chosen for publications; the analyses of the data; the content of the publication.
Contributors
GvdG wrote the proposal, coordinated the study, was involved in the data management and data analyses, and wrote the final version of the manuscript together with FRL and WvdB. FRL, PJC, JAR-Q and WvdB contributed to the design of the study and commented on the manuscript. MK, KvE-vO, AS, JF, E-TB, FM, ZD, MF, AS, MK-F and AR-Q coordinated the local data collection. MWJK supervised the data management and undertook data analyses and commented on the manuscript. All authors contributed to
Conflict of interest
For coordination of the IASP study, as described in the acknowledgement part of the manuscript, grants were received from pharmaceutical companies (Shire, Eli Lilly & Company, Jansen Cilag), from participating institutes and from three not for profit organizations: the Waterloo Foundation, the Noaber Foundation and the Augeo Foundation.
The funding companies, institutes and foundation did not have and will not have influence on any aspect of the study, including research questions, data
Acknowledgements
Many individuals and institutes contributed to the IASP Study. The authors thank all of these, but especially: the participating subjects and professionals, Sarah Shenow, the Waterloo Foundation, the Augeo foundation and the Noaber Foundation.
References (57)
- et al.
History and significance of childhood attention deficit disorder in treatment-seeking cocaine abusers
Compr. Psychiatry
(1993) - et al.
Co-occurrence of 12-month mood and anxiety disorders and personality disorders in the US: results from the national epidemiologic survey on alcohol and related conditions
J. Psychiatr. Res.
(2005) - et al.
Prevalence and implications of attention-deficit hyperactivity disorder among adolescents in treatment for substance abuse
J. Am. Acad. Child Adolesc. Psychiatry
(1997) - et al.
Impact of attention-deficit hyperactivity disorder and other psychopathology on treatment retention among cocaine abusers in a therapeutic community
Addict Behav.
(2004) - et al.
Prevalence of adult attention-deficit hyperactivity disorder among cocaine abusers seeking treatment
Drug Alcohol Depend.
(1998) - et al.
A randomized, placebo-controlled trial of three fixed dosages of prolonged-release OROS methylphenidate in adults with attention-deficit/hyperactivity disorder
Biol. Psychiatry
(2008) - et al.
Increases in hyperactive-impulsive symptoms predict relapse among smokers in nicotine replacement therapy
J. Subst. Abuse Treat.
(2005) - et al.
Prevalence of attention-deficit hyperactivity disorder in substance use disorder patients: a meta-analysis and meta-regression analysis
Drug Alcohol Depend.
(2012) - et al.
Dual diagnosis and successful participation of adolescents in substance abuse treatment
J. Subst. Abuse Treat.
(2001) - et al.
Screening and imputed prevalence of ADHD in adult patients with comorbid substance use disorder at a residential treatment facility
Postgrad. Med.
(2009)
Validity of pilot Adult ADHD Self-Report Scale (ASRS) to rate adult ADHD symptoms
Ann. Clin. Psychiatry
A common variant of the latrophilin 3 gene, LPHN3, confers susceptibility to ADHD and predicts effectiveness of stimulant medication
Mol. Psychiatry
ADHD in Adults. What the Science Says
The persistence of attention-deficit/hyperactivity disorder into young adulthood as a function of reporting source and definition of disorder
J. Abnorm. Psychol.
Comorbid forms of psychopathology: key patterns and future research directions
Epidemiol. Rev.
Questioning the specificity of ASRS-v1.1 to accurately detect ADHD in substance abusing populations
J. Atten. Disord.
Attention-deficit/hyperactivity disorder and substance use: symptom pattern and drug choice
Am. J. Drug. Alcohol Abuse
Comorbid psychopathology in adolescents and young adults treated for substance use disorders: a review
Eur. Child Adolesc. Psychiatry
Adult ADHD Self-Report Scale (ASRS-v1.1) symptom checklist in patients with substance use disorders
Actas Esp. Psiquiatr.
The utility of attention-deficit/hyperactivity disorder screening instruments in individuals seeking treatment for substance use disorders
J. Clin. Psychiatry
Mortality Amongst Illicit Drug Users
Conners’ Adult ADHD Diagnostic Interview for DSM-IV (CAADID). Technical Manual
Psychometric properties of an adult ADHD diagnostic interview. Psychometric properties of an adult ADHD diagnostic interview
J. Atten. Disord.
Childhood attention deficit/hyperactivity disorder and alcohol dependence: a 1-year follow-up
Alcohol Alcohol.
What is the prevalence of adult ADHD? Results of a population screen of 966 adults
J. Atten. Disord.
The age-dependent decline of attention deficit hyperactivity disorder: a meta-analysis of follow-up studies
Psychol. Med.
Cross-national prevalence and correlates of adult attention-deficit hyperactivity disorder
Br. J. Psychiatry
Cited by (130)
Atypical sensory processing in adolescents with Attention Deficit Hyperactivity Disorder: A comparative study
2024, Research in Developmental DisabilitiesClinical utility of new cut-off scores for the world health organization ADHD self-report scale among adolescents in psychiatric outpatient care
2023, International Journal of Clinical and Health PsychologyCross-Cultural Adult ADHD Assessment in 42 Countries Using the Adult ADHD Self-Report Scale Screener
2024, Journal of Attention Disorders
- 1
See Appendix A for the persons participated in this study.