http://orcid.org/0000-0001-9241-8970
Figures
Abstract
Background
The challenge of addressing unhealthy lifestyle choice is of global concern. Motivational Interviewing has been widely implemented to help people change their behaviour, but it is unclear for whom it is most beneficial. This overview aims to appraise and synthesise the review evidence for the effectiveness of Motivational Interviewing on health behaviour of adults in health and social care settings.
Methods
A systematic review of reviews. Methods were pre-specified and documented in a protocol (PROSPERO–CRD42016049278). We systematically searched 7 electronic databases: CDSR; DARE; PROSPERO; MEDLINE; CINAHL; AMED and PsycINFO from 2000 to May 2018. Two reviewers applied pre-defined selection criteria, extracted data using TIDIER guidelines and assessed methodological quality using the ROBIS tool. We used GRADE criteria to rate the strength of the evidence for reviews including meta-analyses.
Findings
Searches identified 5222 records. One hundred and four reviews, including 39 meta-analyses met the inclusion criteria. Most meta-analysis evidence was graded as low or very low (128/155). Moderate quality evidence for mainly short term (<6 months) statistically significant small beneficial effects of Motivational Interviewing were found in 11 of 155 (7%) of meta-analysis comparisons. These outcomes include reducing binge drinking, frequency and quantity of alcohol consumption, substance abuse in people with dependency or addiction, and increasing physical activity participation.
Conclusions
We have created a comprehensive map of reviews relating to Motivational Interviewing to signpost stakeholders to the best available evidence. More high quality research is needed to be confident about the effectiveness of Motivational Interviewing. We identified a large volume of low quality evidence and many areas of overlapping research. To avoid research waste, it is vital for researchers to be aware of existing research, and the implications arising from that research. In the case of Motivational Interviewing issues relating to monitoring and reporting fidelity of interventions need to be addressed.
Citation: Frost H, Campbell P, Maxwell M, O’Carroll RE, Dombrowski SU, Williams B, et al. (2018) Effectiveness of Motivational Interviewing on adult behaviour change in health and social care settings: A systematic review of reviews. PLoS ONE 13(10): e0204890. https://doi.org/10.1371/journal.pone.0204890
Editor: Ethan Moitra, Brown University, UNITED STATES
Received: October 26, 2017; Accepted: September 17, 2018; Published: October 18, 2018
Copyright: © 2018 Frost et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was undertaken by and on behalf of The Scottish Improvement Science Collaborating Centre (SISCC). The Scottish Improvement Science Collaborating Centre (SISCC) is funded by the Scottish Funding Council, Chief Scientist’s Office, NHS Education for Scotland and The Health Foundation with substantial additional investment from partner organisations. Alex Pollock and Pauline Campbell are employed by the Nursing, Midwifery and Allied Health Professions Research Unit, which is funded by the Chief Scientist Office in Scotland. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
There is overwhelming epidemiological evidence that health behaviour such as smoking, substance abuse (drugs and alcohol), physical inactivity, and unhealthy eating are associated with increased morbidity and mortality. The cost to the UK NHS for diseases associated with poor diet, physical inactivity, smoking, alcohol and obesity are estimated to be in excess of £12 billion [1]. The challenge of addressing unhealthy lifestyle choice is complex and requires sustained behaviour change. The UK NICE (2014) guidelines [2] recommend a range of behaviour change approaches, guided by a taxonomy of interventions [3], aimed at changing health-related behaviour of individuals, communities or whole populations.
Motivation to change is a key component of the behaviour change process as it guides and maintains goal-related behaviour [4]. One approach to change motivation and subsequent behaviour is Motivational Interviewing, introduced by William Miller in 1983 to help people with alcohol problems change their drinking behaviour [5]. The approach was developed further in the 1990s into “A collaborative conversation style for strengthening a person’s own motivation and commitment to change” [5]. Motivational Interviewing aims to explore and resolve ambivalence that people might have about health behaviour in favour of change. It encourages people to say why and how they might change and pertains both to a style of relating to others and a set of skills to facilitate that process. The four overlapping processes involve: 1) engaging in a working relationship; 2) focusing on a problem to change; 3) evoking the person’s desire to change; 4) planning the change [5]. In 1997 an international organisation of trainers established ‘The Motivational Interviewing Network of Trainers (MINT)’ with an aim to improve the quality and effectiveness of counseling and consultations for professional delivering Motivational Interviewing. The organisation has grown to represent 35 countries and 26 languages, which demonstrates the global popularity of this intervention. Some reviews report positive outcomes for Motivational Interviewing and suggest it could be useful for a wide range of behavioural and health problems [6–9] whilst others are more cautious in their conclusions and recommendations [10–12].
Many different health care professionals and other groups are using behaviour change interventions including Motivational Interviewing to help people change or adapt their behaviour. However, it is unclear for which behavioural problems and populations Motivational Interviewing is most beneficial, or in some cases, where there is evidence of no effect or possible harm. This overview aims to identify, appraise and synthesise the review evidence for the effectiveness of Motivational Interviewing on health behaviour of adults in a wide range of health and social care settings to answer the following question;
What is the strength and quality of the current evidence to support the use of Motivational Interviewing to change adult behaviours in health and social care settings?
This question is important to guide health care professionals, researchers and other stakeholders to the most effective and worthwhile interventions for patients.
Methods
Design
We conducted a systematic review of existing reviews (referred to as an overview [13]). An overview synthesises the evidence from more than one systematic review at a variety of different levels, including the combination of different interventions, different outcomes, or people from different populations with different conditions.
Search methods
We systematically searched the following electronic databases from January 2000 to 28th May 2018; Cochrane Database of Systematic Reviews (CDSR); Database of Reviews of Effects (DARE); PROSPERO (an international prospective register of systematic reviews); MEDLINE; CINAHL; AMED and PsycINFO. The search string was adapted for each database. (See Appendix 1 for Medline search). A comprehensive search combined key terms using Boolean operators (e.g. AND, OR) for: Intervention (e.g. "motivational interviewing," "motivational enhancement") and Review type (e.g. "systematic review," "meta-analysis, " "review literature, " "qualitative systematic review," "evidence synthesis" OR "realist synthesis", "qualitative AND synthesis", "meta-synthesis* OR meta synthesis* OR metasynthesis", "meta-ethnograph* OR metaethnograph* OR meta ethnograph*", "meta-study OR metastudy OR meta study"). Truncated forms of these terms and alternative spellings were included. To be eligible for inclusion, reviews met the following criteria:
Inclusion criteria.
- Reviews using structured, pre-planned methods to synthesise research studies addressing a clearly defined topic or research question (which could comprise either quantitative, qualitative or mixed methodology)
- Published from January 2000
- Interventions described as Motivational Interviewing or Motivational Enhancement Therapy (MET) delivered in any format (e.g. face to face, online, group, text or telephone)
- English language
- Interventions focused on adults.
Exclusion criteria.
- Letters, commentaries, expert opinion, theoretical and “non-systematic” or unstructured reviews e.g. reviews without an aim that did not clearly describe the search strategy, selection criteria and quality assessment employed.
- Reviews focused solely on children and adolescents under the age of 18 years
- Reviews focused on Motivational Interviewing intervention to change professional or organisational group behaviour.
- Reviews focused on combined psychological interventions e.g. Motivational Interviewing combined with Cognitive Behavioural Therapy.
Identification of studies
Members of the review team (PC / SM) ran the search strategy and then examined all titles to exclude clearly irrelevant papers. Two reviewers (PC and HF) independently reviewed the abstracts of all potential records identified from the electronic searches and excluded those not meeting the inclusion criteria. Inter-rater reliability was assessed for agreement of abstract screening.
Two reviewers (PC and HF) independently assessed full papers for all potentially relevant reviews. Full text papers ranked as irrelevant by both reviewers were excluded at this stage of the screening process. The final selection of full text papers (judged as relevant or unsure) were discussed at a consensus meeting, with a third reviewer (MM or AP) as required.
Data extraction
Three reviewers (PC, HF and EC) independently extracted the following information: review question or aims; types of studies included; characteristics of participants and numbers included; interventions details. The TIDieR framework[14] was used to guide reporting of interventions components and comparators. Two reviewers (HF and PC) checked all the extracted data and discussion between the two reviewers resolved any disagreement; with assistance from a third reviewer (AP) when necessary. A data extraction form (excel) specifically developed by the overview author team was used to collate the data.
Categorisation of reviews
Two reviewers (PC and HF) categorised each review into one of four of the following domains depending on the focus of the review.
Domain 1: Stopping or preventing an unhealthy behaviour
Domain 2: Promoting healthy behaviour for a specific problem
Domain 3: Behaviour change for multiple health related problems and /or multiple behaviour problems
Domain 4: Behaviour change in specific settings
Reviews in Domain 1 and 2 were then sub-grouped by HF and PC according to the main health behaviour or problem.
Assessment of quality of reviews
Two reviewers (HF and PC) independently assessed the methodological quality of included reviews using the ROBIS tool [15]. Any disagreement was resolved through discussion between the two reviewers. The tool covers four domains to detect bias in systematic reviews relating to study eligibility criteria; identification and selection of studies; data collection and study appraisal; synthesis and findings. The full result of assessment of bias aids transparency and aims to help researchers judge risk of bias in the review process, results and conclusions.
Meta-analyses data extraction
One reviewer (PC) extracted comparative data for individual and combined outcomes from any review that included meta-analyses. Data exploring effectiveness of Motivational Interviewing as the main intervention compared with any other intervention or control was extracted. One reviewer (HF) checked the data entry.
This included the following data: Number of trials and participants in the meta-analysis; Measure of effect (e.g. effect size, mean difference, standardised mean difference, relative risk); Measure of variability (95% confidence intervals) and Measure of heterogeneity (I-squared).
Three reviewers (AP, PC and HF) checked the quality assessment of individual studies reported in the reviews and considered the results when grading the evidence. We used the GRADE (Grades of Recommendation, Assessment, Development, and Evaluation) criteria to assess whether the quality of the evidence presented in the meta-analyses was high, moderate, low or very low [16] for all available comparator data within each review. This involved judgement of risk of bias relating to study design, imprecision, inconsistency, indirectness, and publication bias [17]. In addition, one reviewer (PC) extracted any data that included exploration of moderator variables and tabulated effect size for each comparator.
Meta-analysis synthesis
For reviews including a meta-analysis two reviewers (PC and HF) independently checked the overlap in studies within all the reviews and resolved any uncertainty through discussion. We excluded data superseded by a more up-to-date review (e.g. where a Cochrane review had been updated while we were conducting the overview), or in cases where an overlapping review was conducted with the same review question, we selected the higher quality review judged using the ROBIS quality assessment tool [15]. We tabulated the intervention, comparison, outcome, number of studies and participants’ data relating to effectiveness and the GRADE of evidence [18]. Using the data relating to effectiveness we noted whether there was statistically significant evidence of benefit or harm for each outcome reported in the meta-analyses, or if there was no evidence of benefit or harm (no statistically significant effect).
Narrative review synthesis
For all systematic reviews without meta-analysis data (defined as narrative reviews), we summarised key findings. We systematically documented and explored the conclusions reported by the authors of the reviews. Where these reviews included overlapping aims and outcomes, we compared conclusions; where there was a discrepancy in conclusions, we focused conclusions of the most up-to-date and highest quality reviews (judged using ROBIS) [15]. We considered whether these were in agreement with the results of any related meta-analyses reported in other reviews and focused our conclusions on the most up-to-date and high quality data.
Results
The search identified 5222 records; we screened 2852 titles and removed 2363 obviously irrelevant records after removing duplications. Two reviewers screened 489 abstracts and 235 full text articles, excluded 131 reviews and extracted data from the remaining 104 reviews. The inter-rater reliability for abstract screening was 92%. The PRISMA flow diagram (Fig 1) shows the flow of literature through the searching and screening process.
MI = Motivational Interviewing; CBT = Cognitive Behavioural Therapy.
Description of included reviews
Two reviewers categorised the reviews into four domains. The number of reviews in each domain are represented in Fig 2.
Domain 1. Stopping or preventing an unhealthy behaviour including smoking cessation (n = 11) [11, 12, 19–43], substance misuse for general population (alcohol and drugs) (n = 23) [28, 29, 38–58], substance misuse for people with mental health problems (n = 8) [31, 33, 35–37, 59–61] and people with gambling addiction (n = 3)[7, 62, 63] (Total = 45).
Domain 2. Promoting healthy behaviour for a specific problem including; management of oral health (n = 5) [64–68], eating disorders (n = 3) [10, 69, 70], weight loss management (n = 4) [71–74], management of metabolic disease (Type 2 diabetes) (n = 6) [75–80], management of neurovascular (stroke) and cardiovascular disease (n = 3) [81–83], management of sexual health (n = 5) [84–88], adherence to medication (n = 9) [89–97] and engagement with interventions; cardiac care [98], health screening [99] and mental health interventions [100] (n = 3), cancer care (n = 1) [101], musculoskeletal problems [102, 103] (n = 2), irritable bowel disorder[104] (n = 1).
Domain 3. Behaviour change for multiple health related problems and /or multiple behaviour problems (n = 9) including one recent review of Technology Delivered Motivational Interviewing (TDMI)[105] and eight reviews focused on various health problem such as excess drinking, smoking, and physical inactivity [8, 9, 106–111].
Domain 4. Behaviour change in specific settings (n = 8) including emergency care settings [112, 113](n = 2), primary care [114–117](n = 4), medical care settings for multiple problems [6, 118](n = 2).
Domain 1: Reviews focused on interventions aimed at preventing unhealthy behaviour
Smoking cessation.
Of the 11 reviews [11, 12, 19–27], two reviews focused on reducing exposure of smoke to children [11, 20], one on smoking during pregnancy [19], three on general smoking cessation [22–24], two were carried out in emergency care settings [25, 26], One review was updated from an earlier review of Motivational Interviewing to support smoking cessation [119] with the addition of 14 studies since 2010 [12]. One review focused on smokeless tobacco users although only one out of 34 trials included Motivational Interviewing [21].
Substance misuse.
Thirty-one reviews assessed substance misuse/abuse of which 13 focused primarily on alcohol related problems [28, 39, 40, 43–46, 49, 50, 52, 53, 55, 58]. Reviews in this domain included different populations and problems [29, 38, 41, 42, 48, 56, 57] [53, 54]; both alcohol and drug abuse users[56]; young adults [39]; pregnant women and drug use [38], two reviews focused on cannabis use [41, 42]; one focused on offenders and treatment retention [29]. Eight reviews describe substance misuse in people with co-existing mental health disorders [31–37]. Jiang et al (2017) focused on brief non face-to- face interventions e.g. telephone.
Gambling behaviour.
Three reviews focused on Motivational Interviewing and psychological therapies for gambling addiction [7, 30, 63]. Yakovenko et al (2015) [7] identified eight trials including longer term follow up, Petry (2017) [63] reviewed trials of psychological interventions but identified only 2 trials that included Motivational Interviewing as a stand-alone intervention.
Domain 2: Reviews focused on interventions aimed at promoting healthy behaviour for a specific problem
Oral hygiene behaviour.
Five reviews focused on oral hygiene, 3 compared conventional oral hygiene advice with Motivational Interviewing interventions [64, 65, 68]. One compared periodontal therapy alone with Motivational Interviewing and periodontal therapy combined [66], and one included a meta-analysis of psychological treatment for people with poor oral health [67].
Eating disorders.
Three reviews focused on eating disorders of mainly female participants e.g. Anorexia nervosa and bulimia nervosa [10, 69, 70].
Weight management behaviour.
Three reviews focused on changing diet and physical activity for weight management in obese adults [71, 72, 74] and one investigated the management of weight gain during pregnancy [73].
Management of diabetes.
Six reviews focused on the management of people with diabetes. They include reviews focussed on evidence for; improving health behaviour in the management of diabetes [75], promoting glycaemic control [77] and lifestyle modifications programmes for- metabolic risk [78]. Four other reviews categorised in Domain 3 (multiple health problems / behaviours) and Domain 4 (Behaviour change in specific settings) assessed the effectiveness of Motivational Interviewing for diabetes management alongside obesity and other health related problems [71, 91, 114, 118].
Management of neurovascular disorders and cardiovascular disease (CVD).
Three reviews focused on behavioural interventions for neurovascular disorders, but the reviews only included 11 trials in total evaluating the effectiveness of Motivational Interviewing. One review investigated Motivational Interviewing for the management of activities of daily living for stroke victims, identifying one study only [81]. Hildebrand (2015) reported one of 39 trials that incorporated Motivational Interviewing into interventions to support occupational therapy for stroke victims [82]. Lee et al (2016) [83] investigated lifestyle modification, physiological and psychological outcomes for people diagnosed with Cardiovascular disease. Overall there is insufficient evidence in this group to make firm conclusions about effectiveness of Motivational Interviewing.
Sexual health behaviour.
Five reviews focused on promoting safe sexual behaviours [84–88]. Two reviews focused specifically on sexual health in gay men [84, 85]. One review focused on the effectiveness of Motivational Interviewing on contraceptive use in women [87].
Adherence to medication.
Adherence to medication was assessed for different populations and health problems. Hu et al (2014) assessed interventions including Motivational Interviewing to increase medication adherence in racial and ethnic minority groups [94]. Five reviews assessed medication adherence for patients with HIV [90, 94, 96, 97, 120]. Two recent reviews with meta-analyses assessed the effectiveness of Motivational Interviewing to enhance medication adherence for adults with chronic diseases and health problems [93, 95].
Engagement with interventions.
Three reviews focused on engagement with a specific intervention [98–100]; one specifically on cardiac rehabilitation. Karmali et al (2014) assessed adherence to cardiac rehabilitation but only one trial of Motivational Interviewing was identified in this review [98]. A review with meta-analysis of outcomes relating to adherence by Lawrence et al (2017) [100] investigated individuals’ uptake of mental health interventions. Miller et al (2017) [99] assessed the efficacy of Motivational Interviewing to improve health screening for various problems e.g. breast screening, uptake of colonoscopy.
In addition, two other reviews grouped in Domain 1 and 2 assessed the effect of Motivational Interviewing on adherence to drug management programmes in offender populations [29] and adherence to treatment for chronic pain [102].
Management of musculoskeletal problems.
Two reviews focused on musculoskeletal problem [102, 103] with some overlap of trial within the reviews. In the most recent review, Alperstein and Sharp (2016) identified 7 trials focused on pain outcomes and adherence to treatment in adults with various musculoskeletal problems e.g. low back pain, rheumatoid arthritis [102].
Management of irritable bowel disorders.
One review explored the use of Motivational Interviewing to improve outcomes for people with irritable bowel disorders including quality of life measures [104].
Cancer care.
One review focused on Motivational Interviewing to address various lifestyle behaviours and health problem associated with cancer such as fatigue, weight problems, and physical activity participation [101].
Domain 3: Reviews that focused on multiple health related problems and /or multiple behaviour problems
Nine reviews focused on behavioural interventions for people with multiple health problems [8, 9, 105–111]; These included multiple risk factors for cardiovascular disease[110]; diet, exercise, diabetes and oral health[109]; alcohol, drugs, diet and exercise[106, 111]; substance abuse, smoking, HIV risk, diet and exercise[107] multiple behaviour problems[8, 108] and multiple health outcomes [9]. Shingleton et al (2016) evaluated the efficacy of technology delivered Motivational Interviewing interventions in a mixed population from different socioeconomic backgrounds [105].
Domain 4: Reviews focused on behaviour change interventions in specific settings
Eight reviews reported behaviour change interventions delivered in specific settings [6, 112–118]. One included a combination of healthcare settings [118]; one focused on medical care settings [6]; four were carried out in primary care[114–117]. Merz et al (2015)[113] and Kohler and Hofmann (2015)[112] focused on young adults in emergency care units. In addition, two reviews described in Domain 1 (preventing an unhealthy behaviour) also reported smoking cessation in emergency department settings [25, 26].
Review characteristics and quality assessment
Tables 1–4 report details of the review characteristics and implications for clinical practice and research. Further details of the interventions using the ‘Template for Intervention Description and Replication (TIDieR) [14] are reported in S1 Table. Of the 104 reviews 40 were judged by two authors (PC and HF) as overall low risk of bias [7, 11, 12, 20, 21, 25–27, 30, 35, 38, 41, 44, 47–49, 51, 53, 54, 56, 57, 59, 65, 71, 81, 83, 84, 89, 91–94, 97, 98, 100, 102, 111, 113–115]. Fig 3 summaries the risk of bias across all reviews. S2 Table reports the assessment of bias for each review individually using the ROBIS tool [15].
Abbreviations: MI = Motivational Interviewing, BMI Brief Motivational Interviewing, RCT = randomised controlled trial, MET = Motivational Enhancement Therapy.
Abbreviations: MI = Motivational Interviewing, BMI Brief Motivational Interviewing, RCT = randomised controlled trial, MET = Motivational Enhancement Therapy, HAART = Highly Active Antiretroviral Therapies, ETS = Environmental Tobacco Smoke, SUMSM = Substance-using men who have sex with men, BCT = Behaviour change techniques, BZDs = Benzodiazepines, Blood alcohol concentration (BAC).
Abbreviations: MI = Motivational Interviewing, BMI Brief Motivational Interviewing, RCT = randomised controlled trial, MET = Motivational Enhancement Therapy, HAART = Highly Active Antiretroviral Therapies, ETS = Environmental Tobacco Smoke, SUMSM = Substance-using men who have sex with men, T2D = Type 2 Diabetes, CVD = Cardiovascular disease, NVD = neurovascular disease, BMI = Body Mass Index, BCT = Behaviour change techniques.
Abbreviations: MI = Motivational Interviewing, BMI Brief Motivational Interviewing, RCT = randomised controlled trial, MET = Motivational Enhancement Therapy, HAART = Highly Active Antiretroviral Therapies, ETS = Environmental Tobacco Smoke, SUMSM = Substance-using men who have sex with men, T2D = Type 2 Diabetes, CVD = Cardiovascular disease, NVD = neurovascular disease, BMI = Body Mass Index, BCT = Behaviour change techniques.
Results of meta-analyses
Thirty-nine reviews reported meta-analyses but it was not possible to extract data from all. [6–9, 12, 21–23, 26, 27, 30, 38, 39, 41, 45, 46, 48, 49, 56–58, 67, 71, 73, 74, 77, 81, 84, 87, 91, 93, 95, 100, 102, 106, 108, 111, 112, 116]. Table 5 provides a brief summary of results from the reviews with pooled data comparisons.
Of the 155 meta-analysis comparisons that were extracted, we found no high quality evidence. Twenty seven comparisons provide moderate quality evidence according to the GRADE criteria. Most of this evidence was categorised in Domain 1 (Stopping an unhealthy behaviour). Further details of the outcomes for the moderate quality evidence are reported in Table 6.
Seventy one comparisons provided low quality evidence and 57 provide very low quality evidence judged by the GRADE criteria. S3 Table summarises the comparisons that were judged as providing low or very low quality evidence. The key reasons for downgrading the evidence to low or very low quality primarily relate to; risk of bias of the review was unclear; heterogeneity was judged to be moderate to high, or confidence intervals very large; volume of evidence was judged to be insufficient to support a definitive conclusion and concerns about the quality of the trials included within the comparison judged by review authors.
Moderate quality evidence for effectiveness of Motivational Interviewing
Table 6 summarises the 27 comparisons, which provide moderate quality evidence for Motivational Interviewing interventions judged from six reviews [12, 49, 56, 58, 84, 111]. Eleven of these 27 comparisons (7% (11 of 155) of all meta-analyses’ comparisons) provide moderate quality evidence for mainly short term (<6 months) statistically significant beneficial effects of Motivational Interviewing. The remaining 16 comparisons demonstrate no benefit or harm, compared with a control of usual care or other active interventions. Moderate quality evidence of a beneficial effect of Motivational Interviewing was available for;
Alcohol use. 13 comparisons from two reviews [49, 58] explored the effect of Motivational Interviewing on outcomes relating to alcohol use in mixed populations. Eight of the 13 comparisons provide consistent evidence that Motivational Interviewing has a beneficial effect on outcomes relating to the frequency and/or volume of alcohol consumption, for short term outcomes (< 4 months), but the evidence relating to sustained (>4 months) outcomes is less consistence. Comparisons relating to risky behaviour and drink driving demonstrated no benefit (or harm) of Motivational Interviewing. There is evidence of beneficial effects from one review of young adults (<25 years), for reducing binge drinking, frequency, quantity of alcohol consumption and peak blood alcohol concentration[58].
Smoking cessation. One comparison from a review on smoking cessation was judged to provide moderate quality evidence. This review comparing Motivational Interviewing with usual care or brief advice, provides evidence of beneficial effects on abstinence from smoking, particularly when attention was paid to treatment fidelity[12].
Substance abuse (drugs). One comparison from a review of people with substance abuse dependency and addiction provides evidence of a benefit of Motivational Interviewing when compared with no intervention. The other four comparisons derived no benefit or harm when Motivational Interviewing was compared with usual care or any other treatment [56].
Physical activity. Four comparisons from a review of Motivational Interviewing for promoting physical activity participation were judged to provide moderate quality evidence when Motivational Interviewing was compared with a control or usual care. One out of the four comparisons provide evidence of benefits. No benefit was found for the other three comparisons, including outcomes for people with cardiovascular disease and obesity [111].
Sexual health. Four comparisons from one review provide moderate quality evidence of no benefit or harm of Motivational Interviewing relating to changing high risk sexual behaviours in men who have sex with men[84] when compared with a control.
Exploration of moderator variables
Of the six reviews that provide any evidence judged to be of moderate quality, three did not report the results of any subgroup analyses [56, 84, 111]. The three reviews that contain moderate quality evidence and report subgroup analyses are:
· Lindson-Hawley 2015 [12]–smoking cessation (Table A in S1 File)
· Foxcroft 2014 [49]–alcohol use in young people (Table B in S1 File)
· Vasilaki 2006 [58]–alcohol consumption (Table C in S1 File)
Exploration of the reported subgroup analyses provides consistent evidence which suggests that Motivational Interviewing is beneficial when compared to ‘weak’ comparison groups such as no treatment, assessment only or non-specified treatment as usual, but Motivational Interviewing is not beneficial when compared to other ‘strong’ interventions.
Generalisable conclusions relating to the most effective delivery of Motivational Interviewing (e.g. face-to-face or group), dose, or characteristics of provider or patient across behavioural domains are difficult to draw.
Results of narrative reviews
Of the 104 reviews included in this synthesis, 65 did not combine any data within meta-analysis. The main findings from the narrative reviews are summarised in Tables 1 to 4. The majority focus on behaviour change in a general population, but also include people with specific mental and physical problems.
Narrative reviews of people with mental health problems include psychotic disorders[33], comorbid schizophrenia, combined mental health problems [31, 32, 35], general depression [10, 33–35, 69], post-stroke depression [36] and eating disorders [10, 69, 70]. One review in this category judged as low risk of bias suggests that Motivational Interviewing is important in psychiatric settings for reduction of substance use in the short term.
Narrative reviews of physical health problems include: cardiovascular problems (Motivational Interviewing for increasing physical activity) [83, 110]; musculoskeletal health (adherence with intervention for back pain) [103]; diabetes self-management (effect of smoking, blood-glucose control, diet and weight management [62, 75, 76, 78–80]; oral health hygiene[64–66, 68] (use of dental fluoride, increasing dental utilization and reducing sugar consumption); obesity (adherence to weight loss programmes); management of neurovascular disorders [82]. The most recent reviews report outcomes for the effectiveness of Motivational Interviewing for cancer care [101] and outcomes related to the treatment of irritable bowel disorder [104].
Quality of narrative reviews
In total 20 narrative reviews were judged as low risk of bias graded using the ROBIS tool [15] [11, 20, 25, 35, 42, 44, 47, 51, 53, 54, 59, 65, 83, 89, 92, 97, 98, 113–115]. Five of these reviews report positive effects of Motivational Interviewing. Rueda et al (2006) found beneficial effects of Motivational Interviewing for adherence to highly active antiretroviral therapy where there appears to be promising results for interventions delivered over 12 weeks or more [97]. Taggart et al (2012) found further support for benefits of Motivational Interviewing in achieving impacts around smoking cessation compared to other group education [115]. Cooper et al (2015) reported positive results for some but not all outcomes for reducing cannabis use [42]. Noordman et al (2012) conclude that Motivational Interviewing can be effectively delivered by physicians and nurses as a face-to-face communication-related behaviour change technique[114]. Reviews published since 2016 report mixed results. Kay et al (2016) suggest that Motivational Interviewing has potential for use in oral care [65]. Chatters et al (2016) report short term benefits for reducing cannabis use in younger adults [47]. However, most were unable to make firm conclusions about effectiveness of Motivational Interviewing [20, 44, 59, 89]. In a review of brief non face-to-face Motivational Interviewing interventions Jiang et al (2017) found promising evidence for telephone delivery in the treatment of substance abuse, but the results were not consistent for other alternative modalities such as text messages in groups or internet-based interventions.
Discussion
This overview is the first to integrate and systematically grade the quality of the evidence for the effectiveness of Motivational Interviewing interventions across a wide range of settings and populations for people with many different health problems and diseases. We have created a comprehensive map of all reviews relating to Motivational Interviewing to provide clarity relating to an intervention for which there have been multiple overlapping (and sometimes conflicting) reviews. Conflicting review evidence can create barriers and challenges to practitioners wanting to deliver evidence-based practice. This overview provides practitioners, policy makers and researchers with a summary of the quality and strength of the evidence for Motivational Interviewing. It signposts practitioners to the most up to date reviews, enabling them to efficiently access best review evidence to support clinical decisions. We found no high-quality evidence from the meta-analysis data within any review, mainly due to methodological flaws in the reviews and poor quality of the included studies.
Motivational Interviewing appears to be most effective for stopping or preventing unhealthy behaviours (categorised as Domain 1) such as binge drinking, reducing the quantity and frequency of drinking, smoking and substance abuse. For gambling behaviour, low quality evidence of short to long-term effectiveness suggests that further research on the effectiveness of Motivational Interviewing is warranted to address this significant public health problem [62]. For promoting healthy behaviour (categorised as Domain 2) where people may have little desire to change, most of the evidence is inconclusive or of low quality. For example, there is low quality evidence for the effectiveness of Motivational Interviewing for weight loss outcomes in obese and overweight adults. The exception in Domain 2 is physical activity promotion where there is moderate quality evidence of beneficial effects of Motivational Interviewing for increasing physical activity in people with chronic health conditions. However, the trials assessing adherence to physical activity participation were small and further high quality research in this field is justified to investigate the effectiveness of Motivational Interviewing in different populations, settings and context.
Mode of delivery
The exploration of moderator variables from meta-analysis data does not provide enough data to be confident about the effects of different modes of delivery for Motivational Interviewing. Reviews that focus on the mode of delivery report inconsistent results [45, 51, 95, 105]. The TIDieR guidelines [14] capture some of the features that are relevant to intervention delivery but the mode of delivery is considered to be an important component of intervention and is not reported consistently in the literature [121]. Recent reviews have compared telephone [51] or technology-delivered Motivational Interviewing interventions (TAMIs) [105] and report inconsistent results or no beneficial effects. For example, Shingleton et al (2016) [105] found that TAMIs are feasible to deliver but there is limited evidence of effectiveness. For an intervention that relies on building and developing a relationship between client and provider it seems unlikely that this mode of delivery could be successfully adapted for Motivational Interviewing without considerable focus on training and fidelity measures.
Implication for clinicians and policy makers
The National Institute for Health and Care Excellence (NICE) guidelines [2] include Motivational Interviewing as a component associated with some effective interventions for behaviour change strategies. However, the NICE (2014) Programme Development Group (PH49) are cautious about making general recommendations due to lack of details of intervention components reported in this field of research [2].
This overview has identified clear gaps in the evidence in support of most of the interventions categorised in Domain 2 (e.g. weight loss programmes for obesity, oral health behaviour, management of diabetes and musculoskeletal disorders, adherence to medication and engagement with interventions). The high quality reviews on smoking cessation [12] and alcohol abuse [49] both recommend caution when interpreting results. However, the overall effect size reported by Lundahl et al [108] of 0.22 (95% CI 0.17 to 0.27) is similar to other complex behavioural intervention [122, 123]. If applied to the 1 million smokers in the UK, or the millions of physically inactive people globally [124], it is plausible that the impact of Motivational Interviewing on health at a population level may be larger. Further rigorous research is required to support this assumption.
Training and fidelity
Many different health care professionals including nurses, counsellors, physicians, medical students, social workers, and physiotherapists deliver Motivational Interviewing interventions, but there is little information about their training. Reviews that compared different health care providers found either no difference between groups [114] or reported limited conclusions due to small sample size [12].
Details of the fidelity of training of professionals delivering the interventions were generally poor although this is not unique to reporting of Motivational Interviewing. Training issues are fundamental to the success of any complex intervention and Motivational Interviewing, like other surgical, therapy or other behavioural interventions, requires practice of skills and a basic level of competency. There is no formal requirement for training in Motivational Interviewing or evaluation therefore practitioners can claim to use the approach without assessment, and competency is likely to influence outcome. Hall et al (2016) suggest that investment in training would need to be large to impact on change in practice [125].
It is difficult to comment on the cost effectiveness of Motivational Interviewing as it was not the focus of this overview, however we identified very little health economic data. Where cost data was available from a trial of smoking cessation in the UK, no clear conclusions could be drawn as the sustained quit rates did not reach statistical significance[12].
Strengths and limitations of the overview
This overview is the first to synthesise systematic review evidence on the effectiveness of Motivational Interviewing from a wide range of populations and settings with an aim to provide information that informs practice and policy. It highlights the discrepancy between the widespread recommendations of Motivational Interviewing as a universal behaviour change strategy and the available evidence supporting this approach. We carried out a comprehensive search with an inclusive selection criteria and it is unlikely that we missed any reviews written in English prior to our initial search, but this overview is not exhaustive.
The conclusions of this overview are highly dependent on, not only the quality of the reviews but the studies within the reviews. We extracted data according to the TIDieR guidelines [14] but many intervention details were missing, making it difficult to draw conclusions with confidence. This problem needs to be addressed in future trials to facilitate data synthesis and provide clear recommendation to all stakeholders. Our assessment of review quality (ROBIS) [15] and evidence quality (GRADE) [17] are subjective judgements and we used these judgements to categorise the evidence, concentrating our conclusions on those judged to be moderate quality (or low bias for narrative reviews). Some may consider our methods overly critical, but authors of the higher quality reviews are equally cautious with their recommendations [11, 12, 49].
Recommendations and implication for future research
The established Network of Trainers (MINT) alone have delivered Motivational Interviewing around the world to millions of people [126] but many questions remain unanswered regarding effectiveness.
Recommendations for clinical practice.
Many different health professional groups are using Motivational Interviewing but the evidence for training reported in the literature is limited. The ‘Motivational Interviewing Treatment Integrity code’ (MITI) has evolved over the last 10 years [127] with an aim to standardise the delivery of Motivational Interviewing interventions. Guidelines for the minimum intervention content and training requirements for Motivational Interviewing are available and should be followed to standardise intervention delivery [127, 128].
Recommendations for future reviews.
This overview has identified and brought together systematic reviews relating to Motivational Interviewing interventions; however further systematic reviews are warranted to inform clinical practice and future primary research in this field. Recommendations include, but are not limited to;
- Research should address the fact that in clinical practice Motivational Interviewing is often delivered in combination with another psychological intervention. Systematic reviews exploring combined interventions were excluded from this overview; consequently, it is important to identify and appraise any existing systematic reviews relevant to this, prior to planning new reviews or primary research.
- Future systematic reviews would benefit from the development of a taxonomy to ensure meaningful categorisation of the delivered intervention which considers the theoretical basis for Motivational Interviewing. Meaningful categorisation of Motivational Interviewing should be central to informing clinically relevant analyses and subgroup analyses.
- A systematic review to explore the cost-effectiveness of Motivational Interviewing as an intervention for those health conditions where there is moderate quality evidence of a beneficial effect of Motivational Interviewing on patient outcomes.
- A systematic review to explore the barriers and facilitators to delivery of Motivational Interviewing, focussed on those health conditions where there is moderate or high quality evidence of a beneficial effect.
- A systematic review of qualitative evidence to explore the acceptability and perceptions of this intervention to people who are offered Motivational Interviewing.
- Stakeholder involvement should be conducted in future reviews of the Motivational Interviewing literature particularly relating to categorising interventions and outcomes.
- The use of reporting templates, recognised guidance and best practice for the conduct of systematic reviews and primary research is essential. e.g. PRISMA [129] and TIDieR [14].
Recommendations for future primary research.
- Exploration of the effect of Motivational Interviewing should consider long-term outcomes and cost-effectiveness. Subgroup analyses should explore the length of intervention delivery and time since the end of the intervention.
- Investment in training would need to be large to impact on change in practice [130] and this along with other issues relating to sustainability of the intervention e.g. context, should be considered in future trials.
- To ensure avoidance of research waste [131, 132] it is essential that researchers are fully aware of existing reviews before embarking on further reviews, and that critical systematic reviews of evidence are completed prior to further primary research.
Conclusion
For the health problems that Motivational Interviewing was originally developed to address such as smoking cessation and alcohol misuse, the evidence provides some support for implementation particularly if fidelity of the intervention is prioritised. However, Motivational Interviewing has been implemented already for a wide range of other health and social problems where a “one size fits all” approach has been adopted with inconsistent effects.
Supporting information
S1 Table. Characteristics of interventions according to TIDIER checklist reporting guidelines.
https://doi.org/10.1371/journal.pone.0204890.s002
(DOCX)
S2 Table. Quality assessment of included reviews based on ROBIS (risk of bias in systematic reviews) tools.
https://doi.org/10.1371/journal.pone.0204890.s003
(DOCX)
S3 Table. Summary of comparisons judged to provide low or very low quality evidence.
https://doi.org/10.1371/journal.pone.0204890.s004
(DOCX)
Acknowledgments
This work was undertaken by and on behalf of The Scottish Improvement Science Collaborating Centre (SISCC). We thank Sheena Moffat, Information Services Advisors at Edinburgh Napier University, for her assistance with the updated search.
References
- 1. Scarborough P, Bhatnagar P, Wickramasinghe K, Allender S, Foster C, Rayner M. The economic burden of ill health due to diet, physical inactivity, smoking, alcohol and obesity in the UK: an update to 2006–07 NHS costs. J Public Health (Oxf). 2011;33(4):527–35. pmid:21562029.
- 2.
NICE. Behaviour change: individual approaches (PH49) London, UK2014. Available from: http://www.nice.org.uk/guidance/ph49/chapter/glossary#motivation.
- 3. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. pmid:23512568.
- 4.
Heckhausen J, Hechhausen H. Motivation and Action. 2nd ed. UK: Cambridge University Press; 2010.
- 5.
Miller W, Rollnick S. Motivational Interviewing. Helping People Change. 3rd ed. New York, USA: Guildford Press; 2013.
- 6. Lundahl B, Moleni T, Burke B, Butters R, Tollefson D, Butler C, et al. Motivational interviewing in medical care settings: a systematic review and meta-analysis of randomized controlled trials (Structured abstract). Patient Education and Counseling [Internet]. 2013; 93(2):[157–68 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12013052286/frame.htmlhttp://www.pec-journal.com/article/S0738-3991(13)00288-7/pdf.
- 7. Yakovenko I, Quigley L, Hemmelgarn B, Hodgins D, Ronksley P. The efficacy of motivational interviewing for disordered gambling: systematic review and meta-analysis. Addict Behav. 2015;43:72–82. pmid:25577724.
- 8. Hettema J, Steele J, Miller W. Motivational interviewing. Annu Rev Clin Psychol. 2005;1:91–111. pmid:17716083.
- 9. Rubak S, Sandbaek A, Lauritzen T, Christensen B. Motivational interviewing: a systematic review and meta-analysis. The British journal of general practice: the journal of the Royal College of General Practitioners. 2005;55(513):305–12. Epub 2005/04/14. pmid:15826439; PubMed Central PMCID: PMC1463134.
- 10. Knowles L, Anokhina A, Serpell L. Motivational interventions in the eating disorders: What is the evidence? International Journal of Eating Disorders. 2013;46(2):97–107. 2013-04604-001. pmid:23001832
- 11. Baxi R, Sharma M, Roseby R, Polnay A, Priest N, Waters E, et al. Family and carer smoking control programmes for reducing children's exposure to environmental tobacco smoke. Cochrane Database of Systematic Reviews [Internet]. 2014; (3). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD001746.pub3/abstract; http://onlinelibrary.wiley.com/store/10.1002/14651858.CD001746.pub3/asset/CD001746.pdf?v=1&t=ioifgsw9&s=e90df27c627ac8d2192ead2aae3ad2b04b3e26b3.
- 12. Lindson-Hawley N, Thompson T, Begh R. Motivational interviewing for smoking cessation. Cochrane Database Syst Rev. 2015;3:CD006936. pmid:25726920.
- 13. Smith V, Devane D, Begley C, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol. 2011;11(1):15. pmid:21291558; PubMed Central PMCID: PMC3039637.
- 14. Hoffmann T, Glasziou P, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. pmid:24609605.
- 15. Whiting P, Savovic J, Higgins J, Caldwell D, Reeves B, Shea B, et al. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2015. pmid:26092286.
- 16. Guyatt G, Oxman A, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. pmid:18436948; PubMed Central PMCID: PMC2335261.
- 17. Guyatt G, Oxman A, Schunemann H, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol. 2011;64(4):380–2. pmid:21185693.
- 18. Guyatt G, Oxman A, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence—imprecision. J Clin Epidemiol. 2011;64(12):1283–93. pmid:21839614.
- 19. Baxter S, Blank L, Everson-Hock E, Burrows J, Messina J, Guillaume L, et al. The effectiveness of interventions to establish smoke-free homes in pregnancy and in the neonatal period: a systematic review. Health education research. 2011;26(2):265–82. pmid:21273185.
- 20. Behbod B, Sharma M, Baxi R, Roseby R, Webster P. Family and carer smoking control programmes for reducing children's exposure to environmental tobacco smoke. The Cochrane database of systematic reviews. 2018;1:CD001746. https://dx.doi.org/10.1002/14651858.CD001746.pub4. pmid:29383710
- 21. Ebbert J, Elrashidi M, Stead LF. Interventions for smokeless tobacco use cessation. The Cochrane database of systematic reviews. 2015;10:CD004306.
- 22. Heckman CJ, Egleston BL, Hofmann MT. Efficacy of motivational interviewing for smoking cessation: a systematic review and meta-analysis. Tob Control. 2010;19(5):410–6. pmid:20675688; PubMed Central PMCID: PMC2947553.
- 23. Hettema J, Hendricks P. Motivational interviewing for smoking cessation: a meta-analytic review (Structured abstract). Journal of Consulting and Clinical Psychology [Internet]. 2010; 78(6):[868–84 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12011000298/frame.html.
- 24. Mantler T, Irwin J, Morrow D. Motivational interviewing and smoking behaviors: a critical appraisal and literature review of selected cessation initiatives. Psychological reports. 2012;110(2):445–60. pmid:22662398.
- 25. Pelletier J, Strout T, Baumann M. A systematic review of smoking cessation interventions in the emergency setting. Am J Emerg Med. 2014;32(7):713–24. pmid:24768666.
- 26. Rabe G, Wellmann J, Bagos P, Busch M, Hense H, Spies C, et al. Efficacy of emergency department initiated tobacco control.Systematic review and meta-analysis of randomized controlled trials. Nicotine & Tobacco Research. 2013;15(3):643–55. 2013-09864-004.
- 27. Stead L F, Koilpillai P, Fanshawe T R, Lancaster T. Combined pharmacotherapy and behavioural interventions for smoking cessation. Cochrane Database of Systematic Reviews [Internet]. 2016; (3). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD008286.pub3/abstract; http://onlinelibrary.wiley.com/store/10.1002/14651858.CD008286.pub3/asset/CD008286.pdf?v=1&t=ioif8zin&s=0efea3419f5d11120bf2df4c7fc3bb44257b7a83.
- 28. Branscum P, Sharma M. A review of motivational interviewing-based interventions targeting problematic drinking among college students. Alcoholism Treatment Quarterly. 2010;28(1):63–77. 2010-07481-006.
- 29. McMurran M. Motivational interviewing with offenders: A systematic review. Legal and Criminological Psychology. 2009;14(1):83–100. 2009-02935-008.
- 30. Cowlishaw S, Merkouris S, Dowling N, Anderson C, Jackson A, Thomas S. Psychological therapies for pathological and problem gambling. Cochrane Database of Systematic Reviews [Internet]. 2012; (11). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD008937.pub2/abstracthttp://onlinelibrary.wiley.com/store/10.1002/14651858.CD008937.pub2/asset/CD008937.pdf?v=1&t=i2qmh2a4&s=24442e6c86853f078ee853bb6912770fd69af25b.
- 31. Hjorthøj C, Fohlmann A, Nordentoft M. Treatment of cannabis use disorders in people with schizophrenia spectrum disorders—A systematic review. Addictive Behaviors. 2009;34(6–7):520–5. 2009-07777-005. pmid:19268481
- 32. Laker C. How reliable is the current evidence looking at the efficacy of harm reduction and motivational interviewing interventions in the treatment of patients with a dual diagnosis? Journal of Psychiatric and Mental Health Nursing. 2007;14(8):720–6. 2007-18385-002. pmid:18039294
- 33. Baker A, Hiles S, Thornton L, Hides L, Lubman D. A systematic review of psychological interventions for excessive alcohol consumption among people with psychotic disorders. Acta Psychiatr Scand. 2012;126(4):243–55. pmid:22632145.
- 34. Baker A, Thornton L, Hiles S, Hides L, Lubman D. Psychological interventions for alcohol misuse among people with co-occurring depression or anxiety disorders: A systematic review. Journal of Affective Disorders. 2012;139(3):217–29. 2012-16582-003. pmid:21890213
- 35. Cleary M, Hunt G, Matheson S, Walter G. Psychosocial treatments for people with co-occurring severe mental illness and substance misuse: systematic review. J Adv Nurs. 2009;65(2):238–58. pmid:19016921.
- 36. de Man-van Ginkel J, Gooskens F, Schuurmans M, Lindeman E, Hafsteinsdottir T, Rehabilitation Guideline Stroke Working Group. A systematic review of therapeutic interventions for poststroke depression and the role of nurses. J Clin Nurs. 2010;19(23–24):3274–90. pmid:21083778.
- 37. Kelly T, Daley D, Douaihy A. Treatment of substance abusing patients with comorbid psychiatric disorders. Addict Behav. 2012;37(1):11–24. pmid:21981788; PubMed Central PMCID: PMC3196788.
- 38. Terplan M, Ramanadhan S, Locke A, Longinaker N, Lui S. Psychosocial interventions for pregnant women in outpatient illicit drug treatment programs compared to other interventions. Cochrane Database of Systematic Reviews [Internet]. 2015; (4). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD006037.pub3/abstract; http://onlinelibrary.wiley.com/store/10.1002/14651858.CD006037.pub3/asset/CD006037.pdf?v=1&t=ioig2s9v&s=fbc50772d8ebf81e1c60cf130a7a926f1b16f906.
- 39. Tanner-Smith EE, Lipsey MW. Brief alcohol interventions for adolescents and young adults: a systematic review and meta-analysis. J Subst Abuse Treat. 2015;51:1–18. pmid:25300577; PubMed Central PMCID: PMCPMC4346408.
- 40. Joseph J, Basu D, Krishnan N. Are nurse-conducted brief interventions (NCBIs) efficacious for hazardous or harmful alcohol use? A systematic review (Provisional abstract). Database of Abstracts of Reviews of Effects [Internet]. 2014; (2):[203–10 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12014021999/frame.html.
- 41. Gates P, Sabioni P, Copeland J, Le Foll B, Gowing L. Psychosocial interventions for cannabis use disorder. Cochrane Database of Systematic Reviews [Internet]. 2016; (5). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD005336.pub4/abstract; http://onlinelibrary.wiley.com/store/10.1002/14651858.CD005336.pub4/asset/CD005336.pdf?v=1&t=ioig2jkq&s=3973c2abe787bfb16f223d7cc0f1339d4e6d1ba4.
- 42. Cooper K, Chatters R, Kaltenthaler E, Wong R. Psychological and psychosocial interventions for cannabis cessation in adults: a systematic review short report. Health Technol Assess. 2015;19(56):1–130. pmid:26202542; PubMed Central PMCID: PMCPMC4781488.
- 43. Appiah-Brempong E, Okyere P, Owusu-Addo E, Cross R. Motivational interviewing interventions and alcohol abuse among college students: a systematic review (Provisional abstract). Database of Abstracts of Reviews of Effects [Internet]. 2014; (2):[e32-e42 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12014024502/frame.html.
- 44. Barrio P, Gual A. Patient-centered care interventions for the management of alcohol use disorders: a systematic review of randomized controlled trials. Patient preference and adherence. 2016;10:1823–45. pmid:27695301
- 45. Carey K, Scott-Sheldon L, Elliott J, Garey L, Carey M. Face-to-face versus computer-delivered alcohol interventions for college drinkers: a meta-analytic review, 1998 to 2010 (Structured abstract). Clinical Psychology Review [Internet]. 2012; 32(8):[690–703 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12012049936/frame.html.
- 46. Carey K, Scott-Sheldon L, Carey M, DeMartini K. Individual-level interventions to reduce college student drinking: a meta-analytic review. Addict Behav. 2007;32(11):2469–94. pmid:17590277; PubMed Central PMCID: PMC2144910.
- 47. Chatters R, Cooper K, Day E, Knight M, Lagundoye O, Wong R, et al. Psychological and psychosocial interventions for cannabis cessation in adults: A systematic review. Addiction Research & Theory. 2016;24(2):93–110. pmid:112337071. Language: English. Entry Date: 20160122. Revision Date: 20180516. Publication Type: Article.
- 48. Darker C, Sweeney B, Barry J, Farrell M, Donnelly-Swift E. Psychosocial interventions for benzodiazepine harmful use, abuse or dependence. The Cochrane database of systematic reviews. 2015;5:CD009652.
- 49. Foxcroft D, Coombes L, Wood S, Allen D, Almeida Santimano N. Motivational interviewing for alcohol misuse in young adults. The Cochrane database of systematic reviews. 2014;8:CD007025.
- 50. Gilinsky A V, Power K. Interventions delivered during antenatal care to reduce alcohol consumption during pregnancy: A systematic review. Addiction Research & Theory. 2011;19(3):235–50. 2011-08678-005.
- 51. Jiang S, Wu L, Gao X. Beyond face-to-face individual counseling: A systematic review on alternative modes of motivational interviewing in substance abuse treatment and prevention. Addictive behaviors. 2017;73:216–35. https://dx.doi.org/10.1016/j.addbeh.2017.05.023. pmid:28554033
- 52. Joseph J, Basu D. Efficacy of Brief Interventions in Reducing Hazardous or Harmful Alcohol Use in Middle-Income Countries: Systematic Review of Randomized Controlled Trials. Alcohol and alcoholism (Oxford, Oxfordshire). 2017;52(1):56–64. https://dx.doi.org/10.1093/alcalc/agw054.
- 53. Klimas J, Field C, Cullen W, O'Gorman C, Glynn Liam G, Keenan E, et al. Psychosocial interventions to reduce alcohol consumption in concurrent problem alcohol and illicit drug users. Cochrane Database of Systematic Reviews [Internet]. 2012; (11). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD009269.pub2/abstracthttp://onlinelibrary.wiley.com/store/10.1002/14651858.CD009269.pub2/asset/CD009269.pdf?v=1&t=i2qmh9bk&s=8643c3b4208684381ba8c57d902b242ca63d42f1.
- 54. Livingston J, Milne T, Fang M, Amari E. The effectiveness of interventions for reducing stigma related to substance use disorders: A systematic review. Addiction. 2012;107(1):39–50. 2011-29128-010. pmid:21815959
- 55. Seigers D, Carey K. Screening and brief interventions for alcohol use in college health centers: A review. Journal of American College Health. 2010;59(3):151–8. 2011-03610-003. pmid:21186444
- 56. Smedslund G, Berg R, Hammerstrøm K, Steiro A, Leiknes K, Dahl H et al. H. Motivational interviewing for substance abuse. Cochrane Database of Systematic Reviews [Internet]. 2011; (5). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD008063.pub2/abstracthttp://onlinelibrary.wiley.com/store/10.1002/14651858.CD008063.pub2/asset/CD008063.pdf?v=1&t=i2qmfc7p&s=9cd557e022d5878b20c45f506b715404da5f5945.
- 57. Terplan M, Lui S. Psychosocial interventions for pregnant women in outpatient illicit drug treatment programs compared to other interventions. Cochrane Database Syst Rev. 2007;(4):CD006037. pmid:17943878.
- 58. Vasilaki E, Hosier S, Cox W. The efficacy of motivational interviewing as a brief intervention for excessive drinking: A meta-analytic review. Alcohol and Alcoholism. 2006;41(3):328–35. 2006-05794-019. pmid:16547122
- 59. Boniface S, Malet-Lambert I, Coleman R, Deluca P, Donoghue K, Drummond C, et al. The Effect of Brief Interventions for Alcohol Among People with Comorbid Mental Health Conditions: A Systematic Review of Randomized Trials and Narrative Synthesis. Alcohol & Alcoholism. 2018;53(3):282–93. pmid:129422917. Language: English. Entry Date: 20180510. Revision Date: 20180519. Publication Type: Article. Journal Subset: Biomedical.
- 60. Laker CJ. How reliable is the current evidence looking at the efficacy of harm reduction and motivational interviewing interventions in the treatment of patients with a dual diagnosis? (Structured abstract). Journal of Psychiatric and Mental Health Nursing [Internet]. 2007; 14(8):[720–6 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12008009123/frame.html.
- 61. Baker AL, Thornton LK, Hiles S, Hides L, Lubman DI. Psychological interventions for alcohol misuse among people with co-occurring depression or anxiety disorders: a systematic review (Structured abstract). Journal of Affective Disorders [Internet]. 2012; 139(3):[217–29 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12012029787/frame.html.
- 62. Cowlishaw S, Kessler D. Problem Gambling in the UK: Implications for Health, Psychosocial Adjustment and Health Care Utilization. Eur Addict Res. 2016;22(2):90–8. pmid:26343859.
- 63. Petry N, Ginley M, Rash C. Systematic review of gambling. Psychology of addictive behaviors: journal of the Society of Psychologists in Addictive Behaviors. 2017;31(8):951–61. https://dx.doi.org/10.1037/adb0000290.
- 64. Cascaes A, Bielemann R, Clark V, Barros A. Effectiveness of motivational interviewing at improving oral health: a systematic review. Revista de saude publica. 2014;48(1):142–53. pmid:24789647
- 65. Kay E, Vascott D, Hocking A, Nield H. Motivational interviewing in general dental practice: A review of the evidence. British dental journal. 2016;221(12):785–91. Epub 2016/12/17. pmid:27982007.
- 66. Kopp S, Ramseier C, Ratka-Kruger P, Woelber J. Motivational Interviewing As an Adjunct to Periodontal Therapy-A Systematic Review. Frontiers in psychology. 2017;8:279. https://dx.doi.org/10.3389/fpsyg.2017.00279.
- 67. Werner H, Hakeberg M, Dahlstrom L, Eriksson M, Sjogren P, Strandell A, et al. Psychological Interventions for Poor Oral Health: A Systematic Review. Journal of dental research. 2016;95(5):506–14. https://dx.doi.org/10.1177/0022034516628506. pmid:26826109
- 68. Gao X, Lo E, Kot S, Chan K. Motivational interviewing in improving oral health: a systematic review of randomized controlled trials. J Periodontol. 2014;85(3):426–37. pmid:23805818.
- 69. Dray J, Tracey D. Is the transtheoretical model and motivational interviewing approach applicable to the treatment of eating disorders? A review. Clinical Psychology Review. 2012;32(6):558–65. 2012-22130-012. pmid:22819997
- 70. Macdonald P, Hibbs R, Corfield F, Treasure J. The use of motivational interviewing in eating disorders: A systematic review. Psychiatry Research. 2012;200(1):1–11. 2012-16485-001. pmid:22717144
- 71. Armstrong M, Mottershead T, Ronksley P, Sigal R, Campbell T, Hemmelgarn B. Motivational interviewing to improve weight loss in overweight and/or obese patients: a systematic review and meta-analysis of randomized controlled trials. Obes Rev. 2011;12(9):709–23. pmid:21692966.
- 72. Barnes R, Ivezaj V. A systematic review of motivational interviewing for weight loss among adults in primary care. Obesity reviews: an official journal of the International Association for the Study of Obesity. 2015;16(4):304–18.
- 73. Hill B, Skouteris H, Fuller-Tyszkiewicz M. Interventions designed to limit gestational weight gain: a systematic review of theory and meta-analysis of intervention components. Obes Rev. 2013;14(6):435–50. pmid:23534901.
- 74. VanWormer J, Boucher J. Motivational interviewing and diet modification: a review of the evidence (Provisional abstract). Diabetes Educator [Internet]. 2004; 30(3):[404–16 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12004001639/frame.html.
- 75. Clifford Mulimba A, Byron-Daniel J. Motivational interviewing-based interventions and diabetes mellitus (Provisional abstract). British Journal of Nursing [Internet]. 2014; 23(1):[8–14 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12014006260/frame.html.
- 76. Ekong G, Kavookjian J. Motivational interviewing and outcomes in adults with type 2 diabetes: A systematic review. Patient education and counseling. 2016;99(6):944–52. https://dx.doi.org/10.1016/j.pec.2015.11.022. pmid:26699083
- 77. Jones A, Gladstone B, Lubeck M, Lindekilde N, Upton D, Vach W. Motivational interventions in the management of HbA1c levels: a systematic review and meta-analysis (Provisional abstract). Database of Abstracts of Reviews of Effects [Internet]. 2014; (2):[91–100 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12014015299/frame.html.
- 78. Lin C, Chiang S, Tzeng W, Chiang L. Systematic review of impact of lifestyle-modification programs on metabolic risks and patient-reported outcomes in adults with metabolic syndrome. Worldviews Evid Based Nurs. 2014;11(6):361–8. pmid:25488565.
- 79. Soderlund P. Effectiveness of motivational interviewing for improving physical activity self-management for adults with type 2 diabetes: A review. Chronic Illness. 2018;14(1):54–68. pmid:29226694. Language: English. Entry Date: 20180307. Revision Date: 20180307. Publication Type: Article.
- 80. Thepwongsa I, Muthukumar R, Kessomboon P. Motivational interviewing by general practitioners for Type 2 diabetes patients: a systematic review. Family practice. 2017;34(4):376–83. https://dx.doi.org/10.1093/fampra/cmx045. pmid:28486622
- 81. Cheng D, Qu Z, Huang J, Xiao Y, Luo H, Wang J. Motivational interviewing for improving recovery after stroke. Cochrane Database Syst Rev. 2015;6(6):CD011398. pmid:26037617.
- 82. Hildebrand M. Effectiveness of interventions for adults with psychological or emotional impairment after stroke: An evidence-based review. American Journal of Occupational Therapy. 2015;69(1):6901180050p1-9.
- 83. Lee W, Choi K, Yum R, Yu D, Chair S. Effectiveness of motivational interviewing on lifestyle modification and health outcomes of clients at risk or diagnosed with cardiovascular diseases: A systematic review. Int J Nurs Stud. 2016;53:331–41. pmid:26493130.
- 84. Berg R, Ross M, Tikkanen R. The effectiveness of MI4MSM: How useful is motivational interviewing as an HIV risk prevention program for men who have sex with men? A systematic review. AIDS Education and Prevention. 2011;23(6):533–49. 2011-29905-005. pmid:22201237
- 85. Carrico A, Zepf R, Meanley S, Batchelder A, Stall R. Critical review: When the party is over: A systematic review of behavioral interventions for substance-using men who have sex with men. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2016;73(3):299–306. 2016-52706-010. pmid:27258233
- 86. Dillard P, Zuniga J, Holstad M. An integrative review of the efficacy of motivational interviewing in HIV management. Patient Education & Counseling. 2017;100(4):636–46. pmid:122328487. Language: English. Entry Date: 20180108. Revision Date: 20180424. Publication Type: journal article.
- 87. Wilson A, Nirantharakumar K, Truchanowicz E, Surenthirakumaran R, MacArthur C, Coomarasamy A. Motivational interviews to improve contraceptive use in populations at high risk of unintended pregnancy: a systematic review and meta-analysis. European journal of obstetrics, gynecology, and reproductive biology. 2015;191:72–9. pmid:26093351
- 88. Naar-King S, Parsons J, Johnson A. Motivational interviewing targeting risk reduction for people with HIV: a systematic review. Curr HIV/AIDS Rep. 2012;9(4):335–43. pmid:22890780.
- 89. Al-Ganmi A, Perry L, Gholizadeh L, Alotaibi A. Cardiovascular medication adherence among patients with cardiac disease: a systematic review. Journal of advanced nursing. 2016;72(12):3001–14. https://dx.doi.org/10.1111/jan.13062. pmid:27377689
- 90. Binford M, Kahana SY, Altice FL. A systematic review of antiretroviral adherence interventions for HIV-infected people who use drugs. Curr HIV/AIDS Rep. 2012;9(4):287–312. pmid:22936463; PubMed Central PMCID: PMC3495269.
- 91. Easthall C, Song F, Bhattacharya D. A meta-analysis of cognitive-based behaviour change techniques as interventions to improve medication adherence (Provisional abstract). BMJ Open [Internet]. 2013; 3(8):[e002749 p.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12013049255/frame.html.
- 92. Nieuwlaat R, Wilczynski N, Navarro T, Hobson N, Jeffery R, Keepanasseril A, et al. Interventions for enhancing medication adherence. Cochrane Database Syst Rev. 2014;11:CD000011. pmid:25412402.
- 93. Zomahoun H, Guenette L, Gregoire J-P, Lauzier S, Lawani A, Ferdynus C, et al. Effectiveness of motivational interviewing interventions on medication adherence in adults with chronic diseases: a systematic review and meta-analysis. International journal of epidemiology. 2017;46(2):589–602. https://dx.doi.org/10.1093/ije/dyw273. pmid:27864410
- 94. Hu D, Juarez D, Yeboah M, Castillo T. Interventions to increase medication adherence in African-American and Latino populations: a literature review. Hawaii J Med Public Health. 2014;73(1):11–8. pmid:24470982; PubMed Central PMCID: PMCPMC3901167.
- 95. Palacio A, Garay D, Langer B, Taylor J, Wood B, Tamariz L. Motivational Interviewing Improves Medication Adherence: a Systematic Review and Meta-analysis. Journal of general internal medicine. 2016;31(8):929–40. https://dx.doi.org/10.1007/s11606-016-3685-3. pmid:27160414
- 96. Hill S, Kavookjian J. Motivational interviewing as a behavioral intervention to increase HAART adherence in patients who are HIV-positive: A systematic review of the literature. AIDS Care. 2012;24(5):583–92. 2012-11855-006. pmid:22292452
- 97. Rueda S, Park-Wyllie Laura Y, Bayoumi A, Tynan A, Antoniou T, Rourke S, et al. Patient support and education for promoting adherence to highly active antiretroviral therapy for HIV/AIDS. Cochrane Database of Systematic Reviews [Internet]. 2006; (3). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD001442.pub2/abstract.
- 98. Karmali Kunal N, Davies P, Taylor F, Beswick A, Martin N, Ebrahim S. Promoting patient uptake and adherence in cardiac rehabilitation. Cochrane Database of Systematic Reviews [Internet]. 2014; (6). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD007131.pub3/abstract; http://onlinelibrary.wiley.com/store/10.1002/14651858.CD007131.pub3/asset/CD007131.pdf?v=1&t=ioig22rk&s=e2dd028ffe00c7a62f19317069105176b6785a29.
- 99. Miller S, Foran-Tuller K, Ledergerber J, Jandorf L. Motivational interviewing to improve health screening uptake: A systematic review. Patient education and counseling. 2017;100(2):190–8. https://dx.doi.org/10.1016/j.pec.2016.08.027. pmid:27599713
- 100. Lawrence P, Fulbrook P, Somerset S, Schulz P. Motivational interviewing to enhance treatment attendance in mental health settings: A systematic review and meta-analysis. Journal of psychiatric and mental health nursing. 2017;24(9–10):699–718. https://dx.doi.org/10.1111/jpm.12420. pmid:28816412
- 101. Spencer J, Wheeler S. A systematic review of Motivational Interviewing interventions in cancer patients and survivors. Patient education and counseling. 2016;99(7):1099–105. https://dx.doi.org/10.1016/j.pec.2016.02.003. pmid:26879805
- 102. Alperstein D, Sharpe L. The Efficacy of Motivational Interviewing in Adults With Chronic Pain: A Meta-Analysis and Systematic Review. J Pain. 2016;17(4):393–403. pmid:26639413.
- 103. Chilton R, Pires-Yfantouda R, Wylie M. A systematic review of motivational interviewing within musculoskeletal health. Psychology, Health & Medicine. 2012;17(4):392–407. 2012-18217-002.
- 104. Wagoner S, Kavookjian J. The Influence of Motivational Interviewing on Patients With Inflammatory Bowel Disease: A Systematic Review of the Literature. Journal of clinical medicine research. 2017;9(8):659–66. https://dx.doi.org/10.14740/jocmr3081w. pmid:28725313
- 105. Shingleton R, Palfai TP. Technology-delivered adaptations of motivational interviewing for health-related behaviors: A systematic review of the current research. Patient education and counseling. 2016;99(1):17–35. https://dx.doi.org/10.1016/j.pec.2015.08.005.
- 106. Burke B, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003;71(5):843–61. pmid:14516234.
- 107. Dunn C, Deroo L, Rivara FP. The use of brief interventions adapted from motivational interviewing across behavioral domains: A systematic review. Addiction. 2001;96(12):1725–42. 2001-09576-001. pmid:11784466
- 108. Lundahl B, Kunz C, Brownell C, Tollefson D, Burke B. A meta-analysis of motivational interviewing: twenty-five years of empirical studies (Provisional abstract). Research on Social Work Practice [Internet]. 2010; 20(2):[137–60 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12010003750/frame.html.
- 109. Martins R, McNeil D. Review of Motivational Interviewing in promoting health behaviors. Clin Psychol Rev. 2009;29(4):283–93. pmid:19328605.
- 110. Thompson D, Chair S, Chan S, Astin F, Davidson P, Ski C. Motivational interviewing: a useful approach to improving cardiovascular health? J Clin Nurs. 2011;20(9–10):1236–44. pmid:21492271.
- 111. O’Halloran P, Blackstock F, Shields N, Holland A, Iles R, Kingsley M, et al. Motivational interviewing to increase physical activity in people with chronic health conditions: A systematic review and meta-analysis. Clinical Rehabilitation. 2014;28(12):1159–71. 2014-48880-002. pmid:24942478
- 112. Kohler S, Hofmann A. Can motivational interviewing in emergency care reduce alcohol consumption in young people? A systematic review and meta-analysis. Alcohol and alcoholism (Oxford, Oxfordshire). 2015;50(2):107–17.
- 113. Merz V, Baptista J, Haller D. Brief interventions to prevent recurrence and alcohol-related problems in young adults admitted to the emergency ward following an alcohol-related event: a systematic review. J Epidemiol Community Health. 2015;69(9):912–7. pmid:25841242.
- 114. Noordman J, Weijden T, Dulmen S. Communication-related behavior change techniques used in face-to-face lifestyle interventions in primary care: a systematic review of the literature (Structured abstract). Patient Education and Counseling [Internet]. 2012; 89(2):[227–44 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12012055644/frame.html.
- 115. Taggart J, Williams A, Dennis S, Newall A, Shortus T, Zwar N, et al. A systematic review of interventions in primary care to improve health literacy for chronic disease behavioral risk factors. BMC family practice. 2012;13:49. pmid:22656188; PubMed Central PMCID: PMC3444864.
- 116. VanBuskirk K, Wetherell J. Motivational interviewing with primary care populations: a systematic review and meta-analysis (Provisional abstract). Journal of Behavioral Medicine [Internet]. 2014; 37(4):[768–80 pp.]. Available from: http://onlinelibrary.wiley.com/o/cochrane/cldare/articles/DARE-12013048261/frame.html http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4118674/pdf/nihms587843.pdf.
- 117. Purath J, Keck A, Fitzgerald CE. Motivational interviewing for older adults in primary care: a systematic review. Geriatr Nurs. 2014;35(3):219–24. pmid:24656051.
- 118. Knight K, McGowan L, Dickens C, Bundy C. A systematic review of motivational interviewing in physical health care settings. Br J Health Psychol. 2006;11(Pt 2):319–32. pmid:16643702.
- 119. Lai D TCC K, Qin Y, Tang JL. Motivational interviewing for smoking cessation. Cochrane Database of Systematic Reviews [Internet]. 2010; (1). Available from: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD006936.pub2/abstracthttp://onlinelibrary.wiley.com/store/10.1002/14651858.CD006936.pub2/asset/CD006936.pdf?v=1&t=i2qm2k89&s=f678980a22a781079494f2eea1cf91e1aeb8a402.
- 120. Mathes T, Pieper D, Antoine S, Eikermann M. Adherence-enhancing interventions for highly active antiretroviral therapy in HIV-infected patients—a systematic review. HIV medicine. 2013;14(10):583–95. pmid:23773654.
- 121. Dombrowski S, O'Carroll R, Williams B. Form of delivery as a key 'active ingredient' in behaviour change interventions. Br J Health Psychol. 2016;21(4):733–40. pmid:27709824.
- 122. Cuijpers P, van Straten A, Bohlmeijer E, Hollon S, Andersson G. The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size. Psychol Med. 2010;40(2):211–23. pmid:19490745.
- 123. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690–701. pmid:19916637.
- 124. Kohl H, Craig C, Lambert E, Inoue S, Alkandari J, Leetongin G, et al. The pandemic of physical inactivity: global action for public health. Lancet. 2012;380(9838):294–305. S0140-6736(12)60898-8 [pii]; pmid:22818941
- 125. Hall K, Staiger P, Simpson A, Best D, Lubman D. Continuing the conversation: 30 years of motivational interviewing dissemination. Addiction. 2016;111(7):1158–9. Epub 2016/06/09. pmid:27273385.
- 126. Miller W, Rollnick S. Ten things that motivational interviewing is not. Behav Cogn Psychother. 2009;37(2):129–40. Epub 2009/04/15. pmid:19364414.
- 127. Jelsma J, Mertens V, Forsberg L, Forsberg L. How to Measure Motivational Interviewing Fidelity in Randomized Controlled Trials: Practical Recommendations. Contemp Clin Trials. 2015;43:93–9. pmid:25962891.
- 128. Miller W, Rollnick S. The effectiveness and ineffectiveness of complex behavioral interventions: impact of treatment fidelity. Contemp Clin Trials. 2014;37(2):234–41. pmid:24469237.
- 129. Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84. pmid:26030634.
- 130. Hall K, Staiger P, Simpson A, Best D, Lubman DI. After 30 years of dissemination, have we achieved sustained practice change in motivational interviewing? Addiction. 2016;111(7):1144–50. Epub 2015/07/29. pmid:26216706.
- 131. Moher D, Glasziou P, Chalmers I, Nasser M, Bossuyt P, Korevaar D, et al. Increasing value and reducing waste in biomedical research: who's listening? Lancet. 2016;387(10027):1573–86. Epub 2015/10/02. pmid:26423180.
- 132. Chalmers I, Glasziou P. Systematic reviews and research waste. Lancet. 2016;387(10014):122–3. Epub 2016/02/05. pmid:26841991.