Abstract

Background. Migraine is a common neurological disease, which burdens individuals and society all over the world. Acupuncture, an important method in Traditional Chinese Medicine, is widely used in clinical practice as a treatment for migraine. Several systematic reviews (SRs) have investigated the effectiveness and safety of acupuncture for migraine. Objective. To summarize and critically assess the quality of relevant SRs and present an objective and comprehensive evidence on the effectiveness and safety of acupuncture for migraine. Data Sources. MEDLINE, Embase, Cochrane Library, PROSPERO database, Chinese National Knowledge Infrastructure (CNKI), Chinese Biological Medicine (CBM), China Science and Technology Journal (SCTJ), and WanFang database (WF) were searched from inception to December 2019 and grey literatures were manually searched. Selection Criteria. SRs which meet the criteria were independently selected by 2 reviewers according to a predetermined protocol. Data Extraction. Characteristics of included SRs were independently extracted by 2 reviewers following a predefined data extraction form. Review Appraisal. The methodological quality, risk of bias, and reporting quality of included SRs were assessed, respectively, by a Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, the Risk of Bias in Systematic reviews (ROBIS) tool, and the Preferred Reporting Item for Systematic Review and Meta-analysis-Acupuncture (PRISMA-A) statement. The quality of outcomes was evaluated by the Grading of Recommendations Assessment, Development, and Evaluation (GRADE). Results. A total of 15 SRs were included. All the SRs were published between 2011–2019. Based on AMSTAR 2, 14 out of 15 SRs were rated critically low quality and 1 was rated low quality. According to ROBIS tool, 9 SRs (60%) were low risk of bias. With the PRISMA-A checklist, we found 11 out of 15 SRs were found adequately reported over 70%. With the GRADE tool, we found high quality of evidence indicated that the effective rate of acupuncture was superior to western medicine in treatment of migraine. Besides, acupuncture reduced more headache days and the times of using painkiller and was more effective in reducing the frequency and degree of headache than western medicine and sham acupuncture. Limitations. There might be some missing information. The accuracy of the conclusions may be decreased reduced since we were unable to synthesis all the evidence. Conclusions. Based on high quality of evidence, we concluded that acupuncture may be an effective and safe therapy for migraine. However, the quality of SRs in acupuncture for migraine still needs more improvement.

1. Introduction

Migraine is a common neurological disease characterized by unilateral, throbbing recurrent headache, often accompanied by photophobia, phonophobia, or nausea [1]. According to the epidemiological statistics, the prevalence of migraine is 3.3%∼32.6% in female and 0.7%∼16.1% in male [2]. At the same time, it costs between 6.5 and 17 billion dollars annually in the USA which severely burdened individuals and society [3, 4]. In the Global Burden of Disease Survey 2010, migraine ranked as the 3rd most prevalent disorder and 7th highest specific cause of disability worldwide [5, 6]. The standard treatments for migraine include nonsteroidal anti-inflammatory drugs, antiepileptic drugs, ergotamines, and triptans. However, these pharmacotherapies were often accompanied with undesirable adverse effects [7], such as fatigue, sleep disturbance, nausea, and vomiting [8] which lead to poor compliance of patients. Therefore, more and more patients are seeking for effective nonpharmacological alternative treatments.

Acupuncture, an important method in Traditional Chinese Medicine, is widely used in clinical practice as a treatment for migraine. It is reported that acupuncture was one of the most common complementary therapies in worldwide [9]. In German-speaking countries, acupuncture has high utilization and is one of the most primarily used methods to relieve pain [10]. Now, it is increasingly accepted in western countries as an alternative treatment for migraine and other pain conditions [11]. The results of clinical studies have demonstrated that acupuncture is an effective and safe therapeutic approach to treat migraine [1214]. With the development of evidence-based medicine, numerous systematic reviews (SRs) have been conducted to investigate the effectiveness and safety of acupuncture for migraine. However, the results of these SRs often have limitations which may lower the quality of conclusions and mislead the patients, clinical doctors, and policy makers.

Overviews of SRs, a method to evaluate the quality of evidence [15], is becoming more and more prevalent in evidence-based medicine [16]. The overview is a comprehensive approach to reassess the quality of SRs by collecting the information of relevant SRs dealing with the same disease or health problem [17]. While SR has always been regarded as one of the most important sources of high quality and reliable information in the evidence-based medicine [18], there are many factors in the evaluation process which can decrease the quality of SRs, such as incomprehensive source of literature, inadequate evaluation method, and publication bias. Overview of SRs comprehensively integrated the evidence of SRs, which contains more information and can provide more high-quality evidence for clinical work.

This is the first overview which comprehensively assessed SRs of acupuncture for migraine with a Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, the Risk of Bias in Systematic reviews (ROBIS), Preferred Reporting Item for Systematic Review and Meta-analysis-Acupuncture (PRISMA-A), and the Grades of Recommendations, Assessment, Development and Evaluation (GRADE). The objective of this overview is to critically assess the quality of relevant SRs and present an objective and comprehensive evaluation on effectiveness and safety of acupuncture for migraine, which can help the public and policy-makers understand whether acupuncture should be recommended as a treatment for migraine.

2. Methods

2.1. Registration

A predetermined written protocol of this overview was registered in the PROSPERO (International prospective register of systematic overview) database (https://www.crd.york.ac.uk/PROSPERO/), registration number: CRD42017077218. This overview was reported in accordance with the guideline of the pilot version checklist with Preferred Reporting Items for overview of systematic reviews (PRIO-harms) [19].

2.2. Ethics

Ethics approval is not required in overview of SRs, since it does not involve individual patient data.

2.3. Inclusion Criteria
2.3.1. Types of Reviews

SRs with or without meta-analysis of randomized controlled trials (RCTs) were included in which acupuncture was used as treatment for migraine.

2.3.2. Types of Participants

SRs included RCT recruiting participants diagnosed with migraine according to standard diagnostic criteria (e.g., the International Classification of Headache Disorders released by the International Headache Society or other domestic standards). There was no restriction on the gender, age, race, duration, intensity, condition, and source of the patients.

2.3.3. Types of Interventions

There was no restriction on the types of acupuncture (e.g., body acupuncture, electroacupuncture, auricular acupuncture, warm-acupuncture, and scalp acupuncture).

2.3.4. Types of Comparators

SRs included control groups which were treated with sham-acupuncture, placebo, medicine, and other types of nonpharmaceutical therapy or placed in the waiting list.

2.3.5. Types of Outcomes

The primary outcome was effective rate. Secondary outcomes included intensity, frequency or duration of headache, times of using painkiller, quality of life, recurrent rate, and adverse effects of acupuncture in migraine.

2.4. Exclusion Criteria

The SRs were excluded if one of the following criteria was met: did not use the diagnostic criteria of migraine mentioned above; SRs with network meta-analysis or indirect comparison; SRs that included retrospective studies, prospective studies, cross-sectional clinical studies, and case reports; SRs whose data could not be extracted; duplicated publication; review comments.

2.5. Search Strategy

An electronic literature search was conducted in the MEDLINE, Embase, Cochrane Library, PROSPERO database, Chinese National Knowledge Infrastructure (CNKI), Chinese Biological Medicine (CBM) database, Chinese Science and Technology Periodical Database (SCTJ), and WanFang database, all from the inception to December 2019. Details of search strategy were presented in Supplementary Table S1. In addition, reference lists/bibliographies of included studies, study registries, and grey literature, such as dissertations and conference reports, were also searched to avoid missing studies. Besides, the experts in the field were also consulted. No language restrictions were applied.

2.6. Screening

The reviewer (JZ) searched the databases according to the predeveloped standardized search strategy. All the retrieved literatures were imported into Endnote X8. Two reviewers (HY and YXL) independently screened for candidates according to the inclusion and exclusion criteria by reading the title and abstract. Then, the full texts were downloaded for further screening. At the same time, bibliographic references were also reviewed to identify possible SRs. The disagreements were resolved by discussion. If necessary, the discrepancies were resolved by consulting the third reviewer (DLZ).

2.7. Data Extraction

A data extracted form was predefined, including the characteristics of SRs, such as author, title, published year, sample size, intervention, outcome indicators, quality evaluation method, and conclusion. Data was independently extracted by two reviewers (HY and LJL) using Microsoft Excel. After extraction, the two reviewers (LHS and YXL) cross checked to eliminate mis-entry. Discrepancies were resolved by team discussion or arbitrated by the third reviewer (DLZ).

2.8. Assessment of SRs

The assessment of included SRs was carried out independently by qualified reviewers who were trained in the Chinese Cochrane Center. Before the evaluation, each topic of the assessment tools was intensively discussed to achieve consensus. After evaluation, two reviewers cross checked the results. Discrepancies were resolved by team discussion or an independent decision form a third reviewer.(1)AMSTAR 2 [20] was used to assess the methodological quality of included SRs. The checklist has 16 items, including 7 critical items (items 2, 4, 7, 9, 11, 13, and 15), which are used to critically assess the validity of an SR. Each item was evaluated as “yes” (a positive result), “partial yes” (partial adherence to the standard), and “no” (no information is provided to rate an item) according to adherence to the standard.(2)The aim of the ROBIS tool is to evaluate the level of bias presented in a systematic review. This tool assesses the level of bias across 4 domains of 2 phases: “study eligibility criteria,” “identification and selection of studies,” “data collection and study appraisal,” and “synthesis and findings”. Each domain has signaling questions and a judgment of concerns about risk of bias of the domain, and the results are rated as “high risk,” “low risk,” or “unclear risk” [21].(3)PRISMA-A statements an extension of PRISMA especially for acupuncture, which was published in 2019 [22]. It consists of a 27-item checklist and a 4-phase flow diagram, aiming to help authors improve the reporting quality of SRs on acupuncture interventions. Seven aspects of SRs include title, abstract, introduction, methods, results, discussion and funding. Response options for each item are “yes,” “no,” and “not applicable”. The completion of each item was presented as a ratio.(4)The quality of primary outcomes of included SRs was evaluated by the GRADE system [23]. The assessment of included SRs was carried out independently by qualified reviewers (JL and DLZ) who were trained in the GRADE Center in China (Lanzhou). The 5 key elements of GRADE influenced the quality of evidence including study limitations, inconsistency of results, indirectness of evidence, imprecision, and reporting bias. The quality of evidences of SRs was rated as “High,” “Moderate,” “Low,” and “Very Low”. Evidence based on RCTs began as high quality.

3. Results

3.1. Literature Search

We retrieved 457 records according to the search strategy. 11 duplicates were excluded by filtration, 445 papers were screened by titles and abstracts. 65 articles were considered eligible, and full-text papers were downloaded. After being reviewed by two reviewers independently, 50 SRs were excluded and 15 SRs [2438] were included for further analyses (Figure 1). The reasons for exclusion are presented in Supplementary Table S2.

3.2. Characteristics of SRs

The characteristics of included SRs are presented in Table 1. All the included SRs were published between 2011–2019, 6 of which were published in 2016 [21, 3134, 36]. The number of RCTs in SRs ranged from 2 to 33. 3 SRs were on prophylactic treatment for migraine [31, 33, 35], 1 SR on acute migraine [33], 1 SR for menstrual migraine [36], 1 SR for migraine without aura [37], and the others did not clearly stated the type of migraine. 11 SRs specified the diagnostic criteria of HIS (International Headache Society) or ICHD (International Classification of Headache Disorders), while 4 SRs [25, 27, 28, 32] did not report the diagnostic criteria. All the 15 SRs performed meta-analysis, 10 out of 15 SRs [2429, 31, 32, 35, 38] performed subgroup analysis, and only 4 SRs [30, 33, 34, 36, 38] conducted sensitivity analysis. The intervention was acupuncture, while comparators were mainly sham acupuncture and medications (ergotamine, ibuprofen, flunarizine, nimodipine, celecoxib, aspirin, somedon, sodium valproate, metoprolol, and topiramate). The outcomes of SRs were effective rate, intensity, and frequency or duration of headache. For the assessment of methodological quality, 2 SRs [24, 29] used the Jadad scale, 12 SRs [25, 26, 3034, 36, 38] used the Cochrane risk of bias tool, and the remaining 1 SR [27] did not report any specific tool but described 6 aspects of quality assessment, including randomization, allocation concealment, blind method, data integrity, selective reporting, and other biases.

3.3. Methodological Quality of Included SRs

An overview of methodological quality of included SRs is presented in Table 2. Among the 15 SRs, 14 were rated critically low quality and 1 was rated low quality [37]. Items 2, 3, 7, 10, and 16 were rated particularly low quality. All SRs used satisfactory techniques to assess the risk of bias. Only 1 SR [37] established a prior study protocol and 2 [28, 36] reported the funding sources of the included studies. No SR explained the reasons for selection of study types or provided a complete list of excluded studies with reasons. And, few SRs assessed publication bias by a funnel plot.

3.4. Risk of Bias of Included SRs

The ROBIS tool, containing 3 phases with 4 domains, was used to assess the risk of bias of included SRs. Phase 1 assesses the relevance of research question, which is optional and was not performed in our study. Table 3 and Figure 2 present the assessment of risk of bias of each SR. Domain 1 assessed concerns regarding specification of study eligibility criteria, and 12 of 15 SRs (80%) were rated low risk of bias. Domain 2 assessed concerns regarding methods used to identify and select studies, in which 9 SRs (60%) were in low risk of bias. Domain 3 assessed concerns regarding methods used to collect data and appraise studies, and 11 SRs (73%) were at low risk of bias and 1 [24] unclear risk of bias. Domain 4 assessed concerns regarding the synthesis and findings, and 8 SRs (53%) were rated as low risk of bias. The final phase considered the overall risk of bias of SRs, and 9 SRs (60%) were low risk of bias.

3.5. Reporting Quality of Included SRs

Table 4 presents the overview of PRISMA-A checklist items. 11 out of 15 SRs were adequately reported over 70%. The section of title, abstract, and introduction were all well reported (100%). Though in Section 2, topic of protocol and registration, search strategy, study selection, data items, risk of bias, and additional analyses were reported inadequately, three topics (study selection, risk of bias across studies, and additional analysis) in Section 3 were reported under 70%. Of all the items, protocol and registration (13.33%), search strategy (33.33%), risk of bias in individual studies (33.33%), and risk of bias across studies (33.33%) accounted for the main reporting limitations. Overall, 4 SRs [26, 3638] reached over 85% compliance.

3.6. Effectiveness of Acupuncture for Migraine

We summarized the outcomes from the included SRs and presented them in Table 5. The evidence suggested that the effective rate of acupuncture was superior to western medicine (risk ratio (RR) = 1.17, 95% confidence interval (CI) = (1.12, 1.22), ) [26]. Acupuncture had better long-term effective rate for migraine (RR = 4.17, 95% CI (2.80, 6. 20), ) [34, 35] and reduced more headache days (standardized mean difference (SMD) = −0.13, 95% CI = (−0.25, −0.02), ) and the times of using painkiller (SMD = −0.73, 95% CI = (−2.14, 0.69), ) than western medicine and sham acupuncture, both in short-term and long-term follow-up [33, 35]. Besides, acupuncture was more effective in reducing frequency (SMD = −2.18, 95% CI = (−2.61, −1.75), ) and degree of headache (SMD = −1.93, 95% CI = (−2.53, −1.36), ) than western medicine and sham acupuncture [31, 35]. One SR [25] reported more effective rate of acupuncture than Chinese herbal medicine in treating migraine (RR = 1.29, 95% CI = (1.14, 1.45), ).

3.7. Evidence Quality of Included SRs

We evaluated the quality of primary outcomes extracted from included studies. Table 6 shows the level of evidence quality of studies reported effective rate. The high level of evidence quality indicated that the effective rate of acupuncture was superior than western medicine, both in short-term and long-term. The inconsistency and imprecision were the main reasons for downgrading. Significant heterogeneity downgraded inconsistency and imprecision was downgraded because the total sample size did not meet the optimal information size.

3.8. Safety of Acupuncture for Migraine

Of all the 15 SRs, 8 SRs [26, 30, 31, 3337] mentioned the adverse events of acupuncture in the treatment of migraine. 2 SRs [30, 36] did not further analyze the safety evaluation due to the small number of studies. 6 SRs [26, 31, 3335, 37] concluded that acupuncture treatment had fewer adverse events than medication, which indicated that acupuncture was a safe therapy for migraine.

4. Discussion

4.1. Summary of Main Findings

This is the first overview of SRs that investigate the effectiveness and safety of acupuncture for migraine. We rigorously appraised the published SRs with AMSTAR 2, ROBIS, PRISMA-A, and GRADE. Based on AMSTAR 2, 14 out of 15 SRs were rated critically low quality and 1 was rated low quality. By using the ROBIS tool, 9 SRs were rated low risk bias. With PRISMA-A checklist, we found 11 out of 15 SRs were found adequately reported over 70%. The results of GRADE suggested that acupuncture was is an effective and safe method for migraine.

4.2. Implications for Further Study

This overview presents several challenges for producers of SRs that should be considered. By using the ROBIS tool, we found that the risk of bias in domain 2 and domain 4 of phase 2 were relatively high. In domain 2, we focused on the risk of bias in identification and selection of studies. The results indicated that the reviewers of SR should pay attention to whether the search includes an appropriate range of databases or electronic sources for published reports. Instead of database searching, the additional methods should also be used to identify relevant reports, including conference reports and clinical trial registration platforms. In domain 4, the risk of bias in synthesis of findings was high. Even though the data was synthesized in all the SRs, we were not able to determine whether data synthesis and analysis methods have been followed in advance, which may ignore the results of some studies. The robustness of the findings should be assessed through funnel plot or sensitivity analyses, and the biases in primary studies should be minimized or addressed in the synthesis.

The PRISMA-A statement provided the basis for the author to improve the reporting quality of the SRs with acupuncture as intervention. According to the results of the PRISMA score, the lowest report rate (13.33%) was in the protocol and registration section. Only 2 SRs managed to offer a protocol or registration number of SR. An advance registration helps promote transparency, minimize potential bias in the conducting and reporting review, reduce duplication of effort between groups, and keep SRs updated. [39] A free and open database, the International Prospective Register of Systematic Reviews (PROSPERO, http://www.crd.york.ac.uk/prospero), has been advocated and recommended for reviewers to avoid bringing bias in SRs. In order to achieve a better quality of evidence, the researchers need to strictly control the risk of bias with reference to the ROBIS tool when conducting SRs/meta-analyses. In accordance with the requirements of the PRISMA-A statement, writing a SR/meta-analysis helps to get better reporting quality.

In the assessment of evidence quality with GRADE tool, we found that the biggest reason for downgrading was inconsistencies among studies, owing to the high I2 value and statistically significant heterogeneity of effect estimates. The GRADE guideline suggests, when it comes to inconsistency, SR authors should generate and test a small number of a priori hypotheses related to patients, interventions, outcomes, and methodology to explore the sources of heterogeneity [40].

4.3. Strength and Limitations

There are some strength in our study; firstly, this overview is the first to systematically evaluated the methodological quality and reporting quality of SRs in acupuncture for migraine. Secondly, we combined the latest high-quality evidence of SRs to provide a more convinced evidence for clinical work. Thirdly, we started this overview with a predesigned protocol, which helped reduce the risk of bias.

In addition to the strengths, there are several limitations to be noted. Firstly, there might be some missing information since we only gathered studies in English and Chinese. Secondly, we were unable to synthesize all the evidence, which may decrease the accuracy of the conclusions.

5. Conclusions

Based on high quality of evidence, we conclude that acupuncture is more effective and safer than medication or sham acupuncture in the treatment of migraine. However, the methodological quality, risk of bias, and reporting quality of SRs in acupuncture for migraine still needs improvement in future.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Yu-Xi Li, Xi-li Xiao, and Dong-Ling Zhong contributed equally to this work. JL, HZ, and RJJ were involved conceptualization. YXL, XLX, and DLZ wrote the original draft. JL, MXH, and LHS wrote, reviewed, and edited the article. HY, LJL, and JZ were involved in the methodology. DLZ and YXL performed the formal analysis. MXH and LHS were responsible for the data curation. All authors read and approved the publication of this overview.

Acknowledgments

We would like to thank Professor Yao-Long Chen and Mr. NanYang from GRADE center in China (Lanzhou) for their assistance with the GRADE assessment. This work was supported by the National Natural Science Foundation of China (grant nos. 81873356 and 81704137) and the Sichuan Science and Technology Program (grant nos. 2019YFS0019 and 2019YJ0331).

Supplementary Materials

S1 Appendix: search strategies. S2 Appendix 2: excluded systematic reviews. (Supplementary Materials)