Abstract
Animal models of ischaemic stroke have become an integral part of the preclinical pipeline for identifying novel neuroprotective drug targets and drugs. As the process serves as a filter, researchers do not expect complete concordance between the experimental animal and human clinical trial data. However, the paucity of clear examples of translation of promising animal results into drugs that work in a clinical setting has raised concerns about the utility of this translational paradigm. Preclinical systematic reviews have been used in response to these concerns to identify weaknesses in animal studies and provide empirical evidence supporting improvements to the design and conduct of preclinical animal experiments. We propose that further strategic development and application of data analysis methods can help continue this process of improvement and help identify the most promising therapeutic targets and drugs. These next steps in systematic review aim to tighten the focus of preclinical research, streamline the drug development process, and minimise research waste.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsAbbreviations
- ARRIVE:
-
Animal Research: Reporting of In Vivo Experiments
- CAMARADES:
-
Collaborative Approach to Meta-analysis and Review of Animal Data from Experimental Studies
- CONSORT:
-
Consolidated Standards of Reporting Trials
- EBPM:
-
Evidence-based Preclinical Medicine
- EDA:
-
Experimental Design Assistant
- EuroHYP-1:
-
European multicentre randomised, phase III clinical trial of hypothermia plus best medical treatment versus best medical treatment alone for acute ischaemic stroke
- FOCUS:
-
Fluoxetine or Control Under Supervision
- IL-1 RA:
-
Interleukin-1 receptor antagonist
- MeSH:
-
Medical Subject Headings
- NC3Rs:
-
National Centre for the Replacement Refinement and Reduction of Animals in Research
- NIH:
-
National Institutes of Health
- NINDS:
-
National Institutes of Neurological Disorders and Stroke
- NMDA:
-
N-methyl-d-aspartate
- PRISMA:
-
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- QUOROM:
-
Quality of Reporting of Meta-analyses
- SAINT:
-
Stroke -Acute Ischemic NXY Treatment
- STAIR:
-
Stroke Treatment academic industry roundtable
- SYRCLE:
-
Systematic Review Centre for Laboratory Animal Experimentation
- three Rs:
-
Replacement reduction and refinement
- tPA:
-
Tissue plasminogen activator
- UK:
-
United Kingdom
- US:
-
United States
References
Dirnagl U, Endres M (2014) Found in translation: preclinical stroke research predicts human pathophysiology, clinical phenotypes, and therapeutic outcomes. Stroke 45(5):1510–1518
O’Collins VE, Macleod MR, Donnan GA, Horky LL, van der Worp BH, Howells DW (2006) 1,026 experimental treatments in acute stroke. Ann Neurol 59(3):467–477
Sena ES, Briscoe CL, Howells DW, Donnan GA, Sandercock PA, Macleod MR (2010) Factors affecting the apparent efficacy and safety of tissue plasminogen activator in thrombotic occlusion models of stroke: systematic review and meta-analysis. J Cereb Blood Flow Metab 30(12):1905–1913
Shuaib A, Lees KR, Lyden P, Grotta J, Davalos A, Davis SM et al (2007) NXY-059 for the treatment of acute ischemic stroke. N Engl J Med 357(6):562–571
Macleod MR, van der Worp HB, Sena ES, Howells DW, Dirnagl U, Donnan GA (2008) Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality. Stroke 39(10):2824–2829
Greb E (2014) Magnesium treatment may not improve stroke outcome. Neurol Rev 22(3):5
O’Collins VE, Macleod MR, Cox SF, Van Raay L, Aleksoska E, Donnan GA et al (2011) Preclinical drug evaluation for combination therapy in acute stroke using systematic review, meta-analysis, and subsequent experimental testing. J Cereb Blood Flow Metab 31(3):962–975
Howells DW, Sena ES, Macleod MR (2014) Bringing rigour to translational medicine. Nat Rev Neurol 10(1):37–43
Tsilidis KK, Panagiotou OA, Sena ES, Aretouli E, Evangelou E, Howells DW et al (2013) Evaluation of excess significance bias in animal studies of neurological diseases. PLoS Biol 11(7), e1001609
Wegener G, Rujescu D (2013) The current development of CNS drug research. Int J Neuropsychopharmacol 16(7):1687–1693
Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gulmezoglu AM et al (2014) How to increase value and reduce waste when research priorities are set. Lancet 383(9912):156–165
Cochrane|Trusted evidence (c2004–2015) Informed decisions. Better health. [Internet]. The Cochrane Collaboration, Oxford. Available from: http://www.cochrane.org/
Schulz KF, Altman DG, Moher D, for the CG (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med 7(3):e1000251
Bunn F, Trivedi D, Alderson P, Hamilton L, Martin A, Pinkney E et al (2015) The impact of Cochrane Reviews: a mixed-methods evaluation of outputs from Cochrane Review Groups supported by the National Institute for Health Research. Health Technol Assess 19(28):1–100
Peters JL, Sutton AJ, Jones DR, Rushton L, Abrams KR (2006) A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting. J Environ Sci Health B 41(7):1245–1258
Mueller KF, Briel M, Strech D, Meerpohl JJ, Lang B, Motschall E et al (2014) Dissemination bias in systematic reviews of animal research: a systematic review. PLoS One 9(12), e116016
Vesterinen HM, Sena ES, Egan KJ, Hirst TC, Churolov L, Currie GL et al (2014) Meta-analysis of data from animal studies: a practical guide. J Neurosci Methods 221:92–102
Jerndal M, Forsberg K, Sena ES, Macleod MR, O’Collins VE, Linden T et al (2010) A systematic review and meta-analysis of erythropoietin in experimental stroke. J Cereb Blood Flow Metab 30(5):961–968
Macleod MR, O’Collins T, Horky LL, Howells DW, Donnan GA (2005) Systematic review and metaanalysis of the efficacy of FK506 in experimental stroke. J Cereb Blood Flow Metab 25(6):713–721
Macleod MR, O’Collins T, Howells DW, Donnan GA (2004) Pooling of animal experimental data reveals influence of study design and publication bias. Stroke 35(5):1203–1208
Sena E, Wheble P, Sandercock P, Macleod M (2007) Systematic review and meta-analysis of the efficacy of tirilazad in experimental stroke. Stroke 38(2):388–394
Sena ES, van der Worp HB, Bath PM, Howells DW, Macleod MR (2010) Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biol 8(3), e1000344
Lees JS, Sena ES, Egan KJ, Antonic A, Koblar SA, Howells DW et al (2012) Stem cell-based therapy for experimental stroke: a systematic review and meta-analysis. Int J Stroke 7(7):582–588
Krauth D, Woodruff TJ, Bero L (2013) Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121(9):985–992
Fisher M, Feuerstein G, Howells DW, Hurn PD, Kent TA, Savitz SI et al (2009) Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke 40(6):2244–2250
Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW et al (2012) A call for transparent reporting to optimize the predictive value of preclinical research. Nature 490(7419):187–191
Schifilliti D, Grasso G, Conti A, Fodale V (2010) Anaesthetic-related neuroprotection: intravenous or inhalational agents? CNS Drugs 24(11):893–907
Vesterinen HM, Connick P, Irvine CM, Sena ES, Egan KJ, Carmichael GG et al (2015) Drug repurposing: a systematic approach to evaluate candidate oral neuroprotective interventions for secondary progressive multiple sclerosis. PLoS One 10(4), e0117705
Sena E, van der Worp HB, Howells D, Macleod M (2007) How can we improve the pre-clinical development of drugs for stroke? Trends Neurosci 30(9):433–439
Egan KJ, Janssen H, Sena ES, Longley L, Speare S, Howells DW et al (2014) Exercise reduces infarct volume and facilitates neurobehavioral recovery: results from a systematic review and meta-analysis of exercise in experimental models of focal ischemia. Neurorehabil Neural Repair 28(8):800–812
Wheble PC, Sena ES, Macleod MR (2008) A systematic review and meta-analysis of the efficacy of piracetam and piracetam-like compounds in experimental stroke. Cerebrovasc Dis 25(1–2):5–11
Baker M (2016) 1,500 scientists lift the lid on reproducibility. Nature 533(7604):452–454
McCann SK, Cramond F, Macleod MR, Sena ES (2016) Systematic review and meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke: an update. Transl Stroke Res doi:10.1007/s12975-016-0489-z
Higgins JPT, Green S (2011) Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]: The Cochrane Collaboration. Available from: www.cochrane-handbook.org
Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ et al (2010) Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess 14(8):Iii, ix–xi, 1–193
Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC et al (2014) Increasing value and reducing waste: addressing inaccessible research. Lancet 383(9913):257–266
Banwell V, Sena ES, Macleod MR (2009) Systematic review and stratified meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke. J Stroke Cerebrovasc Dis 18(4):269–276
Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Reprint: good laboratory practice: preventing introduction of bias at the bench. Int J Stroke 4(1):3–5
Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Reprint: good laboratory practice: preventing introduction of bias at the bench. J Cereb Blood Flow Metab 29(2):221–223
Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Good laboratory practice: preventing introduction of bias at the bench. Stroke 40(3):e50–e52
Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG (2010) Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol 8(6), e1000412
Editorial (2013) Announcement: reducing our irreproducibility. Nature 496(7446):398.
van der Worp HB, Macleod MR, Bath PM, Demotes J, Durand-Zaleski I, Gebhardt B et al (2014) EuroHYP-1: European multicenter, randomized, phase III clinical trial of therapeutic hypothermia plus best medical treatment vs. best medical treatment alone for acute ischemic stroke. Int J Stroke 9:642–645
van der Worp HB, Sena ES, Donnan GA, Howells DW, Macleod MR (2007) Hypothermia in animal models of acute ischaemic stroke: a systematic review and meta-analysis. Brain 130(pt 12):3063–3074
Sena ES, Jeffreys AL, Cox SF, Sastra SA, Churilov L, Rewell S et al (2013) The benefit of hypothermia in experimental ischemic stroke is not affected by pethidine. Int J Stroke 8(3):180–185
McCann SK, Irvine C, Mead GE, Sena ES, Currie GL, Egan KE et al (2014) Efficacy of antidepressants in animal models of ischemic stroke: a systematic review and meta-analysis. Stroke 45(10):3055–3063
Mead G, Hackett ML, Lundstrom E, Murray V, Hankey GJ, Dennis M (2015) The FOCUS, AFFINITY and EFFECTS trials studying the effect(s) of fluoxetine in patients with a recent stroke: a study protocol for three multicentre randomised controlled trials. Trials 16:369
Batchelor PE, Skeers P, Antonic A, Wills TE, Howells DW, Macleod MR et al (2013) Systematic review and meta-analysis of therapeutic hypothermia in animal models of spinal cord injury. PLoS One 8(8), e71317
Batchelor PE, Wills TE, Skeers P, Battistuzzo CR, Macleod MR, Howells DW et al (2013) Meta-analysis of pre-clinical studies of early decompression in acute spinal cord injury: a battle of time and pressure. PLoS One 8(8), e72659
Howells DW, Sena ES, O’Collins V, Macleod MR (2012) Improving the efficiency of the development of drugs for stroke. Int J Stroke 7(5):371–377
Rottingen JA, Regmi S, Eide M, Young AJ, Viergever RF, Ardal C et al (2013) Mapping of available health research and development data: what’s there, what’s missing, and what role is there for a global observatory? Lancet 382(9900):1286–1307
Finnerup NB, Attal N, Haroutounian S, McNicol E, Baron R, Dworkin RH et al (2015) Pharmacotherapy for neuropathic pain in adults: a systematic review and meta-analysis. Lancet Neurol 14(2):162–173
Betran AP, Say L, Gulmezoglu AM, Allen T, Hampson L (2005) Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol 5(1):6
Kwon Y, Powelson SE, Wong H, Ghali WA, Conly JM (2014) An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks. Syst Rev 3:135
Beynon R, Leeflang MM, McDonald S, Eisinga A, Mitchell RL, Whiting P et al (2013) Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev (9):MR000022
Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M (2010) Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed. Lab Anim 44(3):170–175
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this chapter
Cite this chapter
McCann, S.K., Sena, E.S., Currie, G.L., Macleod, M.R., Howells, D.W. (2017). Systematic Review and Meta-analysis: Important Tools in Understanding Drug Development for Stroke. In: Lapchak, P., Zhang, J. (eds) Neuroprotective Therapy for Stroke and Ischemic Disease. Springer Series in Translational Stroke Research. Springer, Cham. https://doi.org/10.1007/978-3-319-45345-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-45345-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-45344-6
Online ISBN: 978-3-319-45345-3
eBook Packages: MedicineMedicine (R0)