Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Quebec Rural Emergency Department Project: A Cross-Sectional Study of a Potential Two-Pronged Strategy in the Knowledge Transfer Process

  • Mélodie-Anne Drouin ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliations Department of Family and Emergency Medicine, Université Laval; Québec, QC, Canada, Research Chair in Emergency Medicine Laval University—CHAU Hôtel-Dieu de Lévis Hospital; Lévis City, QC, Canada

  • Richard Fleet ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    rfleet@videotron.ca

    Affiliations Department of Family and Emergency Medicine, Université Laval; Québec, QC, Canada, Research Chair in Emergency Medicine Laval University—CHAU Hôtel-Dieu de Lévis Hospital; Lévis City, QC, Canada

  • Julien Poitras ,

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Family and Emergency Medicine, Université Laval; Québec, QC, Canada

  • Patrick Archambault ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliations Department of Family and Emergency Medicine, Université Laval; Québec, QC, Canada, Research Chair in Emergency Medicine Laval University—CHAU Hôtel-Dieu de Lévis Hospital; Lévis City, QC, Canada

  • Jean-Marc Chauny ,

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Family and Emergency Medicine, Université de Montréal; Department of Emergency Medicine, Hôpital du Sacré-Coeur de Montréal, QC, Canada

  • Jean-Frédéric Lévesque ,

    ‡ These authors also contributed equally to this work.

    Affiliation Centre for Primary Health Care and Equity of the University of New South Wales, New South Wales, Australia

  • Mathieu Ouimet ,

    ‡ These authors also contributed equally to this work.

    Affiliation Département de science politique, Pavillon Charles-De Koninck, Université Laval, Québec, QC, Canada

  • Gilles Dupuis ,

    ‡ These authors also contributed equally to this work.

    Affiliation Département de psychologie, Université du Québec à Montréal, Montréal, QC, Canada

  • Alain Tanguay ,

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Family and Emergency Medicine, Université Laval; Québec, QC, Canada

  • Geneviève Simard-Racine ,

    ‡ These authors also contributed equally to this work.

    Affiliation Departement of Emergency Medicine, CSSS de La Matapédia, Québec, QC, Canada

  • Josée Gauthier ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliation Direction de l’analyse et de l’évaluation des systèmes de soins et services, Institut national de santé publique du Québec, Université du Québec à Rimouski, Rimouski, QC, Canada

  • Fatoumata Korika Tounkara ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliation Research Chair in Emergency Medicine Laval University—CHAU Hôtel-Dieu de Lévis Hospital; Lévis City, QC, Canada

  • Marie-Hélène Gilbert ,

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliation Research Chair in Emergency Medicine Laval University—CHAU Hôtel-Dieu de Lévis Hospital; Lévis City, QC, Canada

  • France Légaré

    Contributed equally to this work with: Mélodie-Anne Drouin, Richard Fleet, Patrick Archambault, Josée Gauthier, Fatoumata Korika Tounkara, Marie-Hélène Gilbert, France Légaré

    Affiliation Department of Family Medicine and Emergency Medicine, Knowledge Transfer and Health Technology Assessment of the CHUQ Research Centre (CRCHUQ), Unité de Recherche Évaluative, Université Laval, Québec, QC, Canada

Abstract

Introduction

Health services research generates useful knowledge. Promotion of implementation of this knowledge in medical practice is essential. Prior to initiation of a major study on rural emergency departments (EDs), we deployed two knowledge transfer strategies designed to generate interest and engagement from potential knowledge users. The objective of this paper was to review: 1) a combined project launch and media press release strategy, and 2) a pre-study survey designed to survey potential knowledge users’ opinions on the proposed study variables.

Materials and Methods

We evaluated the impact of the project launch (presentation at two conferences hosted by key stakeholders) and media press release via a survey of participants/stakeholders and by calculating the number of media interview requests and reports generated. We used a pre-study survey to collect potential key stakeholder’ opinions on the study variables.

Results

Twenty-one of Quebec’s 26 rural EDs participated in the pre-study survey (81% participation rate). The press release about the study generated 51 press articles and 20 media request for interviews, and contributed to public awareness of a major rural research initiative. In the pre-study survey, thirteen participants (46%) mentioned prior knowledge of the research project. Results from the pre-study survey revealed that all of the potential study variables were considered to be relevant for inclusion in the research project. Respondents also proposed additional variables of interest, including factors promoting retention of human resources.

Conclusions

The present study demonstrated the potential utility of a two-pronged knowledge transfer strategy, including a combined formal launch and press release, and a pre-study survey designed to ensure that the included variables were of interest to participants and stakeholders.

Introduction

With over 14 million patient visits each year, emergency departments (EDs) represent an important component of the public health care system in Canada [1]. However, the majority of studies in emergency medicine are conducted in academic centers located in urban areas [2], and little information concerning rural EDs is available. The practice of emergency medicine in rural areas differs significantly from practice in urban centers, and research in this area has identified challenges specific to rural practice [36]. Considerable seasonal fluctuation in patient volume in EDs [7], difficulty accessing training for specialized life-saving procedures and for continuing medical education [8], physician shortages, and lack of consultant support [9, 10] constitute only a few examples of the challenges facing rural practice.

Research on rural emergency care is critical, yet faces considerable challenges [11, 12]. Most rural EDs are not university-affiliated, and prior staff experience in research participation is often limited. Challenges inherent to work in rural settings can combine with busy clinical schedules due to staffing shortages to discourage participation in research. Moreover, involvement in research, particularly in the field of health care, may be limited by unfamiliarity with the research process, lack of opportunity to participate in research projects, and limited understanding of statistical analyses [13, 14]. Promoting participation in research in rural settings requires creative dissemination strategies. The scientific community must contribute to the development of knowledge tailored to the realities and needs of rural EDs, and explore novel strategies to support evidence-based decision-making.

Our multidisciplinary research group is conducting a major descriptive and evaluative study of rural EDs in Quebec [15]. To the best of our knowledge, ours is the first large-scale research study on rural EDs in Canada. As such, it constitutes a unique opportunity to develop a solid foundation for further knowledge transfer and participant engagement by involving potential knowledge users in the initial phases of the project. This paper reports on two strategies that were developed to meet this objective. The first strategy involved a combined project launch and media press release; the objective of this strategy was to publicize the project and to optimize the participation rate. The second strategy involved obtaining knowledge users’ opinions concerning study variables before the research project was initiated. Finally, we sought to estimate level of familiarity among rural hospital staff with the provincial ED management Guide (published in 2006 by the Quebec’s Ministry of Health and Social Services to help improve performance among Quebec’s EDs) [16]. The guide contains recommendations specific to rural EDs and could serve as a reference for establishing standards of emergency care across Canada [16].

Materials and Methods

This cross-sectional study is based on data collected from knowledge users. Inclusion criteria for EDs required 24/7 medical coverage and in-patient hospitalization beds. Local community service centers, mobile care units, and private clinics were therefore excluded. Rural EDs (N = 26) were identified using the Guide to Canadian Health Care Facilities and were confirmed by the Quebec’s Ministry of Health and Social Services and the province’s “Direction nationale des urgences” [17]. A rural area was defined according to Statistics Canada criteria [18]. To participate in the study, emergency physicians, emergency clinician managers, and hospital directors had to be working for at least one of the 26 rural EDs in Quebec selected for this study.

Strategy 1: Combined project launch and media press release strategy

Strategy 1 involved a combined project launch and media press release. First, the primary investigator (RF) launched the project at the annual meetings of two key provincial stakeholders meetings: the “Association des gestionnaires infirmiers d’urgence du Québec (AGIUQ)” [Quebec Emergency Nurse Manager’s Association] in May 2011 (approximately 200 attendees), and the “Association des médecins d’urgence du Québec (AMUQ)” [Quebec Emergency Physicians’ Association] in October 2011 (approximately 1000 attendees). The two launches involved formal presentation of the study, and answering stakeholder questions about the project at a conference information booth. Second, concurrently with the AMUQ meeting, a single press release announcing the launch of the research project was sent to major newspapers and specialized media, as well as to regional and rural media. The newsletter was released by the Laval University Department of information and communications.

To evaluate the reach of the press release and the two presentations, the pre-study survey (further described below) contained the following questions: “Had you heard about this research project before you were asked to complete this form? If so, how?” The pre-study survey was sent to participants one month after the project launch and media press release; impact was measured using two independent media monitoring firms.

Strategy 2: Pre-study survey

The pre-study survey consisted of a structured online and paper questionnaire. The paper version was designed to be distributed to emergency physicians attending the October 2011 annual AMUQ meeting. The electronic version was subsequently created using the software program Survey Monkey (California, USA); it included the majority of the questions in the paper version, and was sent by email to potential respondents.

Examples of questionnaire items

  1. Name the three most significant challenges in providing rural emergency care that research should address on a priority basis.
  2. Indicate your level of familiarity with the recommendations in the provincial EDs management Guide [16] on a scale of 1 to 4, ranging from “not at all” to “very” (paper questionnaire), and on a scale of 1 to 7 ranging from “not at all” to “extremely” (online questionnaire).
  3. Propose factors that should be investigated in order to facilitate the implementation of the recommendations in the provincial EDs management Guide [16] in rural EDs.
  4. Rate the perceived importance of the following proposed variables for the larger study: characteristics of the population served, geographical and roadway characteristics, distance between hospital and other specialized services, upstream and downstream resources, ambulance services, air services, hospital characteristics, medical personnel and outpatient clinic, computer support for medical decision-making, knowledge transfer activities, ED visits, trauma data, diagnostic services, number of ED nurses, number of emergency physicians, other professionals and employees, use of the provincial EDs management Guide, performance and quality-of-care indicators, and ED personnel quality of work-life.
  5. Suggest further variables that should be examined in order to accurately describe Quebec’s rural EDs.

Participants were given examples to facilitate understanding of questionnaire items. They were asked to respond on a scale ranging from 1 (“not important at all”) to 5 (“essential”) for the paper version of the questionnaire, and on a scale from 1 “not useful at all” to 7 (“extremely useful”) for the online version.

Rural emergency physicians attending the October 2011 annual meeting of the AMUQ were invited to participate in the paper version of the pre-study survey. We also solicited online opinions from key health-care policy-makers, including representatives from medical and nursing associations and federations (e.g., AMUQ, AGIUQ, Quebec College of Physicians, Quebec’s Ministry of Health and Social Services, Quebec’s health and social services agencies, advisory groups [e.g., the TCCAT], university emergency medicine program directors, and medical school deans). Regular and part-time emergency physicians, two types of emergency clinician managers (ED chiefs and head nurses) and three types of hospital directors (CEOs, directors of professional services, and directors of nursing) from each of Quebec’s rural EDs were also invited to participate in the online survey.

Data analysis

For strategy 1, we assessed the potential impact of this strategy by calculating degree of participant knowledge about the study, using data collected in the pre-study survey within one month of the launch and press release. The impact of the media press release strategy was further assessed by two independent media monitoring firms and reported by Laval University’s Department of information and communications. For the purpose of this study, we tallied the total number of interview requests and media reports about the study.

The pre-study survey (strategy 2) contained several open-ended questions concerning variables to be included in the research project, challenges faced by emergency medicine in rural areas, and obstacles to applying the provincial ED management Guide. To analyze the qualitative data, each raw response was placed in a more general category to reduce the number of possible responses. Two research assistants verified the classification into categories to ensure validity. To identify the most frequently cited and most significant challenges, we compared the frequency of citing for each category. To identify overall trends and specific trends according to employment category, we calculated means and standard deviations for all participants and for each employment group (emergency physicians, emergency clinician managers, hospital directors, and policy-makers). In contrast with the 5-point measurement scale used in the paper version of the questionnaire (administered first), the electronic version used a 7-point scale. Because data from the two questionnaires were not initially meant to be analyzed together, we used two different measurement scales (1 to 4 and 1 to 7). To consolidate the data across scales, we used the cross-multiplication procedure [19], which allowed us to analyze all of the data on a scale from 1 to 7. We also transposed all of the answers onto a scale from 1 to 4. To complete our consolidation, we conducted a sensitivity analysis, that is, an investigation of the potential changes and errors between the two strategies, and their impact on the study conclusions [20].

Ethical considerations

The CSSS Alphonse-Desjardins Research Ethics Committee approved the pre-study survey. The objectives and procedures were explained to each participant, and participant anonymity was respected at all levels of the procedure.

Results

Strategy 1: Combined project launch and media press release strategy

Twenty-eight participants (two emergency physicians, five emergency clinician managers, 18 hospital administrators, and three policy-makers) responded to the question about prior knowledge of the research project (“Had you heard about this research project before you were invited to complete this form?”). Of the 28 participants respondents, thirteen answered “yes” (46%) and 15 answered “no” (54%). Of those who responded “yes,” 8% reported that they had heard about the study at the meeting at Laval University, 15% had heard about it from a third party, and 23% heard about it from the investigators (data not shown). Of the 13 participants who had heard about the project prior to the survey, seven (54%) named a source of information related to the combined media strategy (“media” or “AGIUQ”).

The press release generated 51 press articles and 20 media requests for interviews. Furthermore, staff from four of Quebec’s 26 rural EDs spontaneously contacted the lead investigator for more information.

Strategy 2: Pre-study survey

Forty-three participants completed either the paper or electronic version of the pre-study survey. Seven emergency physicians completed the paper version, and two emergency physicians, seven emergency clinician managers, 18 hospital directors, and nine policy-makers completed the online version. Overall, 81% of Quebec’s rural EDs contributed data to at least one questionnaire. As for the online questionnaire, the response rate was 14% for emergency clinician managers, 24% for hospital directors and 50% for policy-makers. Since emergency physicians had been approached via a booth at the AMUQ meeting, their response rate could not be determined.

When participants were asked to rate the importance of each potential study variable, diagnostic services was deemed to be the most useful variable (see Table 1). In descending order, the next four highly rated variables were distance between hospital and other specialized services, ED visits, computer support, and number of ED nurses. The variable ranked least important was air services, although mean score remained high at 4.81. All variables were therefore considered useful for the upcoming research project.

thumbnail
Table 1. Participant ranking (in decreasing order) of importance of study variables on a scale from 1 “not at all useful” to 7 “extremely useful”.

https://doi.org/10.1371/journal.pone.0120523.t001

Participants were also asked to identify additional variables that should be examined (see Table 2). In light of the results, we added certain variables to the larger study, including factors promoting retention of human resources. The measurement instruments were also adapted to better meet participant needs.

thumbnail
Table 2. New variables for inclusion proposed by participants.

https://doi.org/10.1371/journal.pone.0120523.t002

We also collected data concerning the challenges of providing rural emergency care. Results are presented in Table 3. The most frequently cited challenge across participants was lack of human resources/access to specialized services, followed closely by maintenance of competence/training of medical and nursing personnel. Opinions varied across the four groups of participants, although there was some overlap between answer categories, and some similarities were identified.

thumbnail
Table 3. Frequency of citing for challenges faced by emergency medicine in rural Quebec (by entire sample and by job category).

https://doi.org/10.1371/journal.pone.0120523.t003

Participants were asked to indicate their level of familiarity with the recommendations in the provincial ED management Guide (data not shown). The mean obtained across all groups was 3.7; in general, participants were partially familiar with the guide’s recommendations. Standard deviation was 2.0, which indicates considerable differences between participants. Standard deviation decreased when each group’s data was analyzed separately. Contrary to expectations, emergency physicians were the group that was the least familiar with the guide, with a mean of 1.2. Emergency clinician managers were the most familiar with the guide, with a mean of 5.0. Policy-makers’ familiarity with the guide (4.2) was similar to the level of familiarity among hospital directors (4.2).

The responses concerning potential barriers to implementing the guide’s recommendations are presented in Table 4. For the sample as a whole, maintenance of competence/training of medical and nursing personnel emerged was the most frequently mentioned barrier. Barriers cited differed between the four groups.

thumbnail
Table 4. Frequency of citing for factors that impede the use of the provincial ED management Guide, by entire sample and by job category.

https://doi.org/10.1371/journal.pone.0120523.t004

Discussion

Strategy 1: Combined project launch and media press release strategy

The combined project launch and media press release strategy appears to have successfully informed the target audience of the project, as evidenced by the percentage of participants in the pre-survey study who reported prior knowledge of the study (46%). Of these participants, 54% identified a source of information related to the strategy (“media” or “AGIUQ” conference). Furthermore, the press release generated 51 press articles and 20 media requests for interviews. Given the relatively small number of news outlets in rural Quebec, the press release was considered to have a strong impact among the media. Four of Quebec’s rural EDs contacted the second author (RF) for further information before the research project began.

Several studies [21, 22] have demonstrated the potential benefit of using mass media as a strategy for disseminating research results and thereby changing health behaviors. Mass media dissemination is a key step in the knowledge transfer process, but few data are available on the effectiveness of this strategy for involving knowledge users at an early stage of a project. The perceived importance of research by its users predicts data use [2325] and knowledge transfer [26]. Although it will be difficult to quantify, we anticipate that the combined project launch and media press release strategy will foster interest, engagement, and participation in the larger study.

The strategy implemented here was inexpensive; incurred costs primarily concerned the time invested in the launch and in the media interviews. However, the impact of a press release is unpredictable. Media coverage depends on perceived general public interest for a given subject at a particular point in time. Media coverage also depends on competing current events. Based on the present report, we recommend the implementation of our combined strategy (formal study launch and press release) particularly when attempting to generate interest from potential participants and stakeholders who are otherwise difficult to reach and to engage.

Strategy 2: Pre-study survey

Surveying participants and stakeholders about their perceptions of what is relevant and important to study in their clinical settings is a key knowledge transfer strategy, and one that is often neglected. It demonstrates investigators’ interest in participant issues, and helps to confirm and improve study variables.

In the pre-study survey phase, we found that participants considered all of the planned study variables to be relevant, with diagnostic services ranked as the highest priority for study. The additional suggested variables were used to improve the research project. The primary reported challenge of providing rural emergency care was lack of human resources/access to specialized services. Participants were partially familiar with the provincial ED management Guide, although familiarity among emergency physicians was limited. The primary barrier to the application of the guide was maintenance of competence/training of medical and nursing personnel.

Given that different types of participants (policy-makers, director, clinician managers, and emergency physicians) had different concerns and different interests in the project, the pre-study survey results were examined according to type of participant. Each group has a different role and a different level of decision-making power [26], and the same data will therefore be used differently across groups of participants. For example, research results can be transformed into a decision-making tool for policy-makers and into an intervention grid for health professionals [26]. It is therefore critical to have a strong understanding of target audience when undertaking a research project. To that end, the pre-study survey was designed to confirm relevant factors and to identify new variables deemed important by participants. For instance, researchers and policy-makers do not operate in the same spheres of activity and therefore do not have quite the same needs or constraints [27]. It is therefore critical to include knowledge users’ opinions when determining research goals and priorities prior to initiating a research project. In our project, the variables deemed to be of greatest interest by the investigators concerned the characteristics of the region, hospitals and EDs, and prehospital services and inter-facility transfers. However, participants also cited additional variables of interest, including personnel recruitment and retention factors. In sum, our results suggest that a pre-study survey addressing participant concerns is effective to improve the research protocol. Further, engaging stakeholders from the onset is likely to promote participation in the overall study.

Strengths and limitations

This study has certain limitations. First, participation rate varied according to type of respondent, and may not be entirely representative of Quebec’s rural EDs and health care policy-makers. Further reminders for participation may have optimized the participation rate, but were prevented by time constraints.

Second, it was difficult to assess the precise impact of the press release. There is presently no consensus among researchers regarding the optimal method for assessing the impact of a mass media knowledge transfer strategy [2628]. While two independent media monitoring firms gauged the impact of our press release and presentations by calculating the number of interviews and articles generated, we do not know how well this measure fostered actual participation in the study of Quebec’s rural emergency departments. Certainly, the pre-study survey suggested an increased awareness of the project, and designing a press release with the help of communications specialists may be an easy and inexpensive knowledge transfer strategy.

Despite these limitations, the pre-study survey had a number of strengths. First, it addressed issues that have not been extensively studied in the literature. The results can therefore serve as a basis for future studies of rural hospitals and mass media knowledge transfer strategies. Second, we presented the results for the group as a whole, and also for each different employment group (emergency physicians, emergency clinician managers, hospital directors, and policy-makers). The conclusions of this study are therefore applicable to very specific groups. We also modified variables according to the respective group interests. Furthermore, we clearly defined the term “rural” at the outset of the study, and used rigorous methodology for identifying Quebec’s rural emergency departments. Finally, the results of the pre-study survey reflect the opinions of participants from a large proportion (81%) of Quebec’s rural EDs.

Conclusions

This study demonstrated the potential usefulness of a two-pronged knowledge transfer strategy that included a combined formal study launch and press release, and a pre-study survey that helped us modify study variables to meet the informational needs of participants and stakeholders. This study therefore constitutes a starting point for the development of new integrated knowledge transfer strategies.

Acknowledgments

We wish to thank all rural emergency physicians and emergency department chairs in the province of Quebec for their participation in this study. We further thank Julie Maltais-Giguère (DtP, MSc) and Julie Villa for gathering data, participating in the study design, and coordinating the initial phases of the study. Finally, we give many thanks to J-F Huppé for his help with data collection for the media launch.

Author Contributions

Conceived and designed the experiments: RF MAD FL GD MO JG. Performed the experiments: RF MAD FL GD MO PA JP JMC GSR AT JG. Analyzed the data: RF MAD FL FKT MHG. Contributed reagents/materials/analysis tools: MAD RF JFL FKT FL GD. Wrote the paper: MAD RF MHG FKT.

References

  1. 1. Canadian Institute for Health Information, Understanding Emergency Department Wait Times: Access to Inpatient Beds and Patient Flow Ottawa: CIHI, 2007. CIHI website. Available: https://secure.cihi.ca/free_products/Emergency_Department_Wait_Times_III_2007_e.pdf. Accessed 2015 February 20.
  2. 2. Canadian Institute for Health Information. How healthy are rural Canadians? An assessment of their health status and health determinants. 2006. CIHI website. Available: https://secure.cihi.ca/free_products/rural_canadians_2006_report_e.pdf. Accessed 2015 February 20. pmid:22047772
  3. 3. Baker T. Small rural emergency departments are not simply cut-down large urban emergency departments. The Australian journal of rural health. 2009;17:291. pmid:19930193
  4. 4. Brazil K, Kaasalainen S, Williams A, Rodriguez C. Comparing the experiences of rural and urban family caregivers of the terminally ill. Rural and remote health. 2013;13:2250. pmid:23294373
  5. 5. Choo EK, Newgard CD, Lowe RA, Hall MK, McConnell KJ. Rural-urban disparities in emergency department intimate partner violence resources. The western journal of emergency medicine. 2011;12:178–83. pmid:21691523
  6. 6. Choo EK, Spiro DM, Lowe RA, Newgard CD, Hall MK, McConnell KJ. Rural-urban disparities in child abuse management resources in the emergency department. The Journal of rural health: official journal of the American Rural Health Association and the National Rural Health Care Association. 2010;26:361–5. pmid:21029171
  7. 7. Chen TM, Tescher P. Emergency department demographics at a small Australian rural hospital. Rural and remote health. 2010;10:1318. pmid:20334451
  8. 8. Glazebrook RM, Harrison SL. Obstacles and solutions to maintenance of advanced procedural skills for rural and remote medical practitioners in Australia. Rural and remote health. 2006;6:502. pmid:17107272
  9. 9. Canadian Institute for Health Information. Geographic distribution of physicians in Canada: beyond how many and where. Ottawa 2005. CIHI website. Available: https://secure.cihi.ca/free_products/Geographic_Distribution_of_Physicians_FINAL_e.pdf. Accessed 2015 February 20.
  10. 10. Thompson MJ, Lynge DC, Larson EH, Tachawachira P, Hart LG. Characterizing the general surgery workforce in rural America. Archives of surgery. 2005;140:74–9. pmid:15655209
  11. 11. Masino C, Rubinstein E, Lem L, Purdy B, Rossos PG. The impact of telemedicine on greenhouse gas emissions at an academic health science center in Canada. Telemedicine journal and e-health: the official journal of the American Telemedicine Association. 2010;16:973–6. pmid:20958198
  12. 12. Wears RL, Woloshynowych M, Brown R, Vincent CA. Reflective analysis of safety research in the hospital accident & emergency departments. Applied ergonomics. 2010;41:695–700. pmid:20089245
  13. 13. Atkinson M, Turkel M, Cashy J. Overcoming barriers to research in a Magnet community hospital. Journal of nursing care quality. 2008;23:362–8. pmid:18806648
  14. 14. Chan GK, Barnason S, Dakin CL, Gillespie G, Kamienski MC, Stapleton S, et al. Barriers and perceived needs for understanding and using research among emergency nurses. Journal of emergency nursing: JEN: official publication of the Emergency Department Nurses Association. 2011;37:24–31. pmid:21237364
  15. 15. Fleet R, Archambault P, Legare F, Chauny JM, Levesque JF, Ouimet M, et al. Portrait of rural emergency departments in Quebec and utilisation of the Quebec Emergency Department Management Guide: a study protocol. BMJ open. 2013;3.
  16. 16. Ministère de la Santé et des Services sociaux du Québec. Guide de gestion de l'urgence. Québec. Gouvernement du Québec website. 2006. Available: http://publications.msss.gouv.qc.ca/acrobat/f/documentation/2006/06-905-01.pdf. Accessed 2015 February 20.
  17. 17. Fleet R, Archambault P, Poitras J, Villa J, editors. Limited access to services in Canada rural emergency departments: pilot study. CAEP 2012 Annual Conference Niagara Falls, Canada: CJEM.2012.
  18. 18. Statistics Canada. Health indicator profile, annual estimates, by age group and sex, Canada, provinces, territories, health regions (2011 boundaries) and peer groups (CANSIM Table 105–0501). Ottawa: Statistics Canada website, 2012. Available: http://www4.hrsdc.gc.ca/.3ndic.1t.4r@-eng.jsp?iid=12. Accessed 2015 February 20.
  19. 19. Borosh I, Fraenkel AS. Exact Solutions of Linear Equations with Rational Coefficients by Congruence Techniques. Math. Comp. 1966. pp. 107–112.
  20. 20. Pannell DJ. Sensitivity analysis of normative economic models: Theoretical framework and practical strategies. Agricultural Economics. 1997, 16: 139–152.
  21. 21. Bala MM, Strzeszynski L, Topor-Madry R, Cahill K. Mass media interventions for smoking cessation in adults. The Cochrane database of systematic reviews. 2013;6:CD004704. pmid:23744348
  22. 22. Grilli R, Ramsay C, Minozzi S. Mass media interventions: effects on health services utilisation. The Cochrane database of systematic reviews. 2002:CD000389.
  23. 23. Dagenais C, Queuille L, Ridde V. Evaluation of a knowledge transfer strategy from a user fee exemption program for vulnerable populations in Burkina Faso. Global health promotion. 2013;20:70–9. pmid:23797942
  24. 24. Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. Journal of health services research & policy. 2002;7:239–44.
  25. 25. Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. Journal of health services research & policy. 2005;10 Suppl 1:35–48.
  26. 26. McKenna C. Medical system in northern B.C. 'systematically helps people die,' critics say. The Vancouver Sun. 2013. CTV website. Available: http://bc.ctvnews.ca/medical-system-in-northern-b-c-systematically-helps-people-die-critics-say-1.1227850. Accessed 2015 February 20.
  27. 27. Canadian Institute for Health Information, National Health Expenditure Trends, 1975 to 2012. Ottawa, Ont.: CIHI, 2012. CIHI website. Available: https://secure.cihi.ca/free_products/NHEXTrendsReport2012EN.pdf. Accessed 2015 February 20.
  28. 28. Rajic A, Young I, McEwen SA. Improving the utilization of research knowledge in agri-food public health: a mixed-method review of knowledge translation and transfer. Foodborne pathogens and disease. 2013;10:397–412. pmid:23560423