Research methods
Developing a patient-reported experience questionnaire with and for people who use drugs: A community engagement process in Vancouver’s Downtown Eastside

https://doi.org/10.1016/j.drugpo.2018.06.003Get rights and content

Abstract

People who use drugs (PWUD) frequently have complex health care needs, yet face multiple barriers to accessing services. Involving PWUD in health service design and evaluation can enhance the quality of data collected and ensure policy and practice improvements reflect the expressed needs of the population. However, PWUD remain largely excluded from the evaluation of health services that directly affect their lives, including development of patient-reported experience measures (PREMS) that have gained prominence in health services research and clinical practice. Detailed descriptions of PWUD participation in survey design are notably absent in the literature. In this commentary, we present a case that demonstrates how PWUD can contribute meaningfully to the development of questionnaires that assess patient-reported health care experiences. We describe the development, implementation and outcomes of a process to engage local drug user organizations in the evaluation of a redesign and reorientation of health service delivery in the Downtown Eastside (DTES) neighborhood of Vancouver, Canada. Through this process, participants contributed critical elements to the design of a patient-reported experience measure, including: (1) identifying unmet service needs in the neighborhood; (2) identifying local barriers and facilitators to care; (3) formulating questions on cultural safety; and (4) improving structure, language and clarity of the questionnaire. We highlight lessons learned from the process, reflecting on the strengths, challenges and ethical considerations associated with community-based approaches to questionnaire development. The workshop model presented here illustrates one flexible and promising approach to enabling meaningful participation of PWUD in questionnaire development.

Introduction

In Canada and globally, people who use drugs (PWUD) frequently have complex health care needs related to substance use, including co-occurring infectious diseases (e.g., HIV, viral hepatitis), cardiovascular disease, substance dependence and mental health conditions (Degenhardt & Hall, 2012; Urban Health Research Initiative, 2013). However, PWUD also face substantial barriers to accessing care, often delaying care due to stigma and discrimination experienced within the health care system (Neale, Tompkins, & Sheard, 2008). Indigenous peoples1 in particular experience poor access to appropriate care and a disproportionate burden of disease and substance-related harm (Gracey & King, 2009). These health disparities are rooted in colonial policies and perpetuated by ongoing institutionalized racism, entrenched poverty, social exclusion, interpersonal discrimination and inequitable social policies and practices (Allan & Smylie, 2015; Browne et al., 2011; Goodman et al., 2017; Tang & Browne, 2008). Primary care, substance use and mental health services have historically developed and operated separately in North America, posing additional barriers to comprehensive and continuous care (Rush, Fogg, Nadeau, & Furlong, 2008). Within this context, PWUD frequently access care from multiple sources (Nosyk et al., 2014), and rely heavily on emergency services (Fairbairn et al., 2011; Hansagi, Engdahl, & Romelsjö, 2012; Kerr et al., 2004; Palepu et al., 1999); this fragmented care delivery has been associated with poorer medication adherence and health outcomes (Nosyk et al., 2015).

Regional health authorities are increasingly promoting integrated care models as a way to improve accessibility and quality of services for PWUD with complex needs (Carey et al., 2013; Crowley, Kirschner, & Health and Public Policy Committee of the American College of Physicians, 2015; Health Canada, 2002; Korthuis et al., 2017). This has been the case in Vancouver’s Downtown Eastside (DTES), a neighborhood that has long been home to a large illicit drug use scene. Here, the Vancouver Coastal Health Authority (VCH) is undertaking a redesign of health services aimed at improving health outcomes for residents of the DTES through greater coordination and continuity of care. Launched in 2016, the ‘Downtown Eastside Second Generation Strategy’ (DTES-2GS) plans to establish integrated care teams within three community health clinics; partnerships with private clinics to coordinate care for clients accessing private clinics; a new low-barrier addiction clinic with rapid access to opioid agonist treatment; and staff competency training on Indigenous cultural safety, women’s needs, trauma-informed care, harm reduction fundamentals and pain management. In addition, VCH has allocated funding away from some existing services (including a low-barrier drop-in center for PWUD) and toward development of a new integrated health care center.

Evaluating the impact of these service changes is challenged by the limited availability of client reported data on health care utilization and health care experiences in the DTES. Patient reported experience measures (PREMS), such as the World Health Organization (WHO) Survey on Health and Health System Responsiveness, provide promising tools for assessing patient’s perceptions of care received during a recent health care experience (Valentine et al., 2003). However, existing measures of patient experience are not designed to address the distinct health care needs, perspectives and experiences of PWUD. With few exceptions (Madden, Lea, Bath, & Winstock, 2008; Neale et al., 2016), PWUD are rarely meaningfully involved in the development of health service questionnaires, despite calls from drug user organizations for more involvement in research design (Australian Injecting and Illicit Drug Users League (AIVL) (2003); Canadian HIV/AIDS Legal Network, 2006; Consumers’ Health Forum (CHF), and (NHMRC) (2001); Vancouver Area Network of Drug Users, 2018a, 2018b). Detailed descriptions of PWUD participation in questionnaire design are largely missing in health services literature, raising questions about the extent of community involvement in community-based projects. The exclusion of PWUD from health service research and evaluation is methodologically and ethically problematic given evidence that service-user involvement can enhance the quality of data collected and ensure that evidence best meets the needs of affected communities (Hayashi et al., 2012; Neale et al., 2016; Shannon et al., 2007).

To address this gap, we partnered with three local drug user organizations to develop a patient-reported experience questionnaire. We outline the development, implementation and outcomes of this community engagement process, including the strengths, challenges and ethical considerations associated with community-based approaches to questionnaire development.

Section snippets

Project conceptualization and development

An academic research team based at the BC Centre for Excellence in HIV/AIDS (BC-CfE) and British Columbia Centre on Substance Use (BCCSU), partnering with representatives from VCH Aboriginal Health Strategic Initiatives, proposed to undertake a comprehensive, multidimensional evaluation of the DTES-2GS, focusing on access to care and quality of healthcare delivery. The BCCSU (formerly known as the Urban Health Research Initiative) runs three prospective cohort studies of over 3000

Implementation of community engagement activities

We hosted three workshop sessions at the VANDU office to guide development of the questionnaire. In total, 18 participants were selected through a nomination process coordinated by the director of VANDU and the president of WAHRS. An approximately even number of men and women participated in the workshop series. To be nominated, participants had to be active members of the drug user organizations and be able to communicate in English. The sessions were audio-recorded with the consent of

Project outcomes

In this project, PWUD brought valuable experiential knowledge that enhanced the rigour of the final questionnaire, tailoring it to the DTES context. PWUD participation in the workshops highlighted a number of locally important issues that should be incorporated into the questionnaire to enhance the relevance and quality of data collected. We highlight four key contributions that PWUD made to this questionnaire.

Lessons learned

The patient-oriented questionnaire development process that we have outlined demonstrates the feasibility and value of involving PWUD at the study design stage. To our knowledge, this paper represents one of the few published descriptions of processes to involve PWUD in design of a patient-reported measure (Neale et al., 2016). The workshop-based process presented here represents one approach to questionnaire development which recognizes and leverages the unique expertise that PWUD can bring to

Conclusion

This project demonstrates the importance of building respectful and collaborative partnerships with PWUD community groups to develop patient-reported experience questionnaires that place their needs, priorities and input at the forefront. Particularly in contexts where PWUD have organized into peer-led and democratic organizations, a workshop based model can facilitate meaningful participation from a diverse network of drug users in questionnaire design. The incorporation of Indigenous research

Declaration of interest

None.

Acknowledgments

The authors would like to acknowledge the substantial contributions of Tracey Morrison, who led the talking circle component of this project. We thank Marion Allaart and the board members of the Vancouver Area Network of Drugs Users, the Western Aboriginal Harm Reduction Society and the BC Association of People on Methadone for their critical contributions to planning these sessions. The authors thank the workshop participants for their contribution to the research, as well as current and past

References (49)

  • A.J. Browne et al.

    Access to primary care from the perspective of aboriginal patients at an urban emergency department

    Qualitative Health Research

    (2011)
  • Canadian HIV/AIDS Legal Network

    Nothing about us without us: Greater, meaningful involvement of people who use illegal drugs: A public health, ethical and human rights imperative

    (2006)
  • T.S. Carey et al.

    Future research needs for evaluating the integration of mental health and substance abuse treatment with primary care

    Journal of Psychiatric Practice

    (2013)
  • Consumers’ Health Forum (CHF), & (NHMRC)

    Statement on consumer and community participation in health and medical research

    (2001)
  • R.A. Crowley et al.

    The integration of care for mental health, substance abuse, and other behavioral health conditions into primary care: Executive summary of an American College of physicians position paper

    Annals Of Internal Medicine

    (2015)
  • J. Evans et al.

    VOICE: Developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology

    Journal of Mental Health

    (2012)
  • N. Fairbairn et al.

    Emergency department utilization among a cohort of HIV-positive injecting drug users in a Canadian setting

    The Journal of Emergency Medicine

    (2011)
  • First Nations Health Authority

    Creating a climate for change: Cultural safety and humility in health services delivery for first nations and aboriginal peoples in British Columbia

    (2015)
  • S. Flicker et al.

    Peer research in action III: Ethical issues

    (2010)
  • K. Greenwood et al.

    CHoice of outcome In Cbt for psychosEs (CHOICE): The development of a new service user-led outcome measure of Cbt for psychosis

    Schizophrenia Bulletin

    (2010)
  • A. Greer et al.

    ). Peer engagement Best practices: A Guide for health authorities and other providers

    (2017)
  • A. Greer et al.

    A guide for paying peer research assistants: Challenges and opportunities

    (2017)
  • H. Hansagi et al.

    Predictors of repeated emergency department visits among persons treated for addiction

    European Addiction Research

    (2012)
  • K. Hayashi et al.

    Collective empowerment while creating knowledge: A description of a community-based participatory research project with drug users in Bangkok, Thailand

    Substance Use & Misuse

    (2012)
  • Cited by (15)

    • Suboptimal nonmedical qualities of primary care linked with care avoidance among people who use drugs in a Canadian setting amid an integrated health care reform

      2022, Journal of Substance Abuse Treatment
      Citation Excerpt :

      As a sensitivity analysis, we tested for differences in demographic characteristics among participants who did and did not report a health care need using Pearson's χ2 test (for categorical variables) or the Mann-Whitney test (for continuous variables) as appropriate. For the domains of responsiveness analyses, we utilized items from the WHO Survey on Health and Health System Responsiveness (Valentine et al., 2003), which was adapted through consultation and partnerships with three local PWUD organizations (Olding et al., 2018). We evaluated seven domains of responsiveness at the health care facility that participants most frequently accessed.

    • Development and validation of health system performance measures for opioid use disorder in British Columbia, Canada

      2022, Drug and Alcohol Dependence
      Citation Excerpt :

      This study had several limitations requiring careful consideration. First, despite the breadth of data available in our linked administrative data sources, our focus on measures strictly calculable from these databases constitute a narrow representation of healthcare quality that excludes patient-oriented experience measures (Olding et al., 2018; Price et al., 2014) and other dimensions of healthcare quality. Our results should be interpreted and acted upon with caution and consideration of quantification privileging (Mannion and Braithwaite, 2012).

    • Non-disclosure of drug use in outpatient health care settings: Findings from a prospective cohort study in Vancouver, Canada

      2020, International Journal of Drug Policy
      Citation Excerpt :

      Talking circles with Indigenous people who use drugs in Vancouver's Downtown Eastside have explored the intersection of Indigenous identity with other experiences of discrimination based on drug and alcohol use, homelessness, and chronic pain needs(Goodman et al., 2017; Olding et al., 2018). Indigenous people who use drugs have described common experiences of stereotyping and discrimination from health care providers, which deepened mistrust towards health care providers and the health care system as a whole(Goodman et al., 2017; Olding et al., 2018). Non-disclosure of drug use was previously identified as a means to receive adequate treatment and reduce further discrimination from health care providers(Goodman et al., 2017).

    View all citing articles on Scopus
    View full text