Research methodsDeveloping a patient-reported experience questionnaire with and for people who use drugs: A community engagement process in Vancouver’s Downtown Eastside
Introduction
In Canada and globally, people who use drugs (PWUD) frequently have complex health care needs related to substance use, including co-occurring infectious diseases (e.g., HIV, viral hepatitis), cardiovascular disease, substance dependence and mental health conditions (Degenhardt & Hall, 2012; Urban Health Research Initiative, 2013). However, PWUD also face substantial barriers to accessing care, often delaying care due to stigma and discrimination experienced within the health care system (Neale, Tompkins, & Sheard, 2008). Indigenous peoples1 in particular experience poor access to appropriate care and a disproportionate burden of disease and substance-related harm (Gracey & King, 2009). These health disparities are rooted in colonial policies and perpetuated by ongoing institutionalized racism, entrenched poverty, social exclusion, interpersonal discrimination and inequitable social policies and practices (Allan & Smylie, 2015; Browne et al., 2011; Goodman et al., 2017; Tang & Browne, 2008). Primary care, substance use and mental health services have historically developed and operated separately in North America, posing additional barriers to comprehensive and continuous care (Rush, Fogg, Nadeau, & Furlong, 2008). Within this context, PWUD frequently access care from multiple sources (Nosyk et al., 2014), and rely heavily on emergency services (Fairbairn et al., 2011; Hansagi, Engdahl, & Romelsjö, 2012; Kerr et al., 2004; Palepu et al., 1999); this fragmented care delivery has been associated with poorer medication adherence and health outcomes (Nosyk et al., 2015).
Regional health authorities are increasingly promoting integrated care models as a way to improve accessibility and quality of services for PWUD with complex needs (Carey et al., 2013; Crowley, Kirschner, & Health and Public Policy Committee of the American College of Physicians, 2015; Health Canada, 2002; Korthuis et al., 2017). This has been the case in Vancouver’s Downtown Eastside (DTES), a neighborhood that has long been home to a large illicit drug use scene. Here, the Vancouver Coastal Health Authority (VCH) is undertaking a redesign of health services aimed at improving health outcomes for residents of the DTES through greater coordination and continuity of care. Launched in 2016, the ‘Downtown Eastside Second Generation Strategy’ (DTES-2GS) plans to establish integrated care teams within three community health clinics; partnerships with private clinics to coordinate care for clients accessing private clinics; a new low-barrier addiction clinic with rapid access to opioid agonist treatment; and staff competency training on Indigenous cultural safety, women’s needs, trauma-informed care, harm reduction fundamentals and pain management. In addition, VCH has allocated funding away from some existing services (including a low-barrier drop-in center for PWUD) and toward development of a new integrated health care center.
Evaluating the impact of these service changes is challenged by the limited availability of client reported data on health care utilization and health care experiences in the DTES. Patient reported experience measures (PREMS), such as the World Health Organization (WHO) Survey on Health and Health System Responsiveness, provide promising tools for assessing patient’s perceptions of care received during a recent health care experience (Valentine et al., 2003). However, existing measures of patient experience are not designed to address the distinct health care needs, perspectives and experiences of PWUD. With few exceptions (Madden, Lea, Bath, & Winstock, 2008; Neale et al., 2016), PWUD are rarely meaningfully involved in the development of health service questionnaires, despite calls from drug user organizations for more involvement in research design (Australian Injecting and Illicit Drug Users League (AIVL) (2003); Canadian HIV/AIDS Legal Network, 2006; Consumers’ Health Forum (CHF), and (NHMRC) (2001); Vancouver Area Network of Drug Users, 2018a, 2018b). Detailed descriptions of PWUD participation in questionnaire design are largely missing in health services literature, raising questions about the extent of community involvement in community-based projects. The exclusion of PWUD from health service research and evaluation is methodologically and ethically problematic given evidence that service-user involvement can enhance the quality of data collected and ensure that evidence best meets the needs of affected communities (Hayashi et al., 2012; Neale et al., 2016; Shannon et al., 2007).
To address this gap, we partnered with three local drug user organizations to develop a patient-reported experience questionnaire. We outline the development, implementation and outcomes of this community engagement process, including the strengths, challenges and ethical considerations associated with community-based approaches to questionnaire development.
Section snippets
Project conceptualization and development
An academic research team based at the BC Centre for Excellence in HIV/AIDS (BC-CfE) and British Columbia Centre on Substance Use (BCCSU), partnering with representatives from VCH Aboriginal Health Strategic Initiatives, proposed to undertake a comprehensive, multidimensional evaluation of the DTES-2GS, focusing on access to care and quality of healthcare delivery. The BCCSU (formerly known as the Urban Health Research Initiative) runs three prospective cohort studies of over 3000
Implementation of community engagement activities
We hosted three workshop sessions at the VANDU office to guide development of the questionnaire. In total, 18 participants were selected through a nomination process coordinated by the director of VANDU and the president of WAHRS. An approximately even number of men and women participated in the workshop series. To be nominated, participants had to be active members of the drug user organizations and be able to communicate in English. The sessions were audio-recorded with the consent of
Project outcomes
In this project, PWUD brought valuable experiential knowledge that enhanced the rigour of the final questionnaire, tailoring it to the DTES context. PWUD participation in the workshops highlighted a number of locally important issues that should be incorporated into the questionnaire to enhance the relevance and quality of data collected. We highlight four key contributions that PWUD made to this questionnaire.
Lessons learned
The patient-oriented questionnaire development process that we have outlined demonstrates the feasibility and value of involving PWUD at the study design stage. To our knowledge, this paper represents one of the few published descriptions of processes to involve PWUD in design of a patient-reported measure (Neale et al., 2016). The workshop-based process presented here represents one approach to questionnaire development which recognizes and leverages the unique expertise that PWUD can bring to
Conclusion
This project demonstrates the importance of building respectful and collaborative partnerships with PWUD community groups to develop patient-reported experience questionnaires that place their needs, priorities and input at the forefront. Particularly in contexts where PWUD have organized into peer-led and democratic organizations, a workshop based model can facilitate meaningful participation from a diverse network of drug users in questionnaire design. The incorporation of Indigenous research
Declaration of interest
None.
Acknowledgments
The authors would like to acknowledge the substantial contributions of Tracey Morrison, who led the talking circle component of this project. We thank Marion Allaart and the board members of the Vancouver Area Network of Drugs Users, the Western Aboriginal Harm Reduction Society and the BC Association of People on Methadone for their critical contributions to planning these sessions. The authors thank the workshop participants for their contribution to the research, as well as current and past
References (49)
- et al.
Extent of illict drug use and dependence, and their contribution to the global burden of disease
Lancet
(2012) - et al.
“They treated me like crap and I know it was because I was native”: The healthcare experiences of aboriginal peoples living in Vancouver’s inner city
Social Science & Medicine
(2017) - et al.
Indigenous health part 1: Determinants and disease patterns
Lancet
(2009) - et al.
Development and validation of ‘SURE’: A patient-reported outcome measure (PROM) for recovery from drug and alcohol dependence
Drug and Alcohol Dependence
(2016) - et al.
Health systems’ responsiveness and reporting behaviour: Multilevel analysis of the influence of individual-level factors in 64 countries
Social Science & Medicine
(2015) - et al.
First peoples, second class treatment: The role of racism in the health and well-being of Indigenous peoples in Canada
(2015) National statement on ethical issues for research involving injecting/illicit drug users
(2003)Treatment service users project: Final report
(2008)- Bardwell, G., Kastor, S., Fowler, A., Shaver, L., Blomskog, S., McArthur, A. (forthcoming). Hiring, paying, and...
- et al.
Talking circles: Northern plains tribes American Indian women’s views of canacer as a health issue
Public Health Nursing
(2017)
Access to primary care from the perspective of aboriginal patients at an urban emergency department
Qualitative Health Research
Nothing about us without us: Greater, meaningful involvement of people who use illegal drugs: A public health, ethical and human rights imperative
Future research needs for evaluating the integration of mental health and substance abuse treatment with primary care
Journal of Psychiatric Practice
Statement on consumer and community participation in health and medical research
The integration of care for mental health, substance abuse, and other behavioral health conditions into primary care: Executive summary of an American College of physicians position paper
Annals Of Internal Medicine
VOICE: Developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology
Journal of Mental Health
Emergency department utilization among a cohort of HIV-positive injecting drug users in a Canadian setting
The Journal of Emergency Medicine
Creating a climate for change: Cultural safety and humility in health services delivery for first nations and aboriginal peoples in British Columbia
Peer research in action III: Ethical issues
CHoice of outcome In Cbt for psychosEs (CHOICE): The development of a new service user-led outcome measure of Cbt for psychosis
Schizophrenia Bulletin
). Peer engagement Best practices: A Guide for health authorities and other providers
A guide for paying peer research assistants: Challenges and opportunities
Predictors of repeated emergency department visits among persons treated for addiction
European Addiction Research
Collective empowerment while creating knowledge: A description of a community-based participatory research project with drug users in Bangkok, Thailand
Substance Use & Misuse
Cited by (15)
Suboptimal nonmedical qualities of primary care linked with care avoidance among people who use drugs in a Canadian setting amid an integrated health care reform
2022, Journal of Substance Abuse TreatmentCitation Excerpt :As a sensitivity analysis, we tested for differences in demographic characteristics among participants who did and did not report a health care need using Pearson's χ2 test (for categorical variables) or the Mann-Whitney test (for continuous variables) as appropriate. For the domains of responsiveness analyses, we utilized items from the WHO Survey on Health and Health System Responsiveness (Valentine et al., 2003), which was adapted through consultation and partnerships with three local PWUD organizations (Olding et al., 2018). We evaluated seven domains of responsiveness at the health care facility that participants most frequently accessed.
Development and validation of health system performance measures for opioid use disorder in British Columbia, Canada
2022, Drug and Alcohol DependenceCitation Excerpt :This study had several limitations requiring careful consideration. First, despite the breadth of data available in our linked administrative data sources, our focus on measures strictly calculable from these databases constitute a narrow representation of healthcare quality that excludes patient-oriented experience measures (Olding et al., 2018; Price et al., 2014) and other dimensions of healthcare quality. Our results should be interpreted and acted upon with caution and consideration of quantification privileging (Mannion and Braithwaite, 2012).
Non-disclosure of drug use in outpatient health care settings: Findings from a prospective cohort study in Vancouver, Canada
2020, International Journal of Drug PolicyCitation Excerpt :Talking circles with Indigenous people who use drugs in Vancouver's Downtown Eastside have explored the intersection of Indigenous identity with other experiences of discrimination based on drug and alcohol use, homelessness, and chronic pain needs(Goodman et al., 2017; Olding et al., 2018). Indigenous people who use drugs have described common experiences of stereotyping and discrimination from health care providers, which deepened mistrust towards health care providers and the health care system as a whole(Goodman et al., 2017; Olding et al., 2018). Non-disclosure of drug use was previously identified as a means to receive adequate treatment and reduce further discrimination from health care providers(Goodman et al., 2017).