Elsevier

European Urology Focus

Volume 4, Issue 1, January 2018, Pages 57-63
European Urology Focus

Prostate Cancer
Development of Indicators to Assess Quality of Care for Prostate Cancer

https://doi.org/10.1016/j.euf.2016.01.016Get rights and content

Abstract

Background

The development, monitoring, and reporting of indicator measures that describe standard of care provide the gold standard for assessing quality of care and patient outcomes. Although indicator measures have been reported, little evidence of their use in measuring and benchmarking performance is available. A standard set, defining numerator, denominator, and risk adjustments, will enable global benchmarking of quality of care.

Objective

To develop a set of indicators to enable assessment and reporting of quality of care for men with localised prostate cancer (PCa).

Design, setting, and participants

Candidate indicators were identified from the literature. An international panel was invited to participate in a modified Delphi process. Teleconferences were held before and after each voting round to provide instruction and to review results.

Outcome measurements and statistical analysis

Panellists were asked to rate each proposed indicator on a Likert scale of 1–9 in a two-round iterative process. Calculations required to report on the endorsed indicators were evaluated and modified to reflect the data capture of the Prostate Cancer Outcomes Registry–Australia and New Zealand (PCOR-ANZ).

Results and limitations

A total of 97 candidate indicators were identified, of which 12 were endorsed. The set includes indicators covering pre-, intra-, and post-treatment of PCa care, within the limits of the data captured by PCOR-ANZ.

Conclusions

The 12 endorsed quality measures enable international benchmarking on the quality of care of men with localised PCa. Reporting on these indicators enhances safety and efficacy of treatment, reduces variation in care, and can improve patient outcomes.

Patient summary

PCa has the highest incidence of all cancers in men. Early diagnosis and relatively high survival rates mean issues of quality of care and best possible health outcomes for patients are important. This paper identifies 12 important measurable quality indicators in PCa care.

Introduction

Clinical registries are gaining favour as a means of building on incidence and mortality data from population registries to include indicators of quality of care [1]. Quality of care indicators are usually categorised according to whether they assess structure, process, or outcome of care [2]. Structure refers to physical and human resources needed to provide care, process refers to the way that care is delivered, and outcome refers to the consequences of the care that has been provided [3]. These domains may be further categorised into safe, effective, patient centred, timely, efficient, and equitable processes, as defined by the Institute of Medicine [4].

Prostate cancer (PCa) quality indicators have been described previously; however, little evidence shows that these indicators have been used to measure and benchmark performance. With international consensus data sets that have been developed for localised and advanced PCa [5], [6] and with an increasing number of PCa clinical registries being established [7], it is timely to develop quality indicators that will foster international benchmarking of quality of care delivered to this group. Effective communication of information to care providers enhances safety and efficacy of treatment, reduces variation in care, and can improve patient outcomes [8].

Indicator reporting has proven valuable in revealing variations in care, level of compliance, and changes in practice over time [9], [10], [11], [12]. A Canadian study of patients treated for PCa with external beam radiotherapy showed considerable variation among the 32 participating centres, with 100% compliance for only two indicators and <60% for three pretreatment indicators [10]. Indicator reporting for centre certification in Germany revealed compliance by 80% of sites for 12 of 15 representative indicators [9]. In Sweden, an online real-time reporting system revealed improvements in the national mean for performance on six of nine indicators over 3 yr [11]. In Australia, reporting in the state of Victoria revealed improved clinical practice over 5 yr [12].

Benchmarking and reporting provide an opportunity to modify clinical practice and national health care policies to ensure that patients are receiving high quality of care and treatment that is accessible and equitable. As a key process of implementation of a transnational Prostate Cancer Outcomes Registry–Australia and New Zealand (PCOR-ANZ) [13], our objective was to identify a set of indicators to assess quality of care provided to men diagnosed with PCa at a population level, enabling benchmarking and reporting across Australia and New Zealand.

Although PCOR–Victoria has reported on indictors for PCa since its inception in 2009 [12], the PCOR-ANZ steering committee agreed that reevaluation of the Victorian indicators was required in the context of the PCOR-ANZ minimum data set [13], with the aim of enabling future global comparisons of PCa care using data from other registry data sets [6].

Section snippets

Methods

An extensive review of the literature led to a previous study from our group that identified 85 indicators reported to assess quality of care of men diagnosed with PCa [14]. These indicators were used in a modified Delphi process [15] to reach consensus on a reportable list. The process involved a panel to anonymously and blindly assess the validity and feasibility of each proposed indicator over iterative rounds of voting.

Twenty-six people were invited to participate, and 24 accepted the

Results

Seventeen panellists (70%) completed round 1 voting, from which 74 of 85 indicators qualified for inclusion in round 2 voting. Twelve additional indicators relating to 2014 National Institute for Health and Care Excellence (NICE) guidelines [17] were recommended additions for round 2 voting.

Twenty-three panellists (95%) completed round 2 voting, and 43 indicators were short-listed. Because reporting of this number would be too broad to significantly affect practice, further exclusion criteria

Discussion

PCOR-ANZ is a transnational initiative that aims to capture, report, and ultimately benchmark standard of care and accessibility of services for men with localised PCa in Australia and New Zealand. In an effort to benchmark, indicator measures need to be defined for reporting.

This study recommends 12 of 97 reported indicators for reporting to benchmark current quality of care and to affect best practice guidelines. Moreover, to our knowledge, this study is the first to show how these indicators

Conclusion

This study defined a set of quality indicators and how to derive the information from current data sets to enable international benchmarking and reporting. This will enable consistent reporting, thereby enhancing safety and efficacy of treatment, reducing variation in care, and improving patient outcomes in PCa care.


Author contributions: Sue M. Evans had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study

References (30)

  • J.T. Wei et al.

    Development and validation of the expanded prostate cancer index composite (EPIC) for comprehensive assessment of health-related quality of life in men with prostate cancer

    Urology

    (2000)
  • J.S. Ellison et al.

    Stratification of postprostatectomy urinary function using expanded prostate cancer index composite

    Urology

    (2013)
  • N.A. Dreyer et al.

    Registries for robust evidence

    JAMA

    (2009)
  • A. Donabedian

    The quality of care. How can it be assessed?

    JAMA

    (1988)
  • Crossing the Quality Chasm: A New Health System for the 21st Century

    (2001)
  • Cited by (17)

    • Disparities in prostate cancer

      2023, Journal of the National Medical Association
    • Quality Indicators in the Clinical Specialty of Urology: A Systematic Review

      2023, European Urology Focus
      Citation Excerpt :

      Relative to other diseases, QI sets for prostate cancer tended to be validated (27%, 8/30) [35,39,45–47,51,55,67], reliable (10%, 3/30) [46,47,67], and risk-adjusted (27%, 8/30) [16,40,45,46,49,51,66,67]. In total, 40% (12/30) of the prostate cancer QI sets have been implemented in practice [16,40,41,43,44,46–49,52,55,56]. Seventeen articles described QI sets for bladder cancer.

    • A decade of declining prostatectomy margin positivity within a prostate cancer clinical quality registry

      2022, Urologic Oncology: Seminars and Original Investigations
      Citation Excerpt :

      Commencing soon after inception, PCOR-Vic begun providing to contributing institutions and surgeons a benchmarked report on mutually agreed quality outcomes, including margin status. This confidential report displays individual surgeon or institution data against de-identified peers [9]. We hypothesize that with this personalized feedback, PSM status for patients in the registry decreases with time.

    View all citing articles on Scopus
    View full text