FormalPara Key Points for Decision Makers

Outcome Measures in Rheumatology (OMERACT) has shown that long-term involvement of patients in research is beneficial for identifying and validating outcomes that matter to patients.

Building and sustaining successful partnerships with patients requires restructuring of the research process and investing time and budgets into training and support of patient research partners (PRPs).

The integration of qualitative and quantitative data, complemented by participation of PRPs, enhances the face validity of outcome research.

Ensuring representativeness of the patient perspective for diagnosis, disease severity and cultural, social-economic, and geographical diversity is still challenging.

1 Introduction

There is a growing trend in healthcare research to focus more on outcomes that matter to patients, and more widely on patient-centered research [1, 2]. To this end, the involvement of patients not just as subjects of research but as partners in the design, assessment, and implementation of health research is recommended, and is sometimes mandatory for grant approval [3–5]. In the USA, the Patient-Centered Outcomes Research Institute (PCORI) was established in 2010 to promote research that focuses on those aspects of health that are most meaningful and important to patients. PCORI involves patients at critical stages of the research process to ensure that the questions being asked are relevant and the results are meaningful to people living with a given health condition [6]. In Canada, a unique study explored perspectives of people with osteoarthritis with full involvement of patients in all research phases [7]. In the context of the Innovative Medicine Initiative, the European Union, in collaboration with the pharmaceutical industry, has initiated the European Patients’ Academy on Therapeutic Innovation (EUPATI) to promote the education and active involvement of patients in health research [8]. Internationally, the Cochrane Collaboration involves patients in the development of systematic reviews [9, 10]. The UK has the longest tradition of public and patient involvement through a National Institute of Health Research program called Involve [11]. Within the specialty of rheumatology, the European League Against Rheumatism (EULAR) [12], Outcome Measures in Rheumatology (OMERACT), an international consensus effort, and its member working parties [13], the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis (GRAPPA) [14], and the Assessment of SpondyloArthritis international Society (ASAS) [15] have gained experience and published regarding active involvement of patients in their main activities. In the past years, EULAR and the American College of Rheumatology (ACR) have included patient representatives in their guideline development and other initiatives. In several European countries, arthritis patient organizations have established networks of trained research partners [16, 17].

Although patient engagement in research is promoted, it is often limited to evaluating research proposals for funding or participating in advocacy groups. However, patients can contribute to research in different roles, not only as respondents or study participants but also as advocates, advisors, reviewers, or research partners (Fig. 1). When referring to higher levels of engagement, involving close collaboration in the research process itself, we use the term ‘patient research partner’ (PRP). A PRP is someone living with the relevant disease or condition who participates as an active team member on an equal basis with professional researchers, adding the benefit of his/her experiential knowledge to research projects [13]. There is limited guidance on how high-level patient involvement in research can be achieved, and few case studies to illustrate its success [18–20].

Fig. 1
figure 1

The empirical research circle: potential patient contributions and potential patient roles in research. Phases of the empirical research circle are in blue, examples of potential patient contributions are in orange, and five potential patient roles in research are in black. The role of patient research partner and patient advisor are applicable throughout the research circle. The role of patient reviewer is particularly relevant in the phase of assessing grant applications, often used by research funding bodies. The roles of patient respondent or patient participant mostly relate to the phase of data collection. The role of patient advocate is generally beneficial in the phases of fundraising, establishing supportive legislation for medical research, and dissemination

Full size image

OMERACT, an independent international organization of health professionals, epidemiologists, outcomes researchers, pharmaceutical representatives, and patients [21], has engaged PRPs consistently and increasingly over a period of 14 years [22]. The involvement of patients has been rewarding for both the researchers and the patient representatives. By collaborating with PRPs, relevant outcomes for patients such as fatigue, well-being, and sleep-disturbances have been identified, and PRPs have reported increased knowledge, self-confidence, and empowerment [23, 24]. OMERACT has incrementally learned how to support, promote, and gain from this process. Here we review how PRP involvement in OMERACT was developed, supported, and promoted, how challenges were addressed, and the benefits that have accrued.

2 Outcome Measures in Rheumatology (OMERACT) and the Involvement of Patients

The first OMERACT conference (1992) was convened at a time of actively questioning traditional but arbitrary approaches to assessing the benefits of treatment in rheumatic diseases. The conference aimed to consolidate methodologically oriented approaches that had begun separately in the USA through activities within the ACR and in Europe through the World Health Organization and International League of Associations of Rheumatology (WHO/ILAR). One of the objectives of the first OMERACT conference was to develop consensus on the minimum number of outcome measures to be included in all rheumatoid arthritis (RA) randomized controlled trials. The conference brought together 92 rheumatologists, methodologists, regulatory officials, and pharmaceutical industry researchers from around the world. Agreement was achieved on the outcome domains that are known as the RA core set [25].

Subsequent meetings of OMERACT followed every 2 years, developing and validating specific outcome measures and developing core sets for other rheumatic diseases as proposed by Working Groups within OMERACT. The basis of OMERACT is evidence-based discussions with consensus through nominal group techniques.

In 2000, during discussions about “minimum clinically important” differences in outcome measures [26], there was uncertainty whether the perspective of physicians and researchers was similar to that of patients. Concluding that a representative consensus should include all three, the final plenary voting session at the conference recognized that the patients’ perspective was needed [27], and a decision was made to invite patients to the next meeting.

The 11 PRPs who attended OMERACT 6 (2002) had a limited degree of participation in the meeting. They were asked to review the RA core set from the patient perspective and to identify domains that mattered to patients. It became clear that the views of researchers and patients were not identical [28]. Symptoms of importance to patients such as fatigue, overall well-being, and sleep disturbances were not included in the existing RA core set. Also, the design of clinical trials at that time would not provide patients with the information they felt was needed to judge the success of new treatments. After this meeting, the leadership of OMERACT and a sufficiently large proportion of those actively involved in OMERACT-related research were convinced that PRPs should continue to be involved. Since then, between 17 and 21 patients have participated in each of the OMERACT conferences (Table 1).

Table 1 Characteristics of patients attending Outcome Measures in Rheumatology (OMERACT) conferences
Full size table

Each meeting included patients with the rheumatologic condition featured in the program because experiential knowledge of the condition itself was felt to be critical. Thirty of the 67 PRPs (45 %) have participated in at least two OMERACT conferences, ten of whom have participated in at least four OMERACT conferences. In recent years many more PRPs have been members of OMERACT Working Groups, which carry forward the research agenda between the biannual meetings.

The extent to which PRPs are integrated into the OMERACT meeting program has steadily expanded (Fig. 2). As a consequence, the timetable commitment for PRPs during the meeting has increased from 7.5 h in 2002 to 47 h in 2016. In parallel, OMERACT has developed systems for the selection and support of PRPs, with the funding and organization of their attendance being a practical challenge. However, developing and implementing rules and guidelines recognizing that PRPs are an essential element of all OMERACT activities has been the greatest intellectual challenge [13].

Fig. 2
figure 2

Outcome measures in rheumatology (OMERACT) conference timetabled hours designated for full participation of patient research partners in the program and for patient research partners support sessions

Full size image

3 Recognizing Patient Research Partners (PRPs) as an Essential Element of all OMERACT Activities

3.1 Endorsement by the Leadership and Full Participation in the OMERACT Process

The continuous support of the OMERACT leadership has been crucial, as has the continued increase of experience and patient involvement (Fig. 2) [29]. Initiatives taken by patients, such as producing the OMERACT Glossary (which is now part of every conference information pack) have gradually convinced the majority of OMERACT participants that PRPs make a positive contribution. Results from a recent survey of repeat OMERACT attendees concluded that working with PRPs was one of the aspects that made them return to these meetings [30].

OMERACT values the perspectives of all stakeholders and stimulates open discussions through an interactive meeting design. All participants should be treated as equals and have the same opportunities to contribute to the process. An introductory patient session familiarizes PRPs with the conditions under discussion at the meeting, OMERACT terminology, and procedures. Session moderators provide patients with a pre-session subject overview and provide an environment that encourages all stakeholders, but particularly patients, to speak up and contribute actively in all aspects of the meeting. When voting on consensus decisions, PRPs have full voting rights. The roles played by PRPs at and between OMERACT meetings have steadily expanded to include leading, mentoring, reporting small group discussions, chairing plenary sessions, writing reports, helping to design and facilitate research between meetings, securing funding, and writing and editing papers.

3.2 Support of PRPs and the Sustainability of Participation

OMERACT support for PRPs evolved as experience working together accumulated. Increasing integration of patients into the program (Fig. 2) combined with the achievement of specific milestones was accompanied by greater attention to the support of PRPs (Table 2). Orientation and training sessions have been cumulative and written into the conference program design. The increasing time demand on PRPs has resulted in the introduction of personalized programs to ensure that each PRP is able to attend the sessions most relevant to their condition. Arriving 1 day before the conference and scheduling ‘down time’ during the meeting are included to prevent overburdening and respect disease management (e.g., time for activities of daily living, resting, and doing exercises). An important innovation in 2008 was the introduction of a ‘buddy system,’ where new patient participants are paired with more experienced PRPs. New participants found this extremely helpful [23].

Table 2 Milestones and cumulative patient research partner support activities: 2000–2016
Full size table

Facilitating PRP participation in ongoing research between meetings has been a challenge. Working Group leaders have been confronted with practical issues such as providing lay summaries of documents, preventing overburdening, ensuring sufficient lead time for PRPs to read information and provide feedback, and adequate acknowledgment of PRPs’ contributions. In addition, it is not always clear whether (all) PRPs fulfil the criteria for authorship of peer-reviewed publications. The criteria can vary between groups, to some degree influenced by the PRP’s decision to be coauthor or not. These processes are continually evolving.

3.3 Acceptance of the Role of PRPs by OMERACT Members

In 2014, recommendations for the involvement of PRPs in OMERACT Working Groups were approved by an overwhelming majority at the OMERACT plenary voting session [13]. Together with the appointment of a patient delegate to the Executive Committee, this demonstrates the OMERACT commitment to the principles and practice of substantive patient engagement in the research process to ensure the inclusion of that perspective as a mandatory feature of high-quality outcomes research [13]. This point was arrived at in a stepwise process, with many OMERACT participants gradually changing their views on PRPs’ contributions, and realizing the value they can add to the research process. These developments [29] can be summarized in the observation that increasing experience of working with PRPs has the greatest influence on researchers’ perceptions.

4 Organizing the Attendance of PRPs

4.1 Recruitment, Selection, and Representativeness of PRPs

Potential OMERACT PRPs are first approached by a member of a Working Group, usually a physician. Minimum requirements include being diagnosed with the condition being studied and the ability to speak English, articulate the lived experience with the disease, and travel abroad and participate in an intense 4-day OMERACT working conference. The patient stream leader, who is one of the members of the Executive Committee, approves nominations and invites PRPs to attend the conference. OMERACT aims at an adequate representation of continents, sexes, conditions, and experiences appropriate to each conference program. Ensuring appropriate representativeness of PRPs has been an ongoing challenge. Detailed characteristics have not been systematically collected, but the majority of OMERACT PRPs have been white, middle-class, middle-aged, and higher educated. Attempts have been made to broaden the diversity of the OMERACT PRPs, such as finding participants from Malaysia when the meeting was held there, but it is difficult to involve patients from countries where participatory research is less recognized and physician–patient relationships are traditionally more paternalistic [31]. Nevertheless, the countries of residence of the PRPs (Table 1) are similar to those of the rest of the participants in OMERACT, as is the proportion residing in the USA, Europe, and elsewhere (23, 48, and 29 %, respectively, for PRPs compared with 30, 45, and 25 % for other participants).

Patients and their treating physician are often both involved in OMERACT research, requiring a separation of roles of patient/doctor in the clinic from that of collaborative partners at OMERACT [32]. To facilitate this, each OMERACT meeting has a designated consultant physician available for patients if they have health concerns.

OMERACT expects PRPs to represent their personal perspective of living with the disease, not that of a particular group of patients. Guidelines have been developed to help PRPs and researchers focus on the personal lived experience rather than personal agendas or organizational advocacy [13].

4.2 Resources for Participation

Patient participation in research, and in particular at conferences, requires financial resources. The cost of each PRP attending OMERACT have been met by OMERACT funds or donations organized by Working Groups. These expenses have been considerable, and accommodating patients with severe disabilities may require special transportation arrangements (e.g., supplemental oxygen on flights, personal assistance, or special travel arrangements). The average cost per patient has been similar for almost all meetings; the total cost for patient attendance for each of the last three meetings has been approximately US$100,000 per meeting (in 2014 values [US$] after correction for US inflation). This is a considerable portion of the central funds available to OMERACT and represents a major fundraising commitment by the OMERACT Executive Committee.

5 Challenges and Benefits

5.1 Demonstrating the Impact of PRPs

There is evidence that engaging patients structurally in outcomes research provides benefits for the overall research process [5, 33, 34]. Patients’ questions, opinions, and concerns provided face validity to the OMERACT process and widened the research agenda [24]. New domains, including fatigue, foot problems, stiffness definition, work productivity, and flares, were identified by patients and prompted new research. The involvement of PRPs enhanced the inclusion of patient-relevant outcomes in core sets. It changed the culture of OMERACT and may influence practice in other disciplines and research contexts. At the individual level, PRPs reported ‘positive pay-back’ in feeling more empowered towards their own disease, they appreciated opportunities to contribute to the greater community, and felt better able to keep abreast of research developments related to their disease [24].

In the 2014 OMERACT survey, Working Group leaders valued the PRPs’ feedback as a reality check of the relevance and quality of their project, and stated that the feedback influenced the choice of appropriate outcomes and instruments. Interestingly, patients were less certain about the added value of their experiential knowledge to the overall research. This confirms earlier findings that patients tend to underestimate their contribution to the research process [23].

5.2 Risk of Pseudo-Professionalization

Almost half of OMERACT PRPs have attended two or more OMERACT conferences and some are highly involved in other ongoing research projects. As these patient participants have become more experienced, some researchers have welcomed their increased familiarity with research processes and vocabulary. However, others have questioned the authenticity of their patient perspective because they felt training and support over a long period of time could result in ‘professional patients’ who are not able to represent the ‘naïve’ or ‘authentic’ patient perspective [29] and therefore do not represent ‘ordinary’ patients. Whether this is true is open to debate [29], but OMERACT minimizes this risk by ensuring a mixture of new and more experienced PRPs at meetings, and by focusing education on the ability of PRPs to articulate their personal experience in the context of outcome research.

5.3 Extent of Patient Participation Between Meetings

A 2014 internal OMERACT survey showed that 14 of 18 Working Group leaders reported patient involvement between conferences, usually including at least two PRPs. Involvement included regular electronic communications, teleconferences, and face-to-face meetings where possible. The survey revealed differences between researchers and PRPs in their perception of the role played by PRPs. Most PRPs perceived themselves as “advisors” or “information providers”; four viewed themselves as collaborators and one PRP reported a leadership role. In contrast, Working Group leaders perceived that PRPs had higher levels of involvement: ten Working Group leaders viewed PRPs as “collaborators” in their projects and two Working Group leaders mentioned the role as being “in control”. This disparity might be explained by the varying maturity of Working Groups in regards to their activities and the tendency of PRPs to underestimate the influence of their participation [23].

5.4 PRPs in Different Types of Projects

There remains some debate as to whether the appropriate extent of patient participation may depend on the particular research project. Although OMERACT recommends involvement of patients as PRPs throughout the research process, in reality this is not always feasible. Some patients provide valuable input into one or more research phases, not as a PRP but as a patient advisor. For example, in a study to develop or evaluate a new imaging modality, it may be argued that patients’ perspectives are not as necessary for the assessment of the measurement algorithms or scoring method. However, it would be appropriate for patients to comment on the burden, safety, and feasibility of a test and to understand how the results could be used in guiding their care.

5.5 Examples of PRPs in Working Groups

A detailed analysis of the consequences of PRP involvement in OMERACT has been published [24, 27]. Here we showcase two working groups that substantively engaged patients in all their activities. After patients identified fatigue as an often ignored and under-researched disease symptom, the OMERACT Fatigue Working Group initiated a research agenda with studies at different centers to systematically explore the phenomenon of fatigue. The Working Group looked at its severity and evaluated existing measurement instruments and are developing new ones. Patients have been involved on different levels and in different roles [35]. In the development of a new patient-reported outcome measure for fatigue, patients played a pivotal role in focus group meetings, individual interviews, surveys, clinical trials, cognitive interviews, as well as in the OMERACT Working Group. The result has been a new instrument, the Bristol Rheumatoid Arthritis Fatigue (BRAF) questionnaire [36], which is based on the conceptual framework developed from qualitative studies, ensuring its face validity. New data on the impact and measurement of fatigue have resulted in the recommendation to measure fatigue in clinical trials [37] and in clinical care to reconcile disparities between physician and patient assessments of disease activity [38].

The OMERACT RA Flare Working Group involved patients from its initiation through every stage of the project. Since the inception of the project in 2006, the role of PRPs has been intense and diverse [35]. Tasks were related to developing the design of the study, co-organizing focus group meetings, and coding and analyzing transcripts. PRPs participated in international, bi-weekly teleconferences to discuss the development of an instrument to measure flares, and a patient committee held additional face-to-face meetings and teleconferences with other group leaders for feedback and discussion of research progress and interim findings [39]. This work is ongoing.

6 Discussion

The way patients are involved as research partners in OMERACT has grown from an initial tightly circumscribed and experimental arrangement in 2002 to complete involvement at all levels of activity, supported by an inclusive and supportive code of practice approved by the membership in 2014. During this time, OMERACT has successfully introduced a number of conceptual, structural, and practical processes to ensure the integration of the patient perspective and substantive engagement throughout outcome measure development. These have centered on recognizing PRPs as an essential element of all OMERACT activities and funding and organizing the attendance of PRPs. Initial leadership commitment to providing resources for participation and a structure for the recruitment, selection, and support of PRPs was crucial. The experience of working with PRPs led to a stepwise acceptance and then encouragement of the role by OMERACT members and has resulted in increased PRP engagement in Working Group activities between OMERACT meetings. This approach can be applied by other societies and research groups [40], and may result in the development of different structural and procedural changes to ensure that PRPs are supported and productive in that setting.

PRP inclusion in the OMERACT process is not intended to represent the perspective of all patients as they only represent themselves and their experiences. However, having two patients within a Working Group, whatever their background and experience, is infinitely better than not involving patients at all. Ensuring a more representative view may be achieved through the use of mixed research methods that include qualitative interviews, focus groups, Delphi methods, or surveys to expand the input across a wider spectrum of patients [19]. Such methods are increasingly recognized as an essential requisite of outcomes research in identifying and defining the concept of measurement (e.g., what you are seeking to measure) grounded in the patient experience, and to ensure that the ultimate measure is reflective of this concept [2].

While many have advocated increased participation in research, developing metrics to demonstrate the added value of such inclusion is challenging. In this report we provide not only experiential evidence from the perspectives of patients and researchers, but real evidence of change in the direction of research endeavors, and more detailed analyses are available [17, 23, 24, 27, 29, 30]. The recognition of fatigue as an important aspect of living with RA has now been incorporated into recommendations for patient assessments in clinical care, and for clinical trials, though the optimal measure has yet to be defined. There are few publications that have described methods of successful engagement in detail [41], and further studies are needed to provide additional evidence of the benefits and impact of patient participation.

While the work reported here has been limited to rheumatology, the conceptual foundations and the framework developed for patient inclusion are widely applicable across all chronic diseases and beyond outcomes research [42, 43]. EULAR now recommends involvement of PRPs throughout the research process, preferably from the beginning [12]. PCORI has also recently developed a rubric for patient and stakeholder engagement that provides examples of how patients can be involved at different phases of research [44, 45]. The US Food & Drug Administration Critical Path Initiative, the Core Outcome Measures in Effectiveness Trials (COMET) initiative [46], and the International Society for Quality of Life research (ISOQOL) [47] have also begun to integrate PRPs in their work. The process explained here should be useful in other contexts and to other specialties. Moving such an agenda forward is time consuming and necessitates enthusiasm and perseverance, particularly to support and train patients and health professionals. However, OMERACT researchers value patient participation highly in conferences and this is one of the central reasons for their ongoing participation [30]. The dialogue and engagement between researchers and PRPs has greatly improved the quality of core outcome sets, by ensuring that outcomes are relevant to patients [48, 49]. Patient participation has enriched the research agendas and enhanced mutual understanding of outcomes of importance for both patients and researchers [24].

The experience of OMERACT should help move policy makers, funders, and researchers closer to the view that participatory research is not only a normative imperative for outcome research, but is also effective in producing relevant research and health outcomes [41].