Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Availability of specific tools to assess patient reported outcomes in hip arthroplasty in Spain. Identifying the best candidates to incorporate in an arthroplasty register. A systematic review and standardized assessment

  • Jorge Arias-de la Torre ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    jariasdelatorre@gencat.cat

    Affiliations Agency for Heath Quality and Assessment of Catalonia (AQuAS), Barcelona, Spain, CIBER Epidemiology and Public Health (CIBERESP), Madrid, Spain, Institute of Biomedicine (IBIOMED), University of León, León, Spain

  • Elisa Puigdomenech ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation

    Affiliations Agency for Heath Quality and Assessment of Catalonia (AQuAS), Barcelona, Spain, eHealth Lab Research Group, School of Health Sciences, Universitat Oberta de Catalunya, Catalonia, Spain

  • Jose M. Valderas ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Software, Supervision, Validation, Visualization

    Affiliation Health Services and Policy Research Group, University of Exeter Medical School, Exeter, United Kingdom

  • Jonathan P. Evans ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation

    Affiliations Health Services and Policy Research Group, University of Exeter Medical School, Exeter, United Kingdom, Royal Devon and Exeter NHS Foundation Trust, Exeter, United Kingdom

  • Vicente Martín ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Supervision, Validation

    Affiliations CIBER Epidemiology and Public Health (CIBERESP), Madrid, Spain, Institute of Biomedicine (IBIOMED), University of León, León, Spain

  • Antonio J. Molina ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Supervision, Validation

    Affiliation Institute of Biomedicine (IBIOMED), University of León, León, Spain

  • Nuria Rodríguez ,

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Investigation, Supervision, Validation

    Affiliation Agency for Heath Quality and Assessment of Catalonia (AQuAS), Barcelona, Spain

  • Mireia Espallargues

    Contributed equally to this work with: Jorge Arias-de la Torre, Elisa Puigdomenech, Jose M. Valderas, Jonathan P. Evans, Vicente Martín, Antonio J. Molina, Nuria Rodríguez, Mireia Espallargues

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Agency for Heath Quality and Assessment of Catalonia (AQuAS), Barcelona, Spain, Health Services Research on Chronic Patients Network (REDISSEC), Madrid, Spain

Abstract

Purpose

1) To systematically review the available scientific literature regarding specific instruments developed and/or tested in a Spanish population, to assess these PROMs in hip arthroplasty; 2) to carry out a standardized assessment of their measurement properties; and 3) to identify the best tools for use in Spain in an arthroplasty registry context.

Methods

A systematic review of PubMed/MEDLINE and EMBASE and CINHAL was done. Furthermore, a standardized assessment of the questionnaires identified using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) tool was performed. All developments, validation and studies aiming to assess the measurement properties of PROMs in hip arthroplasty in the Spanish population were included. Data from the questionnaires on metric properties was taken into account to identify the best candidates for inclusion in a register.

Results

A total of 853 documents were found. After screening title and abstract, 13 full text documents were reviewed and 8 questionnaires adapted and validated to assess some of the aspects of hip arthroplasty in the Spanish population were identified. After the EMPRO assessment, 4 questionnaires showed suitable properties (WOMAC, OAKHQOL, mini-OAKHQOL and PFH).

Conclusions

In Spain, there are a few suitable hip-specific questionnaires currently available to assess PROMs in hip arthroplasty surgery. Some of the more widely used questionnaires, like the OHS and HOOS, have not been validated in the Spanish population until now. Identified tools are suitable for use in a clinical context, however their use in an arthroplasty register is more questionable due to the lack of validation studies of the widely used tools in other registers.

Background

Hip arthroplasties are presently one of the most frequent elective surgeries worldwide. The evidence related to these surgeries points to a significant improvement in the physical function and health-related quality of life of the individuals, as well as the cost-effectiveness and long-term results of these procedures [1,2].

Traditionally, studies on hip arthroplasty surgery have focused on different outcomes, commonly related to patient survival and type of prosthesis used for the arthroplasty [3,4]. These studies usually aimed to assess the mortality rate of patients with a specific type of prosthesis or the revision risk of their prosthesis. Despite this, when assessing the results of a hip arthroplasty, evaluating Patient-Reported Outcome Measures (PROMs) such as quality of life, pain or physical function, among others [3,57] has gained importance in recent years, since they can provide different aspects not covered by traditional outcomes like patient-centred care, clinical decision-making or their possible implications in health policy.

There is currently a consensus, both in clinical and in research communities regarding the importance of considering PROMs in hip arthroplasties before and after surgery [2,6,8,9]. In the context of arthroplasty registers, this consensus is made explicit with the continuous incorporation and development of PROMs programs in registers around the world [10,11]. However, this consensus is not such for the most suitable tools to assess these PROMs [12]. As seen from the conclusions of several systematic reviews, until now there have been differences regarding the questionnaires recommended and used, in terms of the quality of different instruments [1317] and the tools used by arthroplasty registries and clinical trials [10,11].

The instruments used to assess PROMs in hip arthroplasties could be classified in terms of the population they focus on. Specific tools designed to be used solely in populations with hip pathology, e.g. Oxford hip Score (OHS), Hip disability and Osteoarthritis Outcome Score (HOOS), or Harris Hip Score (HHS); and general tools designed for use by the population as a whole, e.g. Short Form-12 or 36 (SF-12 or SF-36), EuroQol-5D (EQ-5D), or World Health Organization Quality of Life Instrument (WHO-QoL) [6,13,14,1820]. Some of these tools have been deemed suitable measurement properties for use in hip arthroplasty populations worldwide [10,13,14]. In spite of this evidence, and bearing in mind the differences in results among high quality reviews, particularly with specific tools [1315,17,21], it might be useful to carry out a standardized assessment and systematic comparison when choosing the best tool possible, depending on its context of use. On one hand, a standardized assessment and comparison could be useful to recommend a concrete tool that assesses PROMs in a clinical context, while on the other hand, it might be useful to select the most appropriate tool to be included in an arthroplasty register [22,23].

Focusing on hip-specific PROMs, their selection is generally context-dependent and guided by different criteria of which could be remarkable, among others, the tradition of use in a specific context or country or the availability of a tool [11]. Despite the possible high quality of the selected tools, these criteria are not generally based on a systematic review and comparison of the properties of the tools. Thus, to perform systematic reviews and standardised comparisons of these tools for specific contexts, it could be highly valuable to the decision making process when selecting a questionnaire to assess PROMs in hip arthroplasty.

Therefore, the aims of this study are: 1) to systematically review the scientific literature available about specific instruments developed and/or tested in a Spanish population and Spanish language, to assess PROMs in hip arthroplasty; 2) to evaluate and carry out a standardized assessment of their measurement properties; and 3) to identify the best candidates to be used in an arthroplasty registry context in Spain.

Methods

To find relevant studies on available hip-specific tools in the Spanish population, a systematic review was performed in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (S1 Checklist) guidelines [24] and registered with PROSPERO under registry number CRD42018083626 [25].

The search was done up to 01/01/2018 and there was no restriction on the start date. Searches were conducted in the following databases: PubMed/MEDLINE, EMBASE and CINAHL. They were done using a filter developed specifically for PubMed/MEDLINE, which was then adapted for the other databases (S1 Filter). In addition, a manual search was conducted to retrieve any studies that might not have been included in the review. The search strategy and filter development was guided by previous systematic review filters used to select PROMs tools and the Spanish population [13,14,26,27]. Furthermore, references of the retrieved articles were screened for relevant studies, and relevant authors identified in the developmental studies of the different tools were contacted. After the systematic review, the tools assessed in the studies were identified and a standardized assessment of the adequacy of their measurement properties was done using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) tool.

Study inclusion and exclusion criteria and the review process

Population, Intervention, Comparison, Outcome (PICO) criteria were used. All development, adaptation, validation and studies aimed to assess the metric properties of procedure- or condition-specific tools used to assess PROMs in hip arthroplasty in the Spanish population were included. The following exclusion criteria were used: studies published in a language other than English or Spanish, studies focused on general tools, studies not focused on patients undergoing a hip arthroplasty or on the waiting list for one (e.g. studies focused only on osteoarthritis of the hip and not on hip arthroplasty), studies where it was impossible to determine the joint operated on, surgical technique papers and case studies or studies involving fewer than 10 patients. Due to the cross-cultural adaptation and the possible bias related to the comparability of metric properties between populations, only full-texts of tools developed and/or tested in the Spanish population (from Spain) were included [2830].

After identifying the studies, a screening was done based on the outlined inclusion/exclusion criteria, first by title and abstract and then by full text. All papers that did not meet the inclusion criteria were excluded from the review. All documents identified were revised independently by 2 expert reviewers (JA and JE). If the reviewers did not reach an agreement regarding one or more papers or attributes, a third reviewer (JMV) revised the documents and assessed the questionnaires to arrive at a consensus. After the revision, a standardized assessment of metric properties of the identified tools was done by 2 reviewers (JA and EP) using the EMPRO tool. Before the review, the comprehension of the research aims was assessed using a 10-study pilot and measured using Cohen’s Kappa statistic. None of the reviewers was involved in developing the measures assessed.

Data extraction and standardized evaluation of proms questionnaires

Data about the instruments identified in the studies included after the screening was retrieved. Information regarding their measurement properties was considered, following the Medical Outcomes Trust classification [31]. In addition, a narrative synthesis of the evidence found in each questionnaire was performed. The quality of the identified questionnaires was assessed and compared based on the evidence found in the studies included.

For the standardized assessment of the questionnaires, the EMPRO tool was used [22]. EMPRO is a tool designed for the standardized evaluation of the quality of instruments used to assess PROMs, based on the Medical Outcomes Trust criteria [31,32]. The questionnaire consists of 39 Likert-type items with a response scale from 1 (“strongly disagree”) to 4 (“strongly agree”) that are distributed among 8 attributes described in Table 1: Conceptual and measurement model (7 items); Reliability (8 items); Validity (6 items); Responsiveness (3 items); Interpretability (3 items); Administration burden (7 items); Alternative modes of administration (2 items); and Cross-cultural and linguistic adaptations (3 items). Additionally, the questionnaire provides a space for comments and references in each item and some items have the response option ‘‘no information” or ‘‘not applicable” when the information is insufficient or not suitable. To conclude the questionnaire, an overall recommendation is provided on a scale with the following response categories: “Strongly recommended”, “Recommended with provisos or alterations”, “Would not recommend” and “Unsure” with a rationale for the recommendation. A score for each attribute was calculated using the mean of the responses to all items composing that attribute and a linear transformation was done to obtain a score from 0 (the worst possible score) to 100 (the best possible score). Finally, an overall score for the questionnaire based on the mean score of the metric-related attributes (conceptual and measurement model, reliability, validity, responsiveness and interpretability) was obtained.

thumbnail
Table 1. Attributes assessed using the Evaluating the Measurement of Patient-Reported Outcomes (EMPRO) tool.

https://doi.org/10.1371/journal.pone.0214746.t001

Results

Fig 1 shows a flow diagram of the review process. Using the filter developed for systematic review, a total of 853 documents were identified. Of these, 715 (83.8%) were identified in PubMed/MEDLINE, 91 (10.7%) in EMBASE, 41 (4.8%) in CINAHL and 6 (0.7%) through a manual search. After checking for duplicates, 117 (13.7%) were removed. Of the remaining 736 titles, 696 were excluded, leaving a total of 40 abstracts to screen. After screening the abstracts, 21 full text articles were considered. Of these documents, 8 were excluded: 1 was a conference abstract, 4 were focused on hip osteoarthritis without considering hip replacement or it was impossible to determine the operated joint, 2 aimed to establish prioritisation systems rather than assess PROMs in hip replacement, and 1 was focused on variables that might act as predictors of PROMs and not on their specific measurement properties. Finally, a total of 13 full text articles published between 1997 and 2017 were included in the data extraction [3345].

Taking into account the instruments included in the studies (Table 2), a total of 8 tools were identified, four of which were variants or sub-scales of other main tools. In terms of specific questionnaires, we found: The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) [3336,44], composed by 24 Likert-type items designed to assess pain, stiffness and physical function; two different versions of the WOMAC Short Form, each composed of 11 items with 5 Likert-type items [35,37]; The WOMAC Short Form (Function dimension) composed of 7 items validated to assess functionality in joint replacement [38]; The Pain and Function of the Hip scale (PFH) composed of 9 Likert-type items to assess pain, function and mobility/strength [41,42,45]; The Osteoarthritis Knee and Hip Quality of Life (OAKHQOL) composed of 43 Likert-type items, 40 of which are used to assess physical activity, mental health, pain, social support and social functioning [39]; The Mini-OAKHQOL composed of 20 Likert-type items to assess the same dimensions as the long version (OAKHQOL); and the Harris Hip Score (HHS), with 10 Likert-type items that assess pain, function, amplitude of movement and absence of deformity [43].

thumbnail
Table 2. General characteristics of the instruments identified from validation studies in hip arthroplasty population.

https://doi.org/10.1371/journal.pone.0214746.t002

Considering the properties of the identified tools, Table 3 shows their adaptation according to the EMPRO standardized assessment. Based on the overall score, it was observed that only OAKHQOL, mini-OAKHQOL, WOMAC and PFH could be considered as reasonably acceptable (EMPRO overall score > = 50). The highest overall score corresponded to WOMAC with a score of 65.47, followed by OAKHQOL with a score of 58.87, mini-OAKHQOL with 58.57 points and PFH with 50.71 points. In addition, focusing on the specific metric attributes it was observed that all the assessed tools have EMPRO scores equal to or higher than 50 in reliability, validity and responsiveness, except PFH in validity. Only WOMAC and PFH had a score equal to or higher than 50 points in conceptual and measurement model and in interpretability. Regarding non-metric attributes (cultural adaptation and burden), only OAKHQOL had a score equal to or higher than 50 points.

thumbnail
Table 3. Attributes of each of the questionnaires identified from the studies included in the systematic review.

EMPRO.

https://doi.org/10.1371/journal.pone.0214746.t003

Discussion

Nowadays in Spain, the availability of specific tools to assess PROMs in hip arthroplasty is limited. After the systematic review of the available literature, only eight instruments (including short forms) were identified. Of these instruments only WOMAC, OAKHQOL, mini-OAKHQOL, and PFH, have shown suitable measurement properties to be used in the Spanish population. In addition, none of the most widely used hip-specific questionnaires was identified in arthroplasty registers around the world [10,11,21]. This evidence suggests that there are some suitable tools to be included in an arthroplasty register currently in Spain but, before deciding to do so, it might be valuable to carry out validation studies of widely used hip-specific tools in other registers worldwide as OHS and HOOS.

Taking into account the specific tools assessed in our study, only 4 were identified as suitable candidates and 1 of them, mini-OAKHQOL, was a shorter version of one of the main tools. Of these tools, the most acceptable, according to EMPRO guidelines, was WOMAC, which was the only tool used by 4 other arthroplasty registers worldwide [11]. In addition, the similarity between the EMPRO overall scores from OAKHQOL and the shorter version should be highlighted. Given the similarity in metric properties, we could argue that it would be better to use the mini-OAKHQOL tool over the full version since it has a lower burden, but this hypothesis requires more evidence to support it.

Several reviews assessing the acceptability of instruments to evaluate PROMs in hip arthroplasty were previously done in other countries [1315,17]. From these reviews, specific instruments used with better properties were identified, which in most cases were the OHS and the HOOS. In addition, the most common instruments used in other registries were also the OHS and HOOS [10,21].

Regarding OHS, this questionnaire is one of the most widely used for different reasons, among which could be highlighted its length, including only 12 items, and its acceptable metric properties to be used in a wide range of languages and countries. Despite this, for the Spanish population, only one validation study was found [46]. This study was condition-focused and not procedure-focused, which was why we decided to exclude it. Patient characteristics of the population included in this study might be different from arthroplasty patients. For this reason, and bearing in mind one of the objectives was to select the best candidate tool to be included in an arthroplasty register, we decided to discard this study, again showing the need for procedure-focused validation studies of this questionnaire. The HOOS questionnaire is also one of the most widely used questionnaires in hip arthroplasties, used by the Swedish Arthroplasty Register among others [47], and has shown its acceptability in metric terms in other contexts [13,14,18,20,48]. With these reasons in mind, we propose that the adaptation and validation of OHS and HOOS in the hip arthroplasty population could be valuable in our context, both for clinical use and to know what could be the most acceptable tool for inclusion in an arthroplasty register.

Finally, and despite the suitability of the metric properties of all tools in which was possible to calculate an EMPRO overall score, except WOMAC Short Form whose score was on the border of acceptability, we should highlight that they might only be considered as partially suitable candidates for inclusion in an arthroplasty register. As these tools are not among those most used by other registries, it is difficult to pool data and compare them. Additionally, when the properties of PROMs tools were compared in other contexts and countries [13,14,17], these tools were not present in some cases, OAKHQOL mini-OAKQOL and PFH, for example, or they were not the best candidates for adequacy or specificity. On the other hand, focusing on WOMAC, it should also be noted that the full questionnaire is included in HOOS, which is one of the more widely used questionnaires to assess PROMS in hip arthroplasties [14,20,48,49].

Some limitations of this review should be discussed. Firstly, we should mention that we only examined tools developed and/or tested in the population from Spain. This inclusion criteria, seems to limit the scope of the study. In spite of this, we think that with this approach, our results are much more accurate. Thus, we deem that they could be much more useful for the clinical community of Spain and, furthermore, they may serve as baseline for future comparative studies between countries. Besides, we have to remark the possible publication bias that could affect the results shown. Studies about PROMs could be unpublished or published as grey literature. Despite this, we have tried to be as exhaustive as possible in the literature search and have also tried to contact the most influential authors. As such, we feel that we have identified at least the main validation literature focused on hip arthroplasty specific tools. Another limitation is that we have excluded studies focused on patients with OA if the patients included in the studies were not on a waiting list or undergoing hip arthroplasty. Though OA is by far the most common cause of total hip replacement, it should be noted that not all patients affected by OA are eligible candidates for an arthroplasty [5053]. OA is a chronic condition that could affect people with very different characteristics, including young patients and patients with non-severe OA. Young patients able to perform their daily activities well should not be eligible for an arthroplasty, and especially not for a total hip replacement. For these reasons, we consider the outlined inclusion and exclusion criteria appropriate to address the aims of this study. In addition, we want to point out the limitation related to including only hip specific tools and not general tools. General instruments are widely studied and should be used as the first approach to PROMs assessment. Nevertheless, and despite their use for assessment of specific populations, these instruments were not specifically designed to assess PROMs, which means their responsiveness could be compromised. Furthermore, in some cases the constructs evaluated with general tools are not the same or not entirely equivalent than those evaluated by the specific tools. After taking the conceptual differences between general and specific tools into account, particularly when used in specific populations, we decided to exclude general tools. Finally, we should highlight the lack of validation studies developed from the Item Response Theory (IRT) perspective. Including this approach when evaluating the metric properties of questionnaires could improve the precision of their assessment and decision making when selecting a specific tool.

In conclusion, our study shows that currently in Spain, there are some specific questionnaires with adequate metric properties to assess PROMs in hip arthroplasty. These tools are: WOMAC, OAKHQOL, mini-OAKHQOL and PFH. While these tools might be considered suitable for use in a clinical context, their recommendation for use in an arthroplasty register is more questionable, mainly due to the lack of validation studies of the OHS and HOOS, the more widely used tools in this context.

Supporting information

S1 Filter. PubMed filter.

PubMed/MEDLINE filter. Psychometric properties of specific PROMs questionnaires in the Spanish population.

https://doi.org/10.1371/journal.pone.0214746.s002

(DOCX)

Acknowledgments

We acknowledge Kayla Smith for the technical support she gave to this revision.

References

  1. 1. Räsänen P, Paavolainen P, Sintonen H, Koivisto A-M, Blom M, Ryynänen O-P, et al. Effectiveness of hip or knee replacement surgery in terms of quality-adjusted life years and costs. Acta Orthop. 2007;78: 108–115. pmid:17453401
  2. 2. Jones CA, Beaupre LA, Johnston DWC, Suarez-Almazor ME. Total joint arthroplasties: current concepts of patient outcomes after surgery. Rheum Dis Clin North Am. 2007;33: 71–86. pmid:17367693
  3. 3. Halawi MJ. Outcome Measures in Total Joint Arthroplasty: Current Status, Challenges, and Future Directions. Orthopedics. 2015;38: e685–9. pmid:26270754
  4. 4. Serra-Sutton V, Allepuz A, Espallargues M, Labek G, Pons JM V. Arthroplasty registers: A review of international experiences. Int J Technol Assess Health Care. 2009;25: 63–72. pmid:19126253
  5. 5. Rothman M, Burke L, Erickson P, Leidy NK, Patrick DL, Petrie CD. Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value Health. 12: 1075–83. pmid:19804437
  6. 6. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346. pmid:23358487
  7. 7. Valderas JM, Alonso J. Patient reported outcome measures: A model-based classification system for research and clinical practice. Qual Life Res. 2008; pmid:18836850
  8. 8. Ethgen O, Bruyère O, Richy F, Dardennes C, Reginster J-Y. Health-related quality of life in total hip and total knee arthroplasty. A qualitative and systematic review of the literature. J Bone Joint Surg Am. 2004;86–A: 963–74. Available: http://www.ncbi.nlm.nih.gov/pubmed/15118039 pmid:15118039
  9. 9. Gagnier JJ. Patient reported outcomes in orthopaedics. J Orthop Res. 2017;35: 2098–2108. pmid:28513993
  10. 10. Rolfson O, Eresian Chenok K, Bohm E, Lübbeke A, Denissen G, Dunn J, et al. Patient-reported outcome measures in arthroplasty registries. Acta Orthop. 2016;87: 3–8. pmid:27168175
  11. 11. Rolfson O, Bohm E, Franklin P, Lyman S, Denissen G, Dawson J, et al. Patient-reported outcome measures in arthroplasty registries. Acta Orthop. 2016;87: 9–23. pmid:27228230
  12. 12. Lovelock TM, Broughton NS, Williams CM. The Popularity of Outcome Measures for Hip and Knee Arthroplasties. J Arthroplasty. 2017; pmid:28939034
  13. 13. Harris K, Dawson J, Gibbons E, Lim C, Beard D, Fitzpatrick R, et al. Systematic review of measurement properties of patient-reported outcome measures used in patients undergoing hip and knee arthroplasty. Patient Relat Outcome Meas. 2016;Volume 7: 101–108. pmid:27524925
  14. 14. Thorborg K, Roos E, Bartels E, Petersen J, Holmich P. Validity, reliability and responsiveness of patient-reported outcome questionnaires when assessing hip and groin disability: a systematic review. Br J Sports Med. 2010;44: 1186–1196. pmid:19666629
  15. 15. Thorborg K, Tijssen M, Habets B, Bartels EM, Roos EM, Kemp J, et al. Patient-Reported Outcome (PRO) questionnaires for young to middle-aged adults with hip and groin disability: a systematic review of the clinimetric evidence. Br J Sports Med. 2015;49: 812–812. pmid:25586913
  16. 16. Veenhof C, Bijlsma JWJ, van den Ende CHM, Dijk GM van, Pisters MF, Dekker J. Psychometric evaluation of osteoarthritis questionnaires: A systematic review of the literature. Arthritis Rheum. 2006;55: 480–492. pmid:16739188
  17. 17. Alviar M, Olver J, Brand C, Tropea J, Hale T, Pirpiris M, et al. Do patient-reported outcome measures in hip and knee arthroplasty rehabilitation have robust measurement attributes? A systematic review. J Rehabil Med. 2011;43: 572–583. pmid:21607295
  18. 18. Nilsdotter AK, Lohmander LS, Klässbo M, Roos EM. Hip disability and osteoarthritis outcome score (HOOS)—Validity and responsiveness in total hip replacement. BMC Musculoskelet Disord. 2003; pmid:12777182
  19. 19. Dawson J, Fitzpatrick R, Murray D, Carr A. Comparison of measures to assess outcomes in total hip replacement surgery. Qual Saf Heal Care. 1996;
  20. 20. Klässbo M, Larsson E, Mannevik E. Hip disability and osteoarthritis outcome score: An extension of the Western Ontario and McMaster Universities Osteoarthritis Index. Scand J Rheumatol. 2003;
  21. 21. Paulsen A. Patient reported outcomes in hip arthroplasty registries. Dan Med J. 2014;61: B4845. Available: http://www.ncbi.nlm.nih.gov/pubmed/24814747 pmid:24814747
  22. 22. Valderas JM, Ferrer M, Mendívil J, Garin O, Rajmil L, Herdman M, et al. Development of EMPRO: A Tool for the Standardized Assessment of Patient-Reported Outcome Measures. Value Heal. 2008;11: 700–708. pmid:18194398
  23. 23. Mokkink , Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19: 539–549. pmid:20169472
  24. 24. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Journal of clinical epidemiology. 2009. pp. e1–34. pmid:19631507
  25. 25. Booth A, Clarke M, Dooley G, Ghersi D, Moher D, Petticrew M, et al. The nuts and bolts of PROSPERO: An international prospective register of systematic reviews. Syst Rev. 2012;1. pmid:22587842
  26. 26. Valderas JM, Mendivil J, Parada A, Losada-Yáñez M, Alonso J. Construcción de un filtro geográfico para la identificación en PubMed de estudios realizados en España. Rev Española Cardiol. 2006;59: 1244–1251.
  27. 27. Terwee CB, Jansma EP, Riphagen II, de Vet HCW. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18: 1115–1123. pmid:19711195
  28. 28. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Heal. 2005;8: 94–104. pmid:15804318
  29. 29. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine (Phila Pa 1976). 2000;
  30. 30. Herdman M, Fox-Rushby J, Badia X. “Equivalence” and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;
  31. 31. Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11: 193–205. Available: http://www.ncbi.nlm.nih.gov/pubmed/12074258 pmid:12074258
  32. 32. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013; pmid:23288613
  33. 33. Escobar A, Quintana JM, Bilbao A, Azkárate J, Güenaga JI, A. E, et al. Validation of the Spanish version of the WOMAC questionaire for patients with hip or knee osteoarthritis. Clin Rheumatol. A. Escobar, Unidad de Investigacion, Hospital de Basurto, Avenida de Montevideo 18, 48013 Bilbao, Spain. E-mail: aescobar@hbas.osakidetza.net: Springer London (The Guildway, Old Portsmouth Road, Artington, Guildford GU3 1LP, United Kingdom); 2002;21: 466–471. pmid:12447629
  34. 34. Quintana JM, Escobar A, Bilbao A, Arostegui I, Lafuente I, Vidaurreta I. Responsiveness and clinically important differences for the WOMAC and SF-36 after hip joint replacement. Osteoarthr Cartil. 2005;13: 1076–1083. pmid:16154777
  35. 35. Lopez Alonso SR, Martinez Sanchez CM, Romero Canadillas AB, Navarro Casado F, Gonzalez Rojo J. [Metric properties of WOMAC questionnaires-original and reduced versions-to measure symptoms and Physical Functional Disability]. Aten primaria. Spain; 2009;41: 613–620. pmid:19464081
  36. 36. Quintana JM, Aguirre U, Barrio I, Orive M, Garcia S, Escobar A. Outcomes after total hip replacement based on patients’ baseline status: What results can be expected? Arthritis Care Res. 2012;64: 563–572. pmid:22183807
  37. 37. Bilbao A, Quintana JMJM, Escobar A, Las Hayas C, Orive M, A. B, et al. Validation of a proposed WOMAC short form for patients with hip osteoarthritis. Health Qual Life Outcomes. England: BioMed Central Ltd. (Floor 6, 236 Gray’s Inn Road, London WC1X 8HB, United Kingdom); 2011;9: 75. pmid:21936886
  38. 38. Escobar A, Vrotsou K, Bilbao A, Quintana JM. A, García Pérez L, Herrera-Espiñeira C, et al. [Validation of a short form of the function dimension of the WOMAC questionnaire]. Gac Sanit. Spain: Ediciones Doyma, S.L. (Travesera de Gracia 17–21, Barcelona 08021, Spain); 2011;25: 513–518. pmid:21945068
  39. 39. Gonzalez Sáenz de Tejada M, Escobar A, Herdman M, Herrera C, García L, Sarasqueta C. Adaptation and validation of the Osteoarthritis Knee and Hip Quality of Life (OAKHQOL) questionnaire for use in patients with osteoarthritis in Spain. Clin Rheumatol. 2011;30: 1563–75. pmid:21947701
  40. 40. Gonzalez Sáenz de Tejada M, Bilbao A, Herrera C, García L, Sarasqueta C, Escobar A. Validation of the Mini-OAKHQOL for use in patients with osteoarthritis in Spain. Clin Rheumatol. 2017;36: 1855–1864. pmid:28353088
  41. 41. Valls JM, Alonso J. Clinical results and perceived health among patients with hip prosthesis. Med Clin (Barc). 1997;108: 691–695. pmid:9324584
  42. 42. Alonso J, Lamarca R, Marti-Valls J. The pain and function of the hip (PFH) scale: a patient-based instrument for measuring outcome after total hip replacement. Orthopedics. 2000;23: 1273–1277. Available: file://u/Art?culos Unidad en PDF/2000/5948 Orthop Alonso.pdf pmid:11144496
  43. 43. Navarro Collado MJ, Peiró Moreno S, Ruiz Jareño L, Payá Rubio A, Hervás Juan MT, López Matéu P. Validez de la escala de cadera de Harris en la rehabilitación tras artroplastia de cadera. Rehabilitación. 2005;39: 147–154.
  44. 44. Escobar A, Gonzalez M, Quintana JM, Vrotsou K, Bilbao A, Herrera-Espiñeira C, et al. Patient acceptable symptom state and OMERACT-OARSI set of responder criteria in joint replacement. Identification of cut-off values. Osteoarthr Cartil. 2012;20: 87–92. pmid:22155074
  45. 45. Marti-Valls J, Alonso J, Lamarca R, Pinto JL, Auleda J, Girvent R, et al. Efectividad y costes de la intervencion de protesis total de cadera en siete hospitales de Cataluna. Med Clínica (Barcelona. 2000;114 Suppl: 34–39.
  46. 46. Martin-Fernandez J, Gray-Laymon P, Molina-Siguero A, Martinez-Martin J, Garcia-Maroto R, Garcia-Sanchez I, et al. Cross-cultural adaptation and validation of the Spanish version of the Oxford Hip Score in patients with hip osteoarthritis. BMC Musculoskelet Disord. J. Martin-Fernandez, Cdegree Villamanta (C.S. Navalcarnero)., Gerencia Asistencial de Atencion Primaria., Servicio Madrileno de Salud, Madrid, Spain. E-mail: jmfernandez@salud.madrid.org, England: BioMed Central Ltd. (E-mail: info@biomedcentral.com); 2017;18: 205. pmid:28532445
  47. 47. Rolfson O, Karrholm J, Dahlberg LE, Garellick G. Patient-reported outcomes in the Swedish Hip Arthroplasty Register: RESULTS OF A NATIONWIDE PROSPECTIVE OBSERVATIONAL STUDY. Bone Joint J. 2011; pmid:21705555
  48. 48. Ornetti P, Parratte S, Gossec L, Tavernier C, JN A, EM R, et al. Cross-cultural adaptation and validation of the French version of the Hip disability and Osteoarthritis Outcome Score (HOOS) in hip osteoarthritis patients. Osteoarthr Cartil. Dijon University Hospital, Department of Rheumatology, Dijon F-21078, France: Elsevier B.V.; 2010;18: 522–529. pmid:20060086
  49. 49. Collins NJ, Roos EM. Patient-reported outcomes for total hip and knee arthroplasty: commonly used instruments and attributes of a “good” measure. Clin Geriatr Med. 2012;28: 367–94. pmid:22840304
  50. 50. Polkowski GG, Callaghan JJ, Mont MA, Clohisy JC. Total hip arthroplasty in the very young patient. Journal of the American Academy of Orthopaedic Surgeons. 2012. pmid:22855851
  51. 51. Hofstede SN, Vlieland TPMV, Van Den Ende CHM, Nelissen RGHH, Marang-Van De Mheen PJ, Van Bodegom-Vos L. Variation in use of non-surgical treatments among osteoarthritis patients in orthopaedic practice in the Netherlands. BMJ Open. 2015; pmid:26353874
  52. 52. Zhang W, Moskowitz RW, Nuki G, Abramson S, Altman RD, Arden N, et al. OARSI recommendations for the management of hip and knee osteoarthritis, Part II: OARSI evidence-based, expert consensus guidelines. Osteoarthr Cartil. 2008; pmid:18279766
  53. 53. Learmonth ID, Young C, Rorabeck C. The operation of the century: total hip replacement. Lancet. 2007.