Skip to main content

Shoulder pain and disability index: cross cultural validation and evaluation of psychometric properties of the Spanish version

Abstract

Background

The Shoulder Pain Disability Index (SPADI) is a recently published but widely used outcome measure.

Methods

This study included 136 patients with shoulder disorders. SPADI was first translated and back-translated and then subjected to psychometric validation. Participants completed the Spanish versions of the SPADI, general health (SF-12), the Simple Shoulder Test (SST), Disability of Arm, Shoulder, and Hand (DASH) questionnaires and a pain intensity visual analog scale (VAS).

Results

The factors explained 62.8 % of the variance, with an internal consistency of α = 0.916 and 0.860, respectively. The confirmatory factor analysis showed a Comparative Fit Index of 0.82 and a Normed Fit Index of 0.80. The Root Mean Square Error of Aproximation was 0.12. The x 2 test for the 2-factor model was significant (x 2 = 185.41, df = 62, p < 0.01). The test-retest reliability was high, with an item ranging of the interclass correlation coefficient (ICC) from 0.89 to 0.93. The ICC for the total score was 0.91 (95 % CI 0.88 to 0.94). Measurement error by minimal detectable change (MDC)95 was 12.2 %. In the construct validity analysis, strong positive correlations were observed between Spanish Version of the SPADI and DASH (pain: r = 0.80; p < 0.01; disability: r = 0.76; p < 0.01). Moderate positive correlations were observed between Spanish Version of the SPADI and VAS (pain: r = 0.67; p < 0.01; disability: r = 0.65; p < 0.01). Moderate negative correlations were obtained between Spanish Version of the SPADI and SST-Sp (pain: r = −0.71; p < 0.01; disability: r = −0.75; p < 0.01). However, pain total Spanish Version of the SPADI was only weakly correlated with physical and mental components of SF-12 (both r = 0.40; p < 0.01).

Conclusions

This Spanish version of SPADI demonstrated satisfactory psychometric properties in a patient sample in the hospital setting.

Background

Health related patient reported outcome measures (PROMs) is considered essential to determine the impact of disease on the life of individuals, taking account not only of the clinical diagnosis of a disease but also of its impact [1].

Shoulder pain is one of the most common causes of musculoskeletal pain, with a prevalence of 20–33 % in the general population [2]. Shoulder disorders are responsible for major medical, social, and economic costs [3]. They are often accompanied by pain and restricted movement, hampering certain activities [4] and compromising psychological and social wellbeing [5].

Various questionnaires are available in English to evaluate the impact of shoulder disorders on function. With regard to other languages, it is recommended to translate, culturally adapt, and validate existing instruments in order to avoid the further proliferation of different methods [68].

The original version of the Shoulder Pain Disability Index (SPADI) is a quality of life questionnaire developed to evaluate the pain and disability associated with shoulder dysfunction [9]. The SPADI is a 13-item shoulder function index on the ability of responders to carry out basic activities of daily living. Each item is scored by a numeric rating scale that ranges from 0 (no pain/no difficulty) to 10 (worst pain imaginable/so difficult it required help). SPADI provides a pain scale (5 items; scale score range 0–50 points, expressed as percentage) and a disability scale (8 items; scale score range 0 – 80 points, expressed as percentage). The two scale scores are averaged to derive a total Spanish Version of the SPADI score (0–100 points). A higher score indicates greater pain-related disability [9]. The original version of the SPADI was initially proposed as a visual analog scale (VAS) and subsequently validated as a numerical scale to enable administration by telephone, obtaining reliable and valid results [10].

Previous systematic reviews have found no single questionnaire to superior to others in terms of administrative burden or measurements properties [10]. There are other validated questionnaires already available as Disability of Arm, Shoulder, and Hand (DASH) or Simple Shoulder Test (SST) but several studies have recommended SPADI also, as specific scale for the shoulder due to its easy administration and rapid completion (3–10 min), which is facilitated by the brevity of the questions and the numerical response scale used (from 0 to 100) [1113]. Systematic reviews have described SPADI as one of the highest-quality questionnaires related to the upper extremity and have endorsed its utilization [10, 13].

Although the SPADI questionnaire has been validated in German [14], Slovenian [15], Turkish [16], Italian [17], Portuguese [18], Persian [19], and Danish [20], it has not yet been validated in Spanish.

The objective of this study was to report the procedure followed for the cross-cultural adaptation and subsequent validation of a Spanish version of SPADI, including an examination of its psychometric properties.

Methods

Design

A two-stage observational study was conducted. The first stage comprised the translation and cross-cultural adaptation of SPADI, while the second stage consisted of a prospective evaluation of the internal consistency, reliability, construct validity and measurement error of Spanish Version of the SPADI.

Stage 1- Translation and cross cultural adaptation

Two physicians, with adequate expertise in shoulder disorders management and both lenguages, and an independent native professional interpreter translated the English version of SPADI into Spanish and organized a meeting to take account of possible cultural issues. A back-translation process was carried out by a specialist translator to guarantee the conceptual equivalence of the terms used, as recommended in the literature [21, 22]. People involved in translation worked independently. In a second meeting, we compared the two versions and found no appreciable differences between them. A final version of the Spanish Version of the SPADI was agreed and tested in a pilot study with 40 patients (24 females, age = 45,6 ± 13.0 years) with shoulder problems (fractures and tendinopaties) recruited from among rehabilitation outpatients at hospital setting. This pilot study included cognitive debriefing standardised interviews carried out for one member of the research staff to assess its comprehensibility and ensure that the items retained the meaning of the original version.

Stage 2- Evaluation of psychometric properties

Participants and procedure

This questionnaire validation study included 136 volunteers with different shoulder disorders recruited from among rehabilitation outpatients in a hospital setting. Inclusion criteria were the presence of a shoulder disorder and the availability of a diagnosis by a specialist rehabilitation physician; diagnoses were classified into six subcategories (Table 1). Exclusion criteria were age under 18 years and inadequate command of Spanish to complete the questionnaires. All patients signed their informed consent to participation in the study, which was approved by the Research Ethics Committee of our hospital.

Table 1 Demographic characteristics of the study population and the distribution of diagnoses

Participants who met the selection criteria completed a Spanish version of the SF-12 [23], SST [24], DASH [25] questionnaires and VAS in the hospital with the assistance of rehabilitation service staff. SF-12 (Version 1) is a self-administered instrument with 12 items on physical and mental health status; responses are scored (for intensity or frequency) on a Likert-type scale (3–6 points according to the item). These items are used to calculate the physical and mental summary measures. This instrument has shown adequate reliability (ICC = 0.73-0.86) [23]. SF12 was used to check discriminant construct validity. The SST is a 12-item shoulder function scale on the ability (yes/no) of respondents to perform 12 activities of daily living (ADLs). The total SST score (0 to 100) expresses the percentage of items with a positive response. The Spanish version of the SST was recently validated and showed adequate reliability (ICC = 0.69–0.94) [24]. The 30-item DASH measures the function and symptoms of patients with upper extremity musculoskeletal disorders. The total score ranges from 0 (best state) to 100 (worst). The Spanish version of DASH has been validated and showed adequate reliability (Cronbach alpha = 0.96) [25]. SST and DASH were usded to check convergent validity. Pain intensity was tested using a VAS (0 to 10).

A randomly selected subgroup (n = 56) of the total sample repeated the questionnaires after an interval of 24–48 h to study the reliability of the Spanish Version of the SPADI using a test-retest methodology. This sample was selected using a random numeric sequence generated by a computer. A brief interval of 24–48 h was selected to avoid fluctuations in the severity of the symptoms. The questionnaires were administrated in same conditions used in the all sample.

Statistical analysis

Sample size was selected in accordance with recommendations to include 4–10 subjects per variable, with a minimum sample size of 100 subjects to ensure stability of the variance–covariance matrix in the confirmative factor analysis [26].

Means and standard deviations of the demographic variables were calculated. Construct validity and factor structure were then determined from maximum likelihood extraction (MLE) with varimax rotation, establishing the satisfaction of the following three criteria as a priori extraction requirement: scree-plot inflection, eigenvalue >1.0, and variance >10 %. The fit of confirmatory factor analysis was considered to be acceptable if the comparative fit index (CFI) and the normalized fit index (NFI) were greater than 0.90, with root mean square error of approximation (RMSEA) values equal to or less than 0.08 [27, 28] The internal consistency of measures was evaluated by determining the Cronbach alpha coefficient in an expected range of 0.70 to 0.90 [29]. The test-retest reliability was analyzed by using the type 2.1 interclass correlation coefficient, and the error sensitivity was calculated with the MDC95 analysis of Stratford. Where MDC = 1.96 × SEM × square root of 2 [30]. The construct validity was determined by comparing Spanish Version of the SPADI with SF-12, SST, DASH and VAS scores. Correlations were calculated using Pearson approach. A correlation value below 0.25 indicates a weak relationship, a value between 0.25 and 0.50 a fair relationship, a value between 0.50 and 0.75 a moderate to strong relationship, and a correlation above 0.75 a strong relationship [31]. Moderate to strong positive (DASH, VAS) and negative (SST) correlations with Spanish Version of the SPADI were expected, with a similar pattern of expected correlations for both dimensions of the index. A lower correlation was expected between Spanish Version of the SPADI and SF-12, which is a generic functionality scale. SPSS version 21.0 for IOS (IBM, Chicago, IL) and LISREL v.8.8 (SSI Inc., Lincolnwood, IL) were used for the statistical analysis.

Results

Potentially eligibles participants in database during the period of the study were 234 patients wich were invited for eligibilty 172 patients. 36 patients refused to participate and finally 136 participants were included. 40 participants completed the second questionnaire of the 56 invited. All participants comprehend the questionnaire and found it easy to complete. No conceptual ambiguities or language difficulties were encountered in the translation of the SPADI (Additional file 1). Minor changes in the Spanish version included the replacement of imperial with metric measures, e.g., “10 lb” becomes “4.5 Kg” in item 12. After the cognitive debriefing interviews ensured that the items retained the meaning of the original version.

Table 1 exhibits the demographic characteristics of the participants and the distribution of diagnoses. In the factorial analysis, the correlation matrix for Spanish Version of the SPADI was adequate according to results of the Kaiser-Meyer-Oklin (0.92) and Bartlett’s sphericity test (p < 0.001). A 62.8 % of the variance was explained by two factors. The item loading is shown in Table 2: factor 2 comprised items 1, 9, and 10, while factor 1 included the remaining items with the exception of item 13, which showed cross-loading. The confirmatory factor analysis showed a Comparative Fit Index of 0.82 and a Normed Fit Index of 0.80. The Root Mean Square Error of Aproximation was 0.12. The x2 test for the 2-factor model was significant (x 2 = 185.41, df = 62, p < 0.01 (Fig. 1).

Table 2 Factor loading items for the two-factor solution
Fig. 1
figure 1

The x2 test for the 2-factor model was significant

For the Spanish Version of the SPADI, there were no significant missing responses (<7 missing response in 136 patients), similar level of missing response was found in the rest of questionnaires used in this study. After check the origen of this missing data a missing at random was assumed. A high degree of internal consistency was obtained for each factor α = 0.92 (CI95 % 0.91 to 0.95) and 0.82 (CI95 % 0.76 to 0.86), The test-retest reliability was also evaluated with ICC, with an item ranging from 0.89 to 0.93. The ICC for the total score was 0.91 (95 % CI 0.88 to 0.94). Measurement error by MDC95 was 12.2 %.

The construct validity was confirmed by strong positive correlations between the Spanish Version of the SPADI and DASH (pain: r = 0.80; p < 0.01; disability: r = 0.76; p < 0.01), moderate positive correlations between SPADI and VAS (pain: r = 0.67; p < 0.01; disability: r = 0.65; p < 0.01), moderate negative correlations between SPADI and SST (pain: r = −0.71; p < 0.01; disability: r = −0.75; p < 0.01) and weak positive correlation with physical and mental components of SF-12 (both r = 0.40; p < 0.01).

Discussion

SPADI demonstrated good internal consistency and convergent validity and reliability in a sample of 136 patients with different shoulder disorders.

The confirmatory factor analysis showed an acceptable fit with a CFI of 0.82 and NFI of 0.80, but the error was higher (RMSEA = 0.12) than the recommended value of 0.08 [28]. The internal consistency value calculated for this version was similar to that obtained for versions validated in other languages [1420] and within an acceptable range, in common with the original questionnaire and all other published versions [26]. The Spanish version showed a clear difference in the loading of the two factors, with items that evidenced a high correlation with one of the factors and a low correlation with the other. Our finding contrasts with the similar loading of the two factors reported for the original questionnaire [9] and subsequent versions [32], which hindered a clear separation between pain and disability dimensions. The fit indices associated with the confirmatory factor analysis model were satisfactory, although the error of approximation was an exception and did not indicate an optimal fit, which may possibly be due to an effect of our specific study population on the factor structure. It should be borne in mind that a slightly increased error does not necessarily imply that the structure of the scale is poor. The good construct validity obtained with this Spanish version supports its usefulness for evaluating patients’ perception of the impact of shoulder lesions.

The test-retest reliability of Spanish Version of the SPADI (0.89–0.93) was superior to that reported for the original questionnaire (0.64–0.66), slightly higher than that of the Persian [19] and Danish [20] versions, and similar to that of the Brazilian [18], German [14], Turkish [16], and Slovenian [15] versions. Perhaps, the reason could be a Spanish sample is more homogenous. The Measurement error by MDC95 was 12.2 %, lower than the original version, was of 18 % [11].

As expected, the lowest correlation (divergent construct validity) was observed between SPADI and SF-12, reflecting the discriminative validity of the instrument, given that SF-12 is a generic functionality scale. Moderate-strong correlations were found with the specific shoulder-related instruments (SST and DASH), indicating adequate convergent validity. Low-moderate correlation was found between SPADI and VAS, as observed in previous cross-cultural validation studies [14, 20].

The present study population was limited to hospital outpatients in a Spanish urban setting, and different results may be obtained in other types of population. The greater reliability observed for the Spanish version than for the original questionnaire may be attributable to the shorter interval between tests (48 h) which could induce an artificial inflation of correlation coefficients due to recall bias. Studies of this version of the questionnaire are warranted to test its validity in other Spanish-speaking countries (e.g., Latin America, Philippines, etc.). A study strength is that the sample size was larger (n = 136) than in previous validation studies of this instrument, reducing standard errors and supporting its application in individual and group studies [33]. Further research is needed to establish longitudinal validity, responsiveness and thresholds for minimal important change in the Spanish version of SPADI.

Conclusions

In conclusion, the psychometric properties of the Spanish version of SPADI are similar to those of the original questionnaire and subsequent adaptations in different languages, supporting its utilization as a reliable clinimetric instrument in the setting of shoulder disorders.

References

  1. World Health Organization. ICF - International Classification of Functioning, Disability and Health. Geneva, Switzerland: World Health Organization; 2001. p. 10–20.

    Google Scholar 

  2. McBeth J, Jones K. Epidemiology of chronic musculoskeletal pain. Best Pract Res Clin Rheumatol. 2007;21:403–25.

    Article  PubMed  Google Scholar 

  3. Virta L, Joranger P, Brox JI, Eriksson R. Costs of shoulder pain and resource use in primary health care: a cost-of-illness study in Sweden. BMC Musculoskelet Disord. 2012;13:17.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Largacha M, Parsons IM, Campbell B, Titelman RM, Smith KL, Matsen III F. Deficits in shoulder function and general health associated with sixteen common shoulder diagnoses: a study of 2674 patients. J Shoulder Elbow Surg. 2006;15:30–9.

    Article  PubMed  Google Scholar 

  5. Paananen M, Taimela S, Auvinen J, Tammelin T, Zitting P, Karppinen J. Impact of self-reported musculoskeletal pain on health- related quality of life among young adults. Pain Medicine. 2011;12:9–17.

    Article  PubMed  Google Scholar 

  6. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phil 1976). 2000;25:3186–91.

    Article  CAS  Google Scholar 

  7. Kirkley A, Alvarez C, Griffin S. The development and evaluation of a disease-specific quality-of-life questionnaire for disorders of the rotator cuff: The Western Ontario Rotator Cuff Index. Clin J Sport Med. 2003;13:84–92.

    Article  PubMed  Google Scholar 

  8. Leggin BG, Michener LA, Shaffer MA, Brenneman SK, Iannotti JP, Williams Jr GR. The Penn shoulder score: reliability and validity. J Orthop Sports Phys Ther. 2006;36:138–51.

    Article  PubMed  Google Scholar 

  9. Roach KE, Budiman-Mak E, Songsiridej N, Lertratanakul Y. Development of a shoulder pain and disability index. Arthritis Care Res. 1991;4:143–9.

    Article  PubMed  CAS  Google Scholar 

  10. Schmidt S, Ferrer M, González M, González N, Valderas JM, Alonso J, et al. Evaluation of shoulder-specific patient-reported outcome measures: a systematic and standardized comparison of available evidence. J Shoulder Elbow Surg. 2014;23:434–44.

    Article  PubMed  Google Scholar 

  11. Williams Jr JW, Holleman Jr DR, Simel DL. Measuring shoulder function with the Shoulder Pain and Disability Index. J Rheumatol. 1995;22:727–32.

    PubMed  Google Scholar 

  12. MacDermid JC, Solomon P, Prkachin K. The Shoulder Pain and Disability Index demonstrates factor, construct and longitudinal validity. BMC Musculoskelet Disord. 2006;7:12.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Bot SD, Terwee CB, van der Windt DA, Bouter LM, Dekker J, de Vet HC. Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature. Ann Rheum Dis. 2004;63:335–41.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  14. Angst F, Goldhahn J, Pap G, Mannion AF, Roach KE, Siebertz D, et al. Cross-cultural adaptation, reliability and validity of the German Shoulder Pain and Disability Index (SPADI). Rheumatology (Oxford). 2007;46:87–92.

    Article  CAS  Google Scholar 

  15. Jamnik H, Spevak MK. Shoulder Pain and Disability Index: validation of Slovene version. Int J Rehabil Res. 2008;31:337–41.

    Article  PubMed  Google Scholar 

  16. Bicer A, Ankarali H. Shoulder pain and disability index: a validation study Turkish women. Sind Med J. 2010;5:865–70.

    Google Scholar 

  17. Marchese C, Cristalli G, Pichi B, Manciocco G, Mercante G, Pellini R, et al. Italian cross-cultural adaptation and validation of three different scales for the evaluation of shoulder pain and dysfunction after neck dissection: University of California-Los Angeles (UCLA) Shoulder Scale, Shoulder Pain and Disability Index (SPADI) and Simple Shoulder Test (SST). Acta Otorhinolaryngol Ital. 2012;32:12–7.

    PubMed  CAS  PubMed Central  Google Scholar 

  18. Martins J, Napoles B, Hoffman C, Oliveira A. Versão brasileira do Shoulder Pain and Disability Index: tradução, adaptação cultural e confiabilidad. Revista Brasileira Fisioterapia São Carlos. 2010;14:527–36.

    Article  Google Scholar 

  19. Ebrahimzadeh MH, Biriandineiad A, Golhasani F, Moradi A, Vahedi E, Kachooei AR. Cross-cultural adaptation, validation, and reliability testing of the Shoulder Pain and Disability Index in the Persian population with shoulder problems. Int J Rehabil Res. 2013; Oct 9. [Epub ahead of print].

  20. Christiansen DH, Andersen JH, Haahr JP. Cross-cultural adaption and measurement properties of the Danish version of the Shoulder Pain and Disability Index. Clin Rehabil. 2013;27:355–60.

    Article  PubMed  Google Scholar 

  21. Cuesta-Vargas A, Gonzalez-Sanchez M, Farasyn A. Development of a Spanish version of the “Backache Index” Cross cultural linguistic adaptation and reliability. J Back Musculoskelet Rehabil. 2010;23:105–10.

    PubMed  Google Scholar 

  22. Muñiz J, Elosua P, Hambleton RK. International test commission guidelines for test translation and adaptation. Psicothema. 2013;25:151–7.

    PubMed  Google Scholar 

  23. Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, et al. Cross-validation of item selectionand scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project International Quality of Life Assessment. J Clin Epidemiol. 1998;51:1171–8.

    Article  PubMed  CAS  Google Scholar 

  24. Membrilla-Mesa MD, Tejero-Fernández V, Cuesta-Vargas AI, Arroyo-Morales M. Validation and reliability of a Spanish version of Simple Shoulder Test (SST-Sp). Qual Life Res. 2014;24(2):411–6.

    Article  PubMed  Google Scholar 

  25. Hervás MT, Navarro-Collado MJ, Peiró S, Rodrigo-Pérez JL, López- Mateú P, Martínez-Tello I. Spanish version of the DASH questionnaire.Cross-cultural adaptation, reliability, validity and responsiveness. Med Clin. 2006;127:441–7.

    Article  Google Scholar 

  26. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.

    Article  PubMed  Google Scholar 

  27. Schumacher RE, Lomax RGA. Beginner's guide to structural equation modeling. 14 Mahwah, NJ: Lawrence Erlbaum; 1996. 15.

    Google Scholar 

  28. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

    Article  Google Scholar 

  29. Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Stratford PW. Getting more from the literature: Estimating the standard error of measurement from reliability studies. Physiother Can. 2004;56:27–30.

    Article  Google Scholar 

  31. Colton T. Statistics in Medicine. Boston: Little Brown; 1974.

    Google Scholar 

  32. Roddey TS, Olson SL, Cook KF, Gartsman GM, Hanten W. 30.-Comparison of the University of California-Los Angeles Shoulder Scale and the Simple Shoulder Test with the shoulder pain and disability index: single-administration reliabilityand validity. Phys Ther. 2000;80:759–68.

    PubMed  CAS  Google Scholar 

  33. Fayers PM, Machin D. Scores and measurements: validity, reliability, sensitivity. In: Quality of life: The assessment, analysis and interpretation of patient reported outcomes. West Sussex, England: John Wiley& Sons Ltd; 2007.

    Chapter  Google Scholar 

Download references

Acknowledgements

This study received a grant (8.06/5.42.3064-3) from the Research Office of the University of Malaga.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antonio Ignacio Cuesta-Vargas.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AIC-V and MAM has made a contribution to the conception and design of this study and to analyze the data. RPC, VTF, LMM and MDMM recruit the patient, collect data and made substantial contributions to the manuscript. All the authors have given final approval of the version to be published.

Additional file

Additional file 1:

Shoulder and Pain Disability Index (SPADI-Sp). (PDF 60 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Membrilla-Mesa, M.D., Cuesta-Vargas, A.I., Pozuelo-Calvo, R. et al. Shoulder pain and disability index: cross cultural validation and evaluation of psychometric properties of the Spanish version. Health Qual Life Outcomes 13, 200 (2015). https://doi.org/10.1186/s12955-015-0397-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-015-0397-z

Keywords