Next Article in Journal
Caregivers’ Expectations on Possible Functional Changes following Disease-Modifying Treatment in Type II and III Spinal Muscular Atrophy: A Comparative Study
Next Article in Special Issue
One-Year Survival after Cardiac Surgery in Frail Older People—Social Support Matters: A Prospective Cohort Study
Previous Article in Journal
The Impact of Biologic Treatment on PD-1/PD-L1 Pathway Disturbances in Psoriasis
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 13
10.3390/jcm12134180
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Stair-Climbing Tests or Self-Reported Functional Capacity for Preoperative Pulmonary Risk Assessment in Patients with Known or Suspected COPD—A Prospective Observational Study

by
André Dankert
1,*,
Benedikt Neumann-Schirmbeck
1,
Thorsten Dohrmann
1,
Lili Plümer
1,
Viktor Alexander Wünsch
1,
Phillip Brenya Sasu
1,
Susanne Sehner
2,
Christian Zöllner
1 and
Martin Petzoldt
1
1
Department of Anesthesiology, Center of Anesthesiology and Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, Martinistrasse 52, 20246 Hamburg, Germany
2
Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(13), 4180; https://doi.org/10.3390/jcm12134180
Submission received: 10 May 2023 / Revised: 14 June 2023 / Accepted: 19 June 2023 / Published: 21 June 2023
(This article belongs to the Special Issue Surgical and Anaesthesia Care: From Preparing to Recovering)
Browse Figures
Review Reports Versions Notes

Abstract

:
Background: This prospective study aims to determine whether preoperative stair-climbing tests (SCT) predict postoperative pulmonary complications (PPC) better than self-reported poor functional capacity (SRPFC) in patients with known or suspected COPD. Methods: A total of 320 patients undergoing scheduled for major non-cardiac surgery, 240 with verified COPD and 80 with GOLD key indicators but disproved COPD, underwent preoperative SRPFC and SCT and were analyzed. Least absolute shrinkage and selection operator (LASSO) regression was used for variable selection. Two multivariable regression models were fitted, the SRPFC model (baseline variables such as sociodemographic, surgical and procedural characteristics, medical preconditions, and GOLD key indicators plus SRPFC) and the SCT model (baseline variables plus SCTPFC). Results: Within all stair-climbing variables, LASSO exclusively selected self-reported poor functional capacity. The cross-validated area under the receiver operating characteristic curve with bias-corrected bootstrapping 95% confidence interval (95% CI) did not differ between the SRPFC and SCT models (0.71; 0.65–0.77 for both models). SRPFC was an independent risk factor (adjusted odds ratio (OR) 5.45; 95% CI 1.04–28.60; p = 0.045 in the SRPFC model) but SCTPFC was not (adjusted OR 3.78; 95% CI 0.87–16.34; p = 0.075 in the SCT model). Conclusions: Our findings indicate that preoperative SRPFC adequately predicts PPC while additional preoperative SCTs are dispensable in patients with known or suspected COPD.

1. Introduction

More than 320 million patients undergo surgery each year worldwide [1]. It has been recognized that quantifying functional capacity or cardiopulmonary fitness is a pivotal step for preoperative cardiac risk assessment [2,3,4,5,6]. It has been reported that self-reported functional capacity less than two flights of stairs might improve preoperative cardiovascular risk classification [6]. Current guidelines recommend assessing the self-reported ability to climb two flights of stairs in patients referred for intermediate- or high-risk non-cardiac surgery [3].
Postoperative pulmonary complications (PPC) frequently occur after major surgery [7,8] and the prevalence is particularly high in patients with chronic obstructive pulmonary disease (COPD) [9,10,11,12]. There is growing evidence that individuals with COPD undergoing general anesthesia are at high risk for PPC [10,11]. The incidence of PPC is almost doubled in patients with COPD and the assumed underlying mechanism might be impaired mucociliary clearance of aspirated bacteria and impaired gas exchange [11,12,13]. However, in contrast to cardiovascular risk assessment, only very limited data exist regarding the ability of poor functional capacity to predict PPC after non-thoracic surgery [7,14,15,16,17,18,19,20]. While the prevalence of COPD is rising in the ageing society, COPD is still underdiagnosed and undertreated [21,22]. Assessment of functional capacity, for example with a stair-climbing test or six-minute walk test, is standard of care for staging and monitoring of disease progression in COPD [23,24]. Further, stair-climbing tests have a proven benefit for prediction of PPC after lung resection [25,26,27,28,29,30] and it has been proposed that they might play a relevant role for the prediction of PPC in patients undergoing non-thoracic surgery as well [7,14,15,16,17,18,19,20].
However, screening of surgical patients with stair-climbing tests is costly, labor intensive, and time consuming; it requires adequate infrastructural preconditions and health-care resources and may contribute to additional delays [31]. In contrast, self-reported poor functional capacity is easy to assess without additional expenses and efforts as it is already part of the preoperative routine in many regions and institutions [5,6,32]. However, the diagnostic value of self-reported poor functional capacity for the prediction of PPC is unknown.
This prospective study aims to determine whether preoperative stair-climbing tests predict PPC better than self-reported poor functional capacity in patients with known or suspected COPD undergoing major non-cardiac surgery.

2. Materials and Methods

The Preoperative Diagnostic Tests for Pulmonary Risk Assessment in Chronic Obstructive Pulmonary Disease (PREDICT) study is a prospective observational single-center study conducted in accordance with the Declaration of Helsinki. The study design, conduction, and reporting were carried out in accordance with the TRIPOD statement [33]. The study was registered with Clinical-Trials.gov (NCT02566343) and approved by the Ethics Committee of the Medical Association of Hamburg (PV4743, 5 August 2014). Participants gave written informed consent. The present findings result from an analysis of an independent dataset within the PREDICT study as outlined in the study protocol [10].

2.1. Patient Allocation and Data Collection

Adult patients who presented at our anesthesia preoperative assessment clinic between 18 November 2014 and 14 July 2016 were assessed for eligibility. Patients with GOLD key indicators for COPD [23] and a COPD assessment test (CATTM) [34] score ≥ 5 points, who were scheduled for major non-cardiac surgery, underwent a structured pulmonary risk stratification including preoperative spirometry. Spirometry was performed before and after bronchodilator application (200 µg salbutamol via a spacer) using a Spirobank GTM spirometer (Medical International Research, Rome, Italy; software: winspiroPROTM, version 3.2) according to the recommended standards [23,35]. Reference values were taken from a Caucasian population [10,36].
Inclusion criteria were elective major non-cardiac surgery defined as an expected mortality >2% [37] with an anticipated operation duration ≥120 min and/or planned postoperative intensive care unit admission, planned general anesthesia, and an expected postoperative hospital stay of at least three days. Patients without GOLD key indicators (dyspnea, chronic cough, chronic sputum production, recurrent lower respiratory tract infections, or smoking history), patients with tracheostoma or planned tracheostomy, pregnant women, patients <18 years, and patients with an inability or non-compliance for spirometry or for assessment of functional capacity were excluded. Patients with confirmed COPD (forced expiratory volume in 1 s/forced vital capacity ≤0.7) were included in the COPD cohort and compared with a reference cohort that included 80 consecutive patients with GOLD key indicators and a CAT score > 5 points in whom spirometry disproved COPD (Figure 1). Self-reported poor functional capacity was assessed and a preoperative stair-climbing test was performed in all participators during the preoperative assessment visit of the patient in the preoperative assessment clinic prior to elective surgery.

2.2. Self-Reported Poor Functional Capacity (SRPFC)

Within a structured routine preoperative interview patients were asked if they were able to climb two flights of stairs. If the answer was ‘no’, this was documented as self-reported poor functional capacity less than two flights of stairs [6].

2.3. Stair-Climbing Test (SCT)

All patients underwent a standardized preoperative stair-climbing test supervised and recorded by a member of the study team (observer). The stair-climbing test was performed in a sparsely frequented stairwell to ensure uniform, reproducible conditions for all patients. After at least 10 min of rest, patients were asked to climb up the stairwell with an individualized rapid pace. Patients were instructed not to skip single steps and to only use the railing to keep balance. The observer recorded the time from the start of the stair-climbing test until the patient reached the final landing or terminated the stair-climbing test prematurely due to symptoms (for example dyspnea, exhaustion, dizziness, or chest pain). The observer followed the patient at a little distance in order to avoid making the pace. The steps of the staircase were 17 cm high and 21 cm deep. The test track had a total height of 12.07 m. This stairwell comprised 8 flights of stairs with a landing between each flight that could easily be passed with two or three additional steps.

2.4. Outcome Data

All patients were followed-up until hospital discharge and all available outcome data were recorded. The clinical information systems Soarian Health Archive, release 3.04 SP12 (Siemens Healthcare), critical care information management system (ICM, version 8.12, Draeger Medical), and anesthesia charts were systematically screened for adverse events, newly developed clinical signs, new diagnoses, and new radiological findings. Study inclusion was blinded to all health-care professionals in the operation theater, intensive care unit, and normal ward, and intra- and postoperative managements were left to the discretion of the handling physicians.
In addition, a structured postoperative follow-up was conducted between the first and fifth day after extubation.

2.5. Sample Size

The approach of Riley and coauthors [38] was used to calculate the required sample size for model development; it uses three criteria: The sample size should ensure an accurate estimate of the overall outcome risk. We assumed a PPC rate of 65% [9,11,39] and a margin of error ≤0.05. We further claimed that the sample size should lead to a shrinkage of predictor effects of 10% and small optimism in the apparent model fit. A Cox–Snell R2 of 0.8 and 8 candidate predictors were assumed to be appropriate. Based on this assumption, a required sample size of 350 patients was approximated. Assuming a dropout rate of 5%, 365 patients were included in our study, and datasets from 320 patients were analyzed, leading to an acceptable relaxation of the restricting margin of error from 0.05 to 0.052 [38].

2.6. Primary Endpoint

The primary endpoint of this analysis was PPC, as defined by the European Perioperative Clinical Outcome (EPCO) definitions, as a composite of respiratory infection, respiratory failure, pleural effusion, bronchospasm, atelectasis, pneumothorax, and/or aspiration pneumonitis [40].

2.7. Covariables for Model Fitting

Potentially eligible covariables were screened by literature research, previous studies [6,14,15,17,18,25,26,27,28,29,30,34,41,42,43,44], and clinical considerations.
Fixed covariables for both models (baseline variables):
  • Sociodemographic data: age (years), body mass index (kg m−2), and sex (male);
  • American Society of Anesthesiologists physical status (ASA I-IV);
  • Cardiovascular diseases (yes/no): any reported cardiovascular precondition;
  • Cancer operation (yes/no): patient scheduled for any kind of tumor operation;
  • Type of surgery: clustered variable with five distinct groups (lower abdominal or orthopedic; ear, nose, and throat; neurosurgery; upper abdominal; thorax and mediastinal);
  • GOLD key indicators: chronic cough (yes/no), sputum production (yes/no), dyspnea (yes/no), recurrent lower respiratory tract infections (yes/no), ever-smoked (yes/no);
  • Pack years (if ever-smoked).
Additional stair-climbing covariables (candidates):
  • Self-reported poor exercise capacity (SRPFC) (yes/no): self-reported inability to climb two flights of stairs;
  • Poor exercise capacity in the stair-climbing test (SCTPFC) (yes/no): actually, observed inability to climb two flights of stairs in the stair-climbing test;
  • Successful completion of the stair-climbing test (yes/no): patient reached the final landing after climbing 8 flights of stairs;
  • High (m): maximal height reached by the patient (maximum 12.07; final landing);
  • Power (w): calculated as the bodyweight (kg) × height (m) × 9.81 m/s2;
  • Pace (stairs/s): average speed of climbing.

2.8. Multivariable Model Development and Performance

To evaluate the incremental diagnostic value of the self-reported poor exercise capacity and the stair-climbing test we fitted two multivariable logistic regression models, the ‘SRPFC model’ and the ‘SCT model’, and compared their ability to predict PPC in patients with GOLD key indicators for COPD undergoing major surgery. Complete case analysis was used for both models. Skewed predictors were logarithmized. The results are reported as odds ratios (OR) (95% confidence interval (CI)).
Both models include fixed baseline variables: sociodemographic data, medical preconditions, surgical covariables, and COPD-specific assessments (GOLD key indicators and pack years); these variables were included into the model without any further preselection as they already represent an established assessment bundle [10,23].
STATA’s adaptive least absolute shrinkage selector operator (LASSO) regression, which performs multiple LASSO regression analyses, each with cross validation, was used to select eligible variables out of the six ‘stair-climbing variables’ on top of the fixed baseline variables. This approach was chosen for variable selection and to correct for overfitting by shrinkage. A covariable was considered relevant for prediction if the β-coefficient was not shrunk to zero.
In the next step, we fitted the ‘SRPFC model’, that incorporates self-reported poor exercise capacity in addition to the baseline variables, and the ‘SCT model’, that incorporates SCTPFC in addition to the baseline variables.
To determine the predictive performance, the average of the ten-fold cross-validated area under the receiver operating characteristic (ROC) curve (cvAUC) was calculated with bias-corrected bootstrapped (bc-b) 95% CI for both models.

2.9. Descriptive Statistics

Sample characteristics are given as absolute and relative frequencies or mean (standard deviation) as well as median (interquartile range), whichever is appropriate. Differences between COPD and non-COPD patients were compared using Fisher’s exact test, Student’s t-test, or the Mann–Whitney U test, whichever was appropriate. A two-tailed p < 0.05 was considered statistically significant. We report nominal p-values without correction for multiplicity. Statistical analyses were performed using STATA, version 17.0 (StataCorp, College Station, TX, USA).

3. Results

A total of 31,714 patients were screened and 1271 individuals with GOLD key indicators received spirometry. A total of 365 patients were included in the PREDICT trial and 320 patients (240 with verified COPD and 80 with negative spirometry) were analyzed (12% drop out rate) (Figure 1) [10]. The dataset of this analysis is complete without missing values. Patients with confirmed COPD were grouped into COPD severity classes based on FEV1% values (78 GOLD I, 125 GOLD II, 28 GOLD III, and 9 GOLD IV) [10]. The baseline characteristics of the COPD and reference cohorts are given in Table 1.
Patients with confirmed COPD more frequently terminated the stair-climbing test prematurely before reaching the final landing, spent less power, and reached a slower pace than patients in the reference cohort without COPD (Table 1). Of the analyzed patients, 65.6% (210/320) developed PPC, 47.5% in the non-COPD reference cohort and 71.7% in the COPD cohort (p < 0.001).

Multivariable Model Development and Performance

No missing values exist and all 320 analyzable datasets were used for model fitting.
STATA’s adaptive LASSO regression was applied to select eligible stair-climbing variables on top of the baseline variables and only selected self-reported poor exercise capacity (shrunken β-coefficient 3.39) while the β-coefficients of all other five stair-climbing candidate predictors were shrunk to zero (Table 2).
Two multivariable regression models were fitted, the ‘SRPFC model’ (baseline variables plus self-reported poor exercise capacity) and the ‘SCT model’ (baseline variables plus SCTPFC). Interestingly, while self-reported poor exercise capacity was an independent risk factor in the ‘SRPFC model’ (adjusted OR 5.45; 95% CI 1.04–28.60; p = 0.045), SCTPFC was not an independent risk factor in the ‘SCT model’ (adjusted OR 3.78; 95% CI 0.87–16.34; p = 0.075). Sex (male), upper abdominal, and thoracic and mediastinal surgery were independent predictors for PPC in both models (Table 3).
The cvAUC (bc-b 95% CI) did not differ between the ‘SRPFC model’ (0.712; 0.648–0.768) and the ‘SCT model’ (0.713; 0.650–0.770) (Figure 2).

4. Discussion

In this secondary analysis of a prospective observational study in patients undergoing major non-cardiac surgery, we screened a large surgical population with more than 30,000 patients to identify high-risk individuals. Exercise testing was performed in 365 individuals with known or suspected COPD.
Interestingly, our analysis demonstrates that actually performing a stair-climbing test does not translate into a better diagnostic performance than simply asking the patient if he or she is able to climb two flights of stairs. Only few patients were unable to climb two flights of stairs. Those who reported not being able to climb two flights of stairs were at high risk for PPC. Within all stair-climbing parameters only self-reported poor functional capacity was selected by the LASSO regression. Self-reported poor functional capacity was an independent risk factor associated with a more than five-fold increased risk for PPC, while poor functional capacity in the stair-climbing test was not an independent predictor. Beyond this, only the type of surgery and male sex were further independent risk factors.
The cross-validated area under the receiver operating characteristic curve with bias-corrected bootstrapping 95% confidence interval (95% CI) did not differ between the self-reported poor functional capacity and stair-climbing test models (0.71; 0.65–0.77 for both). Hence, our data indicate that preoperative self-reported poor functional capacity already adequately predicts PPC while preoperative stair-climbing tests did not further improve preoperative pulmonary risk assessment in patients with known or suspected COPD.
Poor functional capacity can either originate from cardiovascular comorbidities (for example, congestive heart failure) or dysfunction of the respiratory system, particularly in COPD. Functional capacity or cardiopulmonary fitness is an important component of preoperative risk assessment [3,4,5,6].
Guidelines recommend using self-reported functional capacity for preoperative cardiovascular risk assessment [3]. Recently, a large multicenter study demonstrated that self-reported functional capacity did not improve prediction of major adverse cardiovascular events compared with clinical factors [32]. While functional capacity is an established predictor for major adverse cardiac events [3,4,5,6], still little is known about its role for prediction of PPC [10,44].
It is an established part of the preoperative routine assessment in many institutions to screen functional capacity by posing a very simple question: ‘Can you climb two flights of stairs?’ [3,6,44]. It was unknown if patients that answer ‘no’ are at increased risk for PPC or if more sophisticated diagnostic measures such as stair-climbing tests or a six-minute walk test are required for this purpose [14,17,23,24,26,27,28,29,30]? Unfortunately, preoperative spirometry and blood gas analysis do not improve preoperative prediction of PPC in patients with known or suspected COPD [10].
The prevalence of COPD is rising rapidly and the worldwide mean prevalence has been estimated to be 13.1% [45]. While it has been recognized that COPD has great implications on patient outcome in perioperative medicine [9,11,46], still only very few studies have investigated preoperative pulmonary risk assessment in individuals with COPD [9].
Considering all this, the present study intended to evaluate if a structured quantitative assessment of the functional capacity by means of a stair-climbing test predicts PPC more accurately than a simple self-assessment of poor functional capacity gathered during preoperative consultation.
Stair-climbing tests are cumbersome, time consuming, costly, and inconvenient for the patient, as they might provoke symptoms such as dyspnea, exhaustion, dizziness, or chest pain. Moreover, stairwells are not uniform and significantly differ between buildings, regions, or countries, thus, test results are not interchangeable [19].
On the other hand, assessment of self-reported poor functional capacity preserves time, costs, and human and health-care resources. Stair-climbing tests are unfeasible in individuals with fractures of the lower limbs, certain types of disabilities, neuromuscular or rheumatic diseases or pain syndromes; however, in many of these individuals, self-reports might still be valuable. Hence, for practical reasons self-assessments might be more feasible and reproducible than exercise tests in many patients.
Beyond all this, the question remains if prediction of the PPC changes perioperative management, decision making, and finally, postoperative outcome [47]? Currently, pulmonary risk prediction tests are neither linked to specific preventive or therapeutic concepts nor provide clear therapeutic targets. Furthermore, efficiency of measures to reduce perioperative risk and to optimize the care in the perioperative period in patients with COPD, such as antiobstructive medication, preoperative pulmonary rehabilitation, choice of drugs, monitoring, or postoperative care is vague [46]. However, the predicted risk for PPC can be particularly useful for shared decision making before surgery. In this context, the estimated risk for PPC might contribute to the individual decision making to undergo surgery or not. Here, the key question is if the benefit of surgery outweighs the combined risk of surgery and anesthesia [47]?
This study has some limitations. Our data represent a single-center experience and caution should be taken extrapolating them to other institutions or different patient populations. Even though we performed a structured postoperative follow-up, assessment of postoperative complications was largely based on chart review. Further external validation could reinforce our findings.

5. Conclusions

COPD is associated with a high incidence of PPC. Preoperative pulmonary risk prediction is poorly defined and little is known about the role of functional capacity in these patients. Our findings demonstrate that a standard preoperative pulmonary risk assessment that includes sociodemographic data, medical history, medical preconditions, type of surgery, COPD-specific assessments, and self-reported poor functional capacity already sufficiently predicts PPC in patients with known or suspected COPD. Within all stair-climbing parameters, LASSO regression exclusively selected self-reported poor functional capacity. Self-reported poor exercise capacity was an independent predictor for PPC in the final multivariable model but not poor exercise capacity assessed by stair-climbing tests. In addition to the standard clinical assessment, preoperative stair-climbing tests did not achieve better diagnostic performance than a simple self-report of a poor functional capacity in these patients and are therefore dispensable. The time, costs, human, and health-care resources for a stair-climbing test could be better spent.

Author Contributions

Conceptualization, A.D., B.N.-S. and M.P.; data curation, A.D. and B.N.-S.; formal analysis, A.D. and S.S.; investigation, A.D. and M.P.; methodology, A.D.; supervision, M.P.; writing—original draft preparation, A.D. and M.P.; writing—review and editing, B.N.-S., T.D., L.P., V.A.W., P.B.S., S.S. and C.Z. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge financial support from the Open Access Publication Fund of UKE—Universitätsklinikum Hamburg-Eppendorf and DFG—German Research Foundation.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki. The study was approved by the Ethics Committee of the Medical Association of Hamburg (PV4743, 5 August 2014) and registered with Clinical-Trials.gov (NCT02566343).

Informed Consent Statement

Written informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patient(s) to publish this paper.

Data Availability Statement

Not applicable.

Conflicts of Interest

M.P. is a member of the Medical Advisory Board of Radiometer Medical, Copenhagen, Denmark. M.P. received a research grant awarded by Verathon Inc., Bothell, WA, USA. The other authors declare no competing interests.

References

  1. International Surgical Outcomes Study group. Global patient outcomes after elective surgery: Prospective cohort study in 27 low-, middle- and high-income countries. Br. J. Anaesth. 2016, 117, 601–609. [Google Scholar] [CrossRef] [Green Version]
  2. Fleisher, L.A.; Fleischmann, K.E.; Auerbach, A.D.; Barnason, S.A.; Beckman, J.A.; Bozkurt, B.; Davila-Roman, V.G.; Gerhard-Herman, M.D.; Holly, T.A.; Kane, G.C.; et al. 2014 ACC/AHA guideline on perioperative cardiovascular evaluation and management of patients undergoing noncardiac surgery: Executive summary: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014, 130, 2215–2245. [Google Scholar] [CrossRef] [PubMed]
  3. Halvorsen, S.; Mehilli, J.; Cassese, S.; Hall, T.S.; Abdelhamid, M.; Barbato, E.; De Hert, S.; de Laval, I.; Geisler, T.; Hinterbuchner, L.; et al. 2022 ESC Guidelines on cardiovascular assessment and management of patients undergoing non-cardiac surgery. Eur. Heart J. 2022, 43, 3826–3924. [Google Scholar] [CrossRef]
  4. Wijeysundera, D.N.; Beattie, W.S.; Hillis, G.S.; Abbott, T.E.F.; Shulman, M.A.; Ackland, G.L.; Mazer, C.D.; Myles, P.S.; Pearse, R.M.; Cuthbertson, B.H.; et al. Integration of the Duke Activity Status Index into preoperative risk evaluation: A multicentre prospective cohort study. Br. J. Anaesth. 2020, 124, 261–270. [Google Scholar] [CrossRef] [Green Version]
  5. Wijeysundera, D.N.; Pearse, R.M.; Shulman, M.A.; Abbott, T.E.F.; Torres, E.; Ambosta, A.; Croal, B.L.; Granton, J.T.; Thorpe, K.E.; Grocott, M.P.W.; et al. Assessment of functional capacity before major non-cardiac surgery: An international, prospective cohort study. Lancet 2018, 391, 2631–2640. [Google Scholar] [CrossRef]
  6. Lurati Buse, G.A.L.; Puelacher, C.; Gualandro, D.M.; Genini, A.S.; Hidvegi, R.; Bolliger, D.; Arslani, K.; Steiner, L.A.; Kindler, C.; Mueller, C.; et al. Association between self-reported functional capacity and major adverse cardiac events in patients at elevated risk undergoing noncardiac surgery: A prospective diagnostic cohort study. Br. J. Anaesth. 2021, 126, 102–110. [Google Scholar] [CrossRef]
  7. Nijbroek, S.G.; Schultz, M.J.; Hemmes, S.N.T. Prediction of postoperative pulmonary complications. Curr. Opin. Anaesthesiol. 2019, 32, 443–451. [Google Scholar] [CrossRef]
  8. Las Vegas investigators. Epidemiology, practice of ventilation and outcome for patients at increased risk of postoperative pulmonary complications: LAS VEGAS—An observational study in 29 countries. Eur. J. Anaesthesiol. 2017, 34, 492–507. [Google Scholar] [CrossRef] [Green Version]
  9. Dankert, A.; Dohrmann, T.; Loser, B.; Zapf, A.; Zollner, C.; Petzoldt, M. Pulmonary Function Tests for the Prediction of Postoperative Pulmonary Complications. Dtsch. Arztebl. Int. 2022, 119, 99–106. [Google Scholar] [CrossRef]
  10. Dankert, A.; Neumann-Schirmbeck, B.; Dohrmann, T.; Greiwe, G.; Plümer, L.; Löser, B.; Sehner, S.; Zöllner, C.; Petzoldt, M. Preoperative Spirometry in Patients with Known or Suspected Chronic Obstructive Pulmonary Disease Undergoing Major Surgery: The Prospective Observational PREDICT Study. Anesth. Analg. 2022. [Google Scholar] [CrossRef]
  11. Gupta, H.; Ramanan, B.; Gupta, P.K.; Fang, X.; Polich, A.; Modrykamien, A.; Schuller, D.; Morrow, L.E. Impact of COPD on postoperative outcomes: Results from a national database. Chest 2013, 143, 1599–1606. [Google Scholar] [CrossRef] [PubMed]
  12. Smetana, G.W.; Lawrence, V.A.; Cornell, J.E. Preoperative pulmonary risk stratification for noncardiothoracic surgery: Systematic review for the American College of Physicians. Ann. Intern. Med. 2006, 144, 581–595. [Google Scholar] [CrossRef]
  13. Wong, D.H.; Weber, E.C.; Schell, M.J.; Wong, A.B.; Anderson, C.T.; Barker, S.J. Factors associated with postoperative pulmonary complications in patients with severe chronic obstructive pulmonary disease. Anesth. Analg. 1995, 80, 276–284. [Google Scholar] [CrossRef]
  14. Girish, M.; Trayner, E., Jr.; Dammann, O.; Pinto-Plata, V.; Celli, B. Symptom-limited stair climbing as a predictor of postoperative cardiopulmonary complications after high-risk surgery. Chest 2001, 120, 1147–1151. [Google Scholar] [CrossRef] [PubMed]
  15. Neto, A.S.; da Costa, L.G.V.; Hemmes, S.N.T.; Canet, J.; Hedenstierna, G.; Jaber, S.; Hiesmayr, M.; Hollmann, M.W.; Mills, G.H.; Vidal Melo, M.F.; et al. The LAS VEGAS risk score for prediction of postoperative pulmonary complications: An observational study. Eur. J. Anaesthesiol. 2018, 35, 691–701. [Google Scholar] [CrossRef]
  16. Arruda, K.A.; Cataneo, D.C.; Cataneo, A.J. Surgical risk tests related to cardiopulmonary postoperative complications: Comparison between upper abdominal and thoracic surgery. Acta. Cir. Bras. 2013, 28, 458–466. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Reddy, S.; Contreras, C.M.; Singletary, B.; Bradford, T.M.; Waldrop, M.G.; Mims, A.H.; Smedley, W.A.; Swords, J.A.; Wang, T.N.; Heslin, M.J. Timed Stair Climbing Is the Single Strongest Predictor of Perioperative Complications in Patients Undergoing Abdominal Surgery. J. Am. Coll. Surg. 2016, 222, 559–566. [Google Scholar] [CrossRef] [Green Version]
  18. Salahuddin, N.; Fatimi, S.; Salahuddin, N.; Huda, S.; Islam, M.; Shafquat, A. Predicting postoperative cardio-pulmonary complications by a test of stair climbing. J. Coll. Physicians Surg. Pak. 2005, 15, 761–764. [Google Scholar]
  19. Biccard, B.M. Relationship between the inability to climb two flights of stairs and outcome after major non-cardiac surgery: Implications for the pre-operative assessment of functional capacity. Anaesthesia 2005, 60, 588–593. [Google Scholar] [CrossRef]
  20. Moran, J.; Wilson, F.; Guinan, E.; McCormick, P.; Hussey, J.; Moriarty, J. The preoperative use of field tests of exercise tolerance to predict postoperative outcome in intra-abdominal surgery: A systematic review. J. Clin. Anesth. 2016, 35, 446–455. [Google Scholar] [CrossRef]
  21. Colak, Y.; Afzal, S.; Nordestgaard, B.G.; Vestbo, J.; Lange, P. Prognosis of asymptomatic and symptomatic, undiagnosed COPD in the general population in Denmark: A prospective cohort study. Lancet Respir. Med. 2017, 5, 426–434. [Google Scholar] [CrossRef]
  22. Hill, K.; Goldstein, R.S.; Guyatt, G.H.; Blouin, M.; Tan, W.C.; Davis, L.L.; Heels-Ansdell, D.M.; Erak, M.; Bragaglia, P.J.; Tamari, I.E.; et al. Prevalence and underdiagnosis of chronic obstructive pulmonary disease among patients at risk in primary care. Can. Med Assoc. J. 2010, 182, 673–678. [Google Scholar] [CrossRef] [Green Version]
  23. Vogelmeier, C.F.; Criner, G.J.; Martinez, F.J.; Anzueto, A.; Barnes, P.J.; Bourbeau, J.; Celli, B.R.; Chen, R.; Decramer, M.; Fabbri, L.M.; et al. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Lung Disease 2017 Report. GOLD Executive Summary. Am. J. Respir. Crit. Care Med. 2017, 195, 557–582. [Google Scholar] [CrossRef] [Green Version]
  24. ATS Committee on Proficiency Standards for Clinical Pulmonary Function Laboratories. ATS statement: Guidelines for the six-minute walk test. Am. J. Respir. Crit. Care Med. 2002, 166, 111–117. [Google Scholar] [CrossRef]
  25. Ambrozin, A.R.P.; Cataneo, D.C.; Arruda, K.A.; Cataneo, A.J.M. Time in the stair-climbing test as a predictor of thoracotomy postoperative complications. J. Thorac. Cardiovasc. Surg. 2013, 145, 1093–1097. [Google Scholar] [CrossRef] [Green Version]
  26. Brunelli, A.; Al Refai, M.; Monteverde, M.; Borri, A.; Salati, M.; Fianchini, A. Stair climbing test predicts cardiopulmonary complications after lung resection. Chest 2002, 121, 1106–1110. [Google Scholar] [CrossRef] [PubMed]
  27. Brunelli, A.; Monteverde, M.; Al Refai, M.; Fianchini, A. Stair climbing test as a predictor of cardiopulmonary complications after pulmonary lobectomy in the elderly. Ann. Thorac. Surg. 2004, 77, 266–270. [Google Scholar] [CrossRef] [PubMed]
  28. Brunelli, A.; Pompili, C.; Berardi, R.; Mazzanti, P.; Onofri, A.; Salati, M.; Cascinu, S.; Sabbatini, A. Performance at preoperative stair-climbing test is associated with prognosis after pulmonary resection in stage I non-small cell lung cancer. Ann. Thorac. Surg. 2012, 93, 1796–1800. [Google Scholar] [CrossRef] [PubMed]
  29. Brunelli, A.; Refai, M.; Xiume, F.; Salati, M.; Sciarra, V.; Socci, L.; Sabbatini, A. Performance at symptom-limited stair-climbing test is associated with increased cardiopulmonary complications, mortality, and costs after major lung resection. Ann. Thorac. Surg. 2008, 86, 240–247; discussion 247–248. [Google Scholar] [CrossRef]
  30. Dong, J.; Mao, Y.; Li, J.; He, J. Stair-Climbing Test Predicts Postoperative Cardiopulmonary Complications and Hospital Stay in Patients with Non-Small Cell Lung Cancer. Med. Sci. Monit. 2017, 23, 1436–1441. [Google Scholar] [CrossRef] [Green Version]
  31. O’Neill, F.; Carter, E.; Pink, N.; Smith, I. Routine preoperative tests for elective surgery: Summary of updated NICE guidance. BMJ 2016, 354, i3292. [Google Scholar] [CrossRef] [PubMed]
  32. Lurati Buse, G.A.; Mauermann, E.; Ionescu, D.; Szczeklik, W.; De Hert, S.; Filipovic, M.; Beck-Schimmer, B.; Spadaro, S.; Matute, P.; Bolliger, D.; et al. Risk assessment for major adverse cardiovascular events after noncardiac surgery using self-reported functional capacity: International prospective cohort study. Br. J. Anaesth. 2023, 130, 655–665. [Google Scholar] [CrossRef] [PubMed]
  33. Collins, G.S.; Reitsma, J.B.; Altman, D.G.; Moons, K.G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. BMJ 2015, 350, g7594. [Google Scholar] [CrossRef] [Green Version]
  34. Jones, P.W.; Harding, G.; Berry, P.; Wiklund, I.; Chen, W.H.; Kline Leidy, N. Development and first validation of the COPD Assessment Test. Eur. Respir. J. 2009, 34, 648–654. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Miller, M.R.; Hankinson, J.; Brusasco, V.; Burgos, F.; Casaburi, R.; Coates, A.; Crapo, R.; Enright, P.; van der Grinten, C.P.; Gustafsson, P.; et al. Standardisation of spirometry. Eur. Respir. J. 2005, 26, 319–338. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Knudson, R.J.; Lebowitz, M.D.; Holberg, C.J.; Burrows, B. Changes in the normal maximal expiratory flow-volume curve with growth and aging. Am. Rev. Respir. Dis. 1983, 127, 725–734. [Google Scholar]
  37. Martin, D.; Mantziari, S.; Demartines, N.; Hubner, M.; Group, E.S.A.S. Defining Major Surgery: A Delphi Consensus Among European Surgical Association (ESA) Members. World J. Surg. 2020, 44, 2211–2219. [Google Scholar] [CrossRef]
  38. Riley, R.D.; Ensor, J.; Snell, K.I.E.; Harrell, F.E., Jr.; Martin, G.P.; Reitsma, J.B.; Moons, K.G.M.; Collins, G.; van Smeden, M. Calculating the sample size required for developing a clinical prediction model. BMJ 2020, 368, m441. [Google Scholar] [CrossRef] [Green Version]
  39. De Albuquerque Medeiros, R.; Faresin, S.; Jardim, J. Postoperative lung complications and mortality in patients with mild-to-moderate COPD undergoing elective general surgery. Arch. Bronconeumol. 2001, 37, 227–234. [Google Scholar] [CrossRef]
  40. Jammer, I.; Wickboldt, N.; Sander, M.; Smith, A.; Schultz, M.J.; Pelosi, P.; Leva, B.; Rhodes, A.; Hoeft, A.; Walder, B.; et al. Standards for definitions and use of outcome measures for clinical effectiveness research in perioperative medicine: European Perioperative Clinical Outcome (EPCO) definitions: A statement from the ESA-ESICM joint taskforce on perioperative outcome measures. Eur. J. Anaesthesiol. 2015, 32, 88–105. [Google Scholar] [CrossRef] [Green Version]
  41. Brueckmann, B.; Villa-Uribe, J.L.; Bateman, B.T.; Grosse-Sundrup, M.; Hess, D.R.; Schlett, C.L.; Eikermann, M. Development and validation of a score for prediction of postoperative respiratory complications. Anesthesiology 2013, 118, 1276–1285. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Canet, J.; Gallart, L.; Gomar, C.; Paluzie, G.; Valles, J.; Castillo, J.; Sabate, S.; Mazo, V.; Briones, Z.; Sanchis, J.; et al. Prediction of postoperative pulmonary complications in a population-based surgical cohort. Anesthesiology 2010, 113, 1338–1350. [Google Scholar] [CrossRef] [PubMed]
  43. Johnson, R.G.; Arozullah, A.M.; Neumayer, L.; Henderson, W.G.; Hosokawa, P.; Khuri, S.F. Multivariable predictors of postoperative respiratory failure after general and vascular surgery: Results from the patient safety in surgery study. J. Am. Coll. Surg. 2007, 204, 1188–1198. [Google Scholar] [CrossRef]
  44. Reilly, D.F.; McNeely, M.J.; Doerner, D.; Greenberg, D.L.; Staiger, T.O.; Geist, M.J.; Vedovatti, P.A.; Coffey, J.E.; Mora, M.W.; Johnson, T.R.; et al. Self-reported exercise tolerance and the risk of serious perioperative complications. Arch. Intern. Med. 1999, 159, 2185–2192. [Google Scholar] [CrossRef] [Green Version]
  45. Blanco, I.; Diego, I.; Bueno, P.; Casas-Maldonado, F.; Miravitlles, M. Geographic distribution of COPD prevalence in the world displayed by Geographic Information System maps. Eur. Respir. J. 2019, 54, 1900610. [Google Scholar] [CrossRef] [PubMed]
  46. Lee, A.H.Y.; Snowden, C.P.; Hopkinson, N.S.; Pattinson, K.T.S. Pre-operative optimisation for chronic obstructive pulmonary disease: A narrative review. Anaesthesia 2021, 76, 681–694. [Google Scholar] [CrossRef]
  47. Fleisher, L.A. Preoperative evaluation in 2020: Does exercise capacity fit into decision-making? Br. J. Anaesth. 2020, 125, 224–226. [Google Scholar] [CrossRef]
Jcm 12 04180 g001 550
Figure 1. Study flow. Abbreviations: CAT: chronic obstructive pulmonary disease assessment test; COPD: chronic obstructive pulmonary disease.
Figure 1. Study flow. Abbreviations: CAT: chronic obstructive pulmonary disease assessment test; COPD: chronic obstructive pulmonary disease.
Jcm 12 04180 g001
Jcm 12 04180 g002 550
Figure 2. Receiver operating characteristic (ROC) curves and ten-fold cross-validated areas under the ROC curve (cvAUC) illustrate the discriminatory capability of two multivariable models to predict postoperative pulmonary complications in patients with known or suspected COPD undergoing major surgery. Abbreviations: bc-b 95% CI: bias-corrected bootstrapped 95% confidence interval; SRPFC: self-reported poor exercise capacity; SCT: stair-climbing test.
Figure 2. Receiver operating characteristic (ROC) curves and ten-fold cross-validated areas under the ROC curve (cvAUC) illustrate the discriminatory capability of two multivariable models to predict postoperative pulmonary complications in patients with known or suspected COPD undergoing major surgery. Abbreviations: bc-b 95% CI: bias-corrected bootstrapped 95% confidence interval; SRPFC: self-reported poor exercise capacity; SCT: stair-climbing test.
Jcm 12 04180 g002
Table
Table 1. Baseline characteristics.
Table 1. Baseline characteristics.
VariablesNon-COPD
(n = 80)		COPD
(n = 240)		p-Value
Sociodemographic data
Age (years)57.74 ± 13.5766.25 ± 9.94<0.001 #
Body mass index (kg m−2)27.17 ± 6.1025.70 ± 5.870.056 #
Sex (male)42 (52.50)172 (71.67)0.002 *
COPD severity grades (GOLD)
I-78 (32.50)-
II-125 (52.08)-
III-28 (11.67)-
IV-9 (3.75)-
Comorbidities and preconditions
Bronchial asthma12 (15.00)29 (12.08)0.562 *
Obstructive sleep apnea syndrome5 (6.25)16 (6.67)1.000 *
Coronary artery disease14 (17.50)62 (25.83)0.172 *
Congestive heart failure1 (1.25)38 (15.83)<0.001 *
Diabetes mellitus10 (12.50)49 (20.42)0.135 *
Peripheral arterial occlusive disease5 (6.25)35 (14.58)0.053 *
Renal failure11 (13.93)53 (22.08)0.145 *
Smoking status
Ever-smoked62 (77.50)232 (96.67)<0.001 **
Pack years9.88 (0.00–102.00)40.00 (0.00-189.00)<0.001 **
Stair-climbing
Self-reported inability to climb two flights (y/n)1 (1.25)18 (7.50)0.052 *
Stair-climbing test
Unable to climb two flights of stairs (y/n)2 (2.50)21 (8.75)0.079 *
Successful completed (y/n)59 (73.75)128 (53.33)0.002 *
High (m)12.07 (11.26–12.07)12.07 (6.80–12.07)0.001 **
Power (W)188.59 ± 71.18146.14 ± 65.06<0.001 **
Pace (stairs/sec)1.37 ± 0.401.12 ± 0.40<0.001 **
The dataset of this analysis is complete without missing values; values are mean ± standard deviation, median (IQR), or number (proportion), whichever is appropriate; differences between COPD and non-COPD patients were compared using Fisher’s exact test *, Student’s t-test #, or the Mann–Whitney U test **, whichever was appropriate. Abbreviations: GOLD: global initiative for chronic obstructive lung diseases.
Table
Table 2. Adaptive LASSO regression for the selection of eligible stair-climbing covariables out of six candidate predictors on top of the baseline variables.
Table 2. Adaptive LASSO regression for the selection of eligible stair-climbing covariables out of six candidate predictors on top of the baseline variables.
Covariablesβ-Coefficients
with λmin = 0.00054
Stair-climbing variables
Self-reported inability to climb 2 flights of stairs (SRPFC) (y/n)3.39
Observed inability to climb 2 flights of stairs in the SCT (SCTPFC) (y/n)Shrunk to zero
Successful completion (y/n)Shrunk to zero
High (m)Shrunk to zero
Power (W) Shrunk to zero
Pace (stairs/sec)Shrunk to zero
Baseline variables (fixed)
COPD-specific assessments (GOLD key indicators and smoking history)
Chronic cough (y/n)1.26
Sputum production (y/n)1.70
Dyspnea (y/n)0.97
Recurrent lower respiratory tract infections (y/n)2.06
Ever-smoked (y/n)0.83
Pack years (if ever-smoked) 11.14
Preconditions, sociodemographic, surgical, and procedural characteristics
Age (years)1.02
Body mass index (kg m−2) 11.17
Sex (male)2.09
ASA physical status
ASA I and II(Reference)
ASA III0.99
ASA IV0.936
Cardiovascular diseases (y/n)1.30
Cancer operation (y/n)1.09
Type of surgery:
Lower abdominal or orthopedic(Reference)
Ear, nose, and throat0.71
Neurosurgery1.01
Upper abdominal3.28
Thoracic and mediastinal9.27
Reported are λmin—penalty parameter determined by adaptive LASSO, β-coefficients of the best fitting LASSO regression model that was not shrunk to zero; covariables were considered informative if coefficients were not shrunk to zero; 1 per two-fold increase. The dataset of this analysis is complete without missing values. Abbreviations: SCT: stair-climbing test; SR: self-reported; PFC: poor functional capacity.
Table
Table 3. Multivariable logistic regression analysis: fitting of two multivariable prediction models for postoperative pulmonary complications.
Table 3. Multivariable logistic regression analysis: fitting of two multivariable prediction models for postoperative pulmonary complications.
SRPFC ModelSCT Model
Adjusted OR
(95% CI)		p-Value 2Adjusted OR
(95% CI)		p-Value 2
Poor functional capacity (inability to climb two flights of stairs)
Self-reported (SRPFC)5.45 (1.04–28.60)0.045–
Observed in the stair-climbing test (SCTPFC)– 3.78 (0.87–16.34)0.075
COPD-specific assessments (GOLD key indicators and pack years)
Chronic cough1.17 (0.60–2.28)0.4851.17 (0.60–2.28)0.642
Sputum production1.59 (0.89–2.82)0.0621.74 (0.99–3.07)0.054
Dyspnea0.76 (0.40–1.46)0.8620.98 (0.53–1.81)0.951
Recurrent lower respiratory
tract infections		1.91 (0.62–5.86)0.1931.94 (0.65–5.82)0.236
Ever-smoked0.74 (0.20–2.71)0.8060.75 (0.21–2.69)0.656
Pack years (if ever-smoked) 11.12 (0.90–1.39)0.1801.17 (0.94–1.45)0.162
Sociodemographic, surgical and procedural data, medical preconditions
Age; years1.01 (0.99–1.04)0.2571.01 (0.99–1.04)0.291
Body mass index; kg m−2 11.14 (0.44–2.94)0.7821.12 (0.43–2.89)0.817
Sex (male)2.17 (1.18–4.00)0.0132.12 (1.15–3.91)0.016
ASA physical status
ASA IIreference reference
ASA III0.98 (0.51–1.92)0.9630.98 (0.51–1.91)0.961
ASA IV0.88 (0.26–2.90)0.8280.86 (0.26–2.86)0.802
Cardiovascular diseases1.31 (0.70–2.44)0.3921.26 (0.68–2.33)0.470
Cancer operation1.09 (0.62–1.90)0.7621.08 (0.62–1.89)0.780
Type of surgery:
Lower abdominal or orthopedicreference reference
Ear, nose, and throat0.71 (0.29–1.77)0.4670.72 (0.29–1.79)0.485
Neurosurgery1.02 (0.44–2.33)0.9691.08 (0.47–2.50)0.848
Upper abdominal3.35 (1.60–7.04)0.0013.34 (1.59–7.01)0.001
Thoracic and mediastinal9.38 (3.33–26.42)<0.0019.20 (3.27–25.89)<0.001
The dataset of this analysis is complete, without missing values; the results are reported as adjusted odds ratios (ORs) with 95% confidence intervals (95% CIs). 1 per two-fold increase; 2 reported p-value results from the Wald χ2 test. Abbreviations: ASA: American Society of Anesthesiologists; COPD: chronic obstructive pulmonary disease; GOLD: global initiative for chronic obstructive lung disease, SCT: stair-climbing test; SR: self-reported; PFC: poor functional capacity.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dankert, A.; Neumann-Schirmbeck, B.; Dohrmann, T.; Plümer, L.; Wünsch, V.A.; Sasu, P.B.; Sehner, S.; Zöllner, C.; Petzoldt, M. Stair-Climbing Tests or Self-Reported Functional Capacity for Preoperative Pulmonary Risk Assessment in Patients with Known or Suspected COPD—A Prospective Observational Study. J. Clin. Med. 2023, 12, 4180. https://doi.org/10.3390/jcm12134180

AMA Style

Dankert A, Neumann-Schirmbeck B, Dohrmann T, Plümer L, Wünsch VA, Sasu PB, Sehner S, Zöllner C, Petzoldt M. Stair-Climbing Tests or Self-Reported Functional Capacity for Preoperative Pulmonary Risk Assessment in Patients with Known or Suspected COPD—A Prospective Observational Study. Journal of Clinical Medicine. 2023; 12(13):4180. https://doi.org/10.3390/jcm12134180

Chicago/Turabian Style

Dankert, André, Benedikt Neumann-Schirmbeck, Thorsten Dohrmann, Lili Plümer, Viktor Alexander Wünsch, Phillip Brenya Sasu, Susanne Sehner, Christian Zöllner, and Martin Petzoldt. 2023. "Stair-Climbing Tests or Self-Reported Functional Capacity for Preoperative Pulmonary Risk Assessment in Patients with Known or Suspected COPD—A Prospective Observational Study" Journal of Clinical Medicine 12, no. 13: 4180. https://doi.org/10.3390/jcm12134180

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop