Next Article in Journal
Somatostatinoma and Neurofibromatosis Type 1-A Case Report and Review of the Literature
Next Article in Special Issue
Multidisciplinary Evaluation of Interstitial Lung Diseases: New Opportunities Linked to Rheumatologist Involvement
Previous Article in Journal
Red Blood Cell Distribution Width (RDW) Predicts COVID-19 Severity: A Prospective, Observational Study from the Cincinnati SARS-CoV-2 Emergency Department Cohort
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Model for Early COvid-19 Recognition (MECOR) Score: A Proof-of-Concept for a Simple and Low-Cost Tool to Recognize a Possible Viral Etiology in Community-Acquired Pneumonia Patients during COVID-19 Outbreak

by
Gianluca Sambataro
1,*,†,
Mauro Giuffrè
2,3,†,
Domenico Sambataro
4,5,
Andrea Palermo
6,
Giovanna Vignigni
1,
Roberto Cesareo
7,
Nunzio Crimi
1,
Sebastiano Emanuele Torrisi
1,
Carlo Vancheri
1,
Lorenzo Malatino
5,
Michele Colaci
5,
Nicoletta Del Papa
8,
Francesca Pignataro
8,
Erik Roman-Pognuz
9,
Massimiliano Fabbiani
10,
Francesca Montagnani
10,11,
Chiara Cassol
10,11,
Lorenzo Cavagna
12,
Valentina Zuccaro
13,
Verena Zerbato
2,
Cristina Maurel
2,
Roberto Luzzati
2 and
Stefano Di Bella
2
add Show full author list remove Hide full author list
1
Department of Clinical and Experimental Medicine, Respiratory Medicine Unit, University Hospital “Policlinico-Vittorio Emanuele”, University of Catania, 95123 Catania, Italy
2
Department of Medical, Surgical and Health Sciences, University of Trieste, 34151 Trieste, Italy
3
Italian Liver Foundation, Basovizza, 34149 Trieste, Italy
4
Artroreuma S.R.L., Outpatient of Rheumatology Associated with the National Health System corso S. Vito 53, Mascalucia, 95030 Catania, Italy
5
Department of Clinical and Experimental Medicine, Internal Medicine Unit, Cannizzaro Hospital, University of Catania, via Messina 829, 95100 Catania, Italy
6
Unit of Endocrinology and Diabetes, Campus Bio-Medico University, 00128 Rome, Italy
7
Unit of Metabolic Diseases, “S.M. Goretti” Hospital, 04100 Latina, Italy
8
Dept Rheumatology, ASST Pini-CTO, Piazza Cardinal Ferrari 1, 20122 Milan, Italy
9
Department of Perioperative Medicine, Intensive Care and Emergency, University Hospital, 34151 Trieste, Italy
10
Infectious and Tropical Disease Unit, Azienda Ospedaliero-Universitaria Senese, 53100 Siena, Italy
11
Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy
12
Rheumatology Division, University and IRCCS Policlinico San Matteo Foundation, Lombardia, 27100 Pavia, Italy
13
Infectious Diseases Clinic, University and IRCCS Policlinico S. Matteo Foundation, 27100 Pavia, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2020, 10(9), 619; https://doi.org/10.3390/diagnostics10090619
Submission received: 29 June 2020 / Revised: 16 August 2020 / Accepted: 20 August 2020 / Published: 21 August 2020
(This article belongs to the Special Issue Clinical and Radiological Features of Interstitial Lung Diseases 2.0)

Abstract

:
This study aims to assess the peripheral blood cell count “signature” of Severe Acute Respiratory Syndrome-Coronavirus 2 (SARS-CoV-2) to discriminate promptly between COronaVIrus Disease 19 (COVID-19) and community-acquired pneumonia (CAP). We designed a retrospective case-control study, enrolling 525 patients (283 COVID-19 and 242 with CAP). All patients had a fever and at least one of the following signs: cough, chest pain, or dyspnea. We excluded patients treated with immunosuppressants, steroids, or affected by diseases known to modify blood cell count. COVID-19 patients showed a significant reduction in white blood cells (neutrophils, lymphocytes, monocytes, eosinophils) and platelets. We studied these parameters univariately, combined the significant ones in a multivariate model (AUROC 0.86, Nagelkerke PSEUDO-R2 0.5, Hosmer–Lemeshow p-value 0.9) and examined its discriminative performance in an internally-randomized validation cohort (AUROC 0.84). The cut-off selected according to Youden’s Index (−0.13) showed a sensitivity of 84% and a specificity of 72% in the training cohort, and a sensitivity of 88% and a specificity of 73% in the validation cohort. In addition, we determined the probability of having COVID-19 pneumonia for each Model for possible Early COvid-19 Recognition (MECOR) Score value. In conclusion, our model could provide a simple, rapid, and cheap tool for prompt COVID-19 diagnostic triage in patients with CAP. The actual effectiveness should be evaluated in further, prospective studies also involving COVID-19 patients with negative nasopharyngeal swabs.

Graphical Abstract

1. Introduction

The outbreak of the novel COronaVirus Disease 2019 (COVID-19) caused by the Severe Acute Respiratory Syndrome-CoronaVirus 2 (SARS-CoV-2) began in December 2019. Since then, the disease has caused a global pandemic, and as of 26 June 2020, the World Health Organization (WHO) reported about 10 million cases of COVID-19 worldwide with approximately 500,000 deaths. Given the current emergency, clinicians and researchers are looking for new tools that could allow the early identification of COVID-19 patients [1]. Currently, the diagnosis is made through rhino-pharyngeal swabs, even considering the high risk of false negatives [2]. Furthermore, other techniques, such as viral detection in sputum, tracheal-aspirate, and Broncho-Alveolar Lavage (BAL) [3] may be more sensitive, but they are not yet routinely used. Finally, serological assays for immunoglobulin [4] produce information regarding contact with the virus, rather than an actual, current infection, and they are not rapidly available. In addition, imaging techniques are not always able to confidently distinguish COVID-19 from other pneumonia etiologies.
In recent years, growing evidence has supported the role of the simple blood cell count in predicting prognosis in several conditions. These studies evaluated the role of simple, rapid, nonexpensive tools such as Neutrophil-to-Lymphocyte Ratio (NLR). This index showed good results in predicting mortality, disease activity, and severity in a broad spectrum of diseases such as Community-Acquired Pneumonia (CAP), atherosclerosis, cancer, and autoimmune disorders [5,6,7,8,9,10,11]. In particular, a high NLR was found to predict mortality [5] and admission to a respiratory intensive care unit [9] in patients with CAP.
Several studies reported alterations in peripheral blood cells in COVID-19 patients and their association with disease severity. High ratio of NLR and lymphopenia are associated with worse outcomes, whereas an increased level of eosinophils could positively affect the final prognosis [12,13,14,15]. That being said, the use of a simple white blood cell count to distinguish between COVID-19 and CAP that could show similar clinical presentations has not been explored yet.
The current study aims to evaluate the potential role of the complete blood cell count in predicting the presence of SARS-CoV-2 infection in patients presenting with pneumonia symptoms.

2. Materials and Methods

This is a case-control study involving patients with COVID-19 and CAP as the control group. The study was conducted retrospectively, including COVID-19 symptomatic patients with positive swabs admitted between February and April 2020 in Italy from participating centers. We decided to use CAP as the control group to compare between COVID-19 and a common disease mimicker with different management in terms of therapy and patients’ isolation. This study was conducted according to the declaration of Helsinki approved by the Ethics Committee (Unique RegionalEthical Committee Friuli Venezia-Giulia 16 April 2020 cod. CEUR 2020-OS-072).
The diagnosis of COVID-19 was made through suggestive symptoms, positive swabs, and consistent imaging in chest radiography and/or Computed Tomography.
Considering that the prevalence of CAP is estimated at 258 patients in every 100,000 individuals, considering a confidence interval of 95% and a confidence interval of 7, we calculated an expected sample size of 196 individuals of CAP. In addition, as of 30th April 2020, 18,000 patients with COVID-19 were hospitalized in Italy. With that taken into consideration, considering a confidence level of 95% and a confidence interval of 7, we calculated a sample size of 194 subjects with proven COVID-19 infection that required hospitalization.

2.1. Inclusion Criteria

We included consecutive adult patients (>18 years) with a fever ≥37.3 °C, presenting dyspnea, and/or chest pain or cough requiring hospitalization and undergoing a full white blood cell (WBC) count on admission, which included neutrophils (NEUT), lymphocytes (LYM), monocytes (MON), eosinophils (EOS), and platelets (PLT). Patients must have been diagnosed with CAP (as reported on hospital discharge charts before the SARS-CoV-2 outbreak, January 2017–December 2018) or with SARS-CoV-2 infection, which was confirmed by real-time reverse-transcription polymerase-chain-reaction (RT-PCR) assay from nasal and pharyngeal swabs.

2.2. Exclusion Criteria

Patients were excluded from the study for (1) missing data regarding complete blood count, chest imaging, clinical presentation, pharmacological anamnesis, and clinical history for previous and concurrent comorbidities: (2) current hospital-acquired pneumonia; (3) lung malignancies (both primary and metastatic neoplasms); (4) history of chemotherapy; (5) current use of steroids or treatment with any immunosuppressive drug; (6) known HIV infection; (7) liver cirrhosis; (8) organ transplantation; (9) mild pneumonia not requiring hospitalization.

2.3. Patient Data Collection

Data collection of the training and validation cohorts was conducted retrospectively, involving patients with symptoms suggestive of pneumonia and referred to five hospital centers, each of them located in distinct territories of North, Central, and South Italy. In particular, patients with CAP were evaluated between January 2017 and December 2018, before the SARS-CoV-2 outbreak. On the contrary, data regarding the SARS-CoV-2 infection were collected from patients admitted to the five participating centers between February and April 2020. The patients mentioned in the results have already been screened by the referring center for the application of inclusion/exclusion criteria.

2.4. Statistical Analysis

Variables were reported as the median and interquartile range (IQR, 1–3). We explored intercohort (training cohort vs. validation cohort) and intracohort (SARS-CoV-2 negatives vs. positives) differences using the Mann–Whitney U test or the Wilcoxon Sum-Rank test for continuous variables and the Pearson’s Chi-Square Test for discrete variables.
The variables that turned out to be statistically different between SARS-CoV-2 negative and SARS-CoV-2 positive patients in the training cohort were modeled in a univariate fashion using a binary logistic regression. In particular, the probability of testing positive for SARS-CoV-2 infection was calculated using SARS-CoV-2 diagnosis as the dependent variable (0 = non-SARS-CoV-2 pneumonia; 1 = SARS-CoV-2 pneumonia) and white blood cell parameters. Models were compared regarding their discrimination (i.e., the ability of the studied model to distinguish correctly between the two classes of outcomes) [16] and calibration (i.e., the measure of how close the predicted probabilities are to the observed rate of the selected outcome for any given value of the independent variable that constitutes the model) [16,17], through the area under the receiver-operating characteristic curve (AUROC), Akaike information criterion (AIC), the Bayesian information criterion (BIC), the Hosmer–Lemeshow goodness-of-fit test, and the Nagelkerke pseudo-R2. A complete assessment of model performance should take into consideration both discrimination and calibration. Therefore, we estimated a multivariate model including those variables that univariately showed an AUROC ≥ 0.65 and a Hosmer–Lemeshow p-value ≥ 0.05. The multivariate model was estimated through forward stepwise imputation (p < 0.10 to enter, p > 0.15 to be removed). Additionally, before being included in the model, variables underwent a nonlinear transformation using natural logarithm or arctangent functions, which were performed to obtain a linear relationship between the log odds and the independent variable and to obtain a final score that could range between −10 and +10. Between the seven possible multivariate models that could be obtained, we chose the one that showed the lowest AIC and where the single variable showed a variance inflation factor (VIF) ≥ 5, to exclude residual multicollinearity [18]. The linear predictor (LP) of the multivariate model was calculated as the sum of the intercept (β0), and each coefficient multiplied for the related variable (βn × xn). For the sake of simplicity, the LP of the multivariate model was renamed as the Model for possible Early COvid-19 Recognition (MECOR) Score. To obtain the probability of being SARS-CoV-2 positive according to the MECOR Score, the LP was computed in the following function:
f ( L P ) = 1 ( 1 1 +   e L P )
To validate our results, we randomly selected an internal derivative cohort of 250 patients maintaining the ratio of 1:16 (COVID-19/CAP) found in the training cohort.
Optimal MECOR Score cut-off values were chosen in the training cohort according to Youden’s Index [19], or to either maximize sensitivity or specificity. The same cut-offs were also applied in the validation cohort, after AUROC computation and inter-ROC curve difference analysis employing the Hanley–McNeil Test [20]. Cut-off characteristics were reported using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, positive likelihood ratio (+LR), and negative likelihood ratio (−LR). For all analyses, two-sided statistical significance was defined as p < 0.05. Data were analyzed using SPSS (Statistical Package for Social Science) version 26.0 (IBM SPSS Statistics for MAC OS. Armonk, NY, USA: IBM Corp.).

3. Results

We collected data from 525 patients in the training cohort, of which 283 (53.9%) had COVID-19, and 242 (46.1%) were diagnosed with CAP (control group). The identified CAP pathogens are reported in Table 1. Our CAP cohort included 30% of interstitial pneumonia. Three-hundred and thirty-one (63%) patients were male with a median age of 64 (52–77) years. In the validation cohort, we collected data from 250 patients (135 COVID-19, 115 control group), who were predominantly male (n = 164, 65.6%) and had a median age of 63 (53–77) years. As auspicated, there was no statistically significant difference in blood leukocytes and SARS-CoV-2 infection prevalence between the two cohorts (Table 1).
In the training cohort, SARS-CoV-2 positive patients had lower median WBC (5930 vs. 11,465 cells/mm3, p < 0.00001), NEUT (4300 vs. 8925 cells/mm3, p < 0.00001), LYM (830 vs. 1185 cells/mm3, p = 0.005), MON (430 vs. 755 cells/mm3, p < 0.00001), EOS (0 vs. 20 cells/mm3, p < 0.00001), and PLT (186,000 vs. 251,000 cells/µL, p < 0.00001) when compared to patients with CAP. A similar trend was also observed in the validation cohort as shown in Table 2.

3.1. Model Analysis

As explained in the methods section, we initially built six univariate models (Model 1 through 6) based on variables that resulted significantly different between SARS-Cov-2 negative and positive patients in the training cohort. As reported in Table 3, M1, M2, M3, M4, and M6 showed an AUROC ≥ 0.65 and a Hosmer–Lemeshow p-value ≥ 0.05. The probability of being SARS-CoV-2 positive according to changes in the variable constituting M1, M2, M3, M4, and M6 is plotted in Figure 1. Then, we proceeded to the nonlinear transformation of the independent variables of M1, M2, M3, M4, and M6 as explained in the method section. Transformed variables were computed in a multivariate model (MM). The MM (Table 4) showed the following metrics: AUROC 0.86, Nagelkerke PSEUDO-R2 0.5, Hosmer–Lemeshow p-value 0.9, AIC 516, BIC 533). For the sake of simplicity, the LP of the MM was renamed as the “MECOR Score”, and its formula is reported below:
MECOR   Score   =   18.47     3.23 × log e ( WBC [ cells / mm 3 ] )     0.76   × log e ( LYM [ cells / mm 3 ] ) +   11.94   × arctan ( MON [ cells / mm 3 ]   ×   NEUT [ cells / mm 3 ] PLT [ cells / μ L ] )
By replacing patients’ variables, with the same unit of measure as reported in the formula, we performed the canonical cut-off analysis, which is reported in Table 5. In particular, (1) a MECOR Score ≤ −2.54 showed a 100% sensitivity, 10% specificity, 56% PPV, 100% NVP, 1.11 +LR, and 59% accuracy; (2) a MECOR Score ≥ −0.13 showed an 84% sensitivity, 72% specificity, 78% PPV, 79% NVP, 2.92 +LR, 0.23 −LR, and 80% accuracy; (3) a MECOR Score ≥ +4 showed a 2% sensitivity, 100% specificity, 100% PPV, 47% NVP, 0.98 −LR, and a 47% accuracy.
However, we proceeded further by determining the probability of testing positive to SARS-CoV-2 according to the MECOR Score, employing the formula reported in the method section, whose graphical representation is plotted in Figure 2. The slope of the probability curve sharply rose from a MECOR Score equal to −3 and reached a plateau at a MECOR Score of +4. This behavior can be interpreted as follows: the probability of being SARS-Cov-2 positive was approximately 0% for values < −3, then, it steadily increased and reached 100% for values > 4.

3.2. MECOR Score Application in the Validation Cohort

We applied the MECOR Score to the validation cohort and evaluated its discriminative ability through AUROC analysis. As reported in Figure 3, the MECOR Score showed an AUROC of 0.84 (95% Confidence Interval, CI 0.81–0.87), comparable to the training cohort (nonsignificant Hanley–McNeal test). Afterward, we applied the cut-offs selected for the training cohort, and their characteristics are reported in Table 5. Additionally, we proceeded further by plotting the probability of being SARS-Cov-2 positive according to the MECOR Score in the validation cohort (Figure 2). If compared to the probability plot of the training cohort, it appears to be translated towards the right. In particular, the slope of the probability curve sharply rose from a MECOR Score equal to −1 and reached a plateau at a MECOR Score of 5. This behavior can be interpreted as follows: the probability of being SARS-Cov-2 positive was approximately 0% for values < −1, then it steadily increased and reached 100% for values > 5.

3.3. Online Calculator

An online calculator and a mobile app based on the MECOR Score were developed to allow clinicians to enter the values of the five variables required to obtain the probability of being SARS-CoV-2 positive based on admission laboratory tests (http://bit.ly/mecorscore).

4. Discussion

In line with previous studies [12,13,14,15], we found significant differences in peripheral blood cells count between CAP and COVID-19 pneumonia, with a reduction in all White Blood Cell (WBC) populations and platelets. In particular, lymphopenia and low eosinophil count could reliably predict worse outcomes if compared to other serological parameters [21]. However, the explanation of these associations, and the “peripheral withe blood signature” of SARS-CoV-2 is currently mostly speculative.

4.1. Behind the Pathophysiology of COVID-19 White Blood Cell Signature

The proposed mechanisms able to explain lymphopenia are related to several mechanisms, such as direct infection through the receptor ACE2, a potential direct attack on the lymphatic organs, lymphocytic apoptosis due to the exposition to high levels of Tumour Necrosis Factor-α and Interleukin-6 or their inhibition caused by metabolic disorders as lactic acidemia [14]. The high level of Interferon-γ in the first days after the clinical onset can also inhibit the differentiation of myeloid progenitors to eosinophils, thus favoring monocyte formation [22,23]. The cytokine storm mediated by T helper 1 lymphocytes could promote the rapid M1 polarization, lung migration, and accumulation of these cells [24,25].
Hematopoietic stem cells can also directly interact with the virus through direct infection, change in bone marrow environment, and/or through their Toll-Like Receptors. These interactions can cause impairment in cell differentiation mechanisms favoring, in turn, one or more specific lines [26]. The latter has been proposed as the mechanism underlying thrombocytopenia during SARS-1 [27]. Morphological abnormalities of platelets were described in COVID-19 in patients with both thrombocytosis and thrombocytopenia [28]. The authors explain this phenomenon with the severe, even if transient, perturbation of myelopoiesis caused in these patients by the cytokine storm. Morphological alterations were also identified in neutrophils, mainly including the production of immature cells, reduction in cytoplasmic granules, and Myeloperoxidase (MPO) [28]. These cells are of particular interest, because their count increased in both BAL and peripheral blood samples, together with monocytes, mainly in severe disease forms [24]. The pathogenic role of neutrophils in COVID-19 is likely due to the production of Neutrophil Extracellular Traps (NET), obtained with the release of DNA and MPO [28,29]. The titer of MPO-DNA was associated with a worse prognosis and increased inflammatory markers [29].

4.2. Study Limitations

Our study has some limitations. First of all, the retrospective nature could lead to unintentional missing data. In the present study, the score was retrospectively validated, whereas its effectiveness in real life should be prospectively proven. This is mainly true in patients with malignancy or autoimmune diseases, in which concomitant immunosuppressive treatment can favor the infection and, at the same time, alter the blood cell count [30]. The number of patients enrolled was relatively limited, and the control group was composed of infectious pneumonia in which a limited group of patients had atypical pneumonia. Moreover, only a small proportion of patients with CAP had been diagnosed with a viral etiology. For this reason, we cannot exclude that our score can be useful to detect viral pneumonia in general rather than only COVID-19. However, in these months of SARS-CoV-2 outbreak, most of the viral pneumonia are sustained by this virus, which represents a great concern for its management. On the other hand, it should be noted that 30% of our CAP patients showed imaging of atypical pneumonia, and most of our CAP patients had no identified pathogen. Therefore, it could be possible that at least some of our CAP patients could be sustained by a virus, alone or with a bacterial super-infection. [31]. The score was also derived in symptomatic patients with positive swabs: the performance in the diagnostic assessment of both oligo-asymptomatic COVID-19 subjects and swab-negative patients could be significantly different. Finally, our model is extremely complex and cannot be used in clinical practice without an available tool. To overcome this problem, we named our model the MECOR Score and developed an application available for common devices.

4.3. The MECOR Score in Real-Life and Study Strenghts

Before further discussion, it is necessary to highlight that the MECOR Score does not pretend to replace SARS-CoV-2 diagnosis by nasopharyngeal PCR testing but to support its diagnostic accuracy. In fact, one of the most significant challenges faced during the COVID-19 pandemic is to avoid misdiagnosis.
During the first stages of the COVID-19 outbreak, PCR test results often experienced severe delays if the number of tested patients exceeded laboratory capacity, leading to inappropriate patient placement. A widespread PCR testing shortage has also been confirmed by a recent trial in the United States, confirming that only 58% of patients received testing because of severe shortages [32]. This highlights the reason for which developing countries may suffer from shortages of PCR reagents and specialized laboratories, thus further delaying valuable test results. The WBC was recently included in an algorithm for the diagnosis of COVID-19, including High-Resolution Computed Tomography features [33]. Our model, being based solely on complete blood cell count, may be readily employed in countries with limited resources or cases when a prompt decision (pending test) should be taken (e.g., emergency medical and/or surgical conditions).
Moreover, despite the fact that the PCR test is considered the current gold standard for the diagnosis of COVID-19, this technique proved to have up to 30% false-negative results [34]. Therefore, positive patients can be admitted to a COVID-free ward contributing to sustained intrahospital transmission. If supported by external, prospective validation in this subgroup of patients, the MECOR score could be useful in the triage of patients with clinical presentation suggestive for COVID-19 supporting the PCR results. Our score could confirm a negative swab or, in case of high results, obtain a deeper respiratory sample (e.g., tracheal aspirate or BAL) or repeat the nasopharyngeal swab, before ruling out the patient as COVID-19 positive.
Regarding the MECOR Score performance, despite having calculated the most performing cut-off values (as shown in Table 5), we have plotted the probability of being COVID-19 positive according to each value of the MECOR Score (as shown in Figure 2). A given probability instead of a single number to rule-in or rule-out a specific event is indeed more helpful and could support the clinician in the decision to perform an invasive test if the probability is high. Cut-off values are always subject to false-positive and false-negative cases, and, sometimes, the clinical presentation may require more invasive tests, making cut-offs pointless [35].

5. Conclusions

This pilot retrospective study highlights the possibility to support a diagnosis of COVID-19 in the case of new waves of outbreak in patients with suggestive clinical presentation only evaluating Complete BloodCount. If validated in larger, prospective cohorts it could be useful in the case of new outbreak waves, supporting PCR tests in the case of delay or false negativity.

Author Contributions

Conceptualization, G.S., M.G., and S.D.B.; data curation, G.S., D.S., A.P., G.V., S.E.T., F.P., C.C., V.Z. (Valentina Zuccaro), V.Z. (Verena Zerbato), and C.M.; formal analysis, M.G.; funding acquisition, not applicable; investigation, G.S., D.S., A.P., R.C., N.C., C.V., L.M., M.C., N.D.P., E.R.-P., M.F., F.M., S.P., L.C., R.L., and S.D.B; methodology, M.G.,. R.C., N.C., C.V., L.M., M.C., N.D.P., E.R.-P., M.F., F.M., S.P., L.C., and R.L.; resources, not applicable; software, not applicable; supervision, G.S., M.G., R.C., N.C., C.V., L.M., M.C., N.D.P., E.R.-P., M.F., F.M., S.P., L.C., R.L., and S.D.B.; validation, all authors; visualization, all authors; writing—original draft, G.S., D.S., A.P., G.V., S.E.T., F.P., C.C. and V.Z. (Valentina Zuccaro), V.Z. (Verena Zerbato), and C.M.; writing—review and editing, G.S., M.G., R.C., N.C., C.V., L.M., M.C., N.D.P., E.R.-P., M.F., F.M., S.P., L.C., R.L., and S.D.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

C.V. is part of the F. Hoffmann-La Roche Ltd. and Boehringer Ingelheim Scientific board. He has received consulting fees and/or speaker fees from AstraZeneca, Boehringer Ingelheim, Chiesi, F. Hoffmann-La Roche Ltd., and Menarini. MF has received speakers’ honoraria and support for travel to meetings from Bristol-Myers Squibb (BMS), Gilead, Janssen-Cilag, Merck Sharp & Dohme (MSD), and ViiV Healthcare, and fees for attending advisory boards from BMS and Gilead and V.Z. (Valentina Zuccaro) has received speaking fees from AbbVie. G.S., M.G., D.S., A.P., G.V., S.E.T., R.C., N.C., L.M., M.C., N.D.P., F.P., E.R.P., F.M., C.C., S.P., L.C., V.Z. (Verena Zerbato), C.M., R.L., and S.D.B. declare that they have no conflict of interest associated with this study.

Abbreviations

AICAkaike Information criterion
AUROCArea Under Receiver-Operating Curve
BALBroncho-Alveolar Lavage
BICBayesian Information Criterion
CAPCommunity-Acquired Pneumonia (CAP)
COVID-19COronaVirus Disease 2019
EOSEosinophils
EREmergency Rooms (ER)
HRCTHigh-Resolution Computed Tomography
LPLinear predictor
LRLikehood Ratio
LYMLymphocytes
MECORModel for Early COvid-19 Recognition
MONMonocytes
MPOMyeloperoxidase
NETNeutrophil Extracellular Trap
NEUTNeutrophils
NLRNeutrophil-to-Lymphocyte Ratio (NLR)
NPVNegative Predictive Value
PLTplatelets
PPVPositive Predictive Value
RT-PCRreal-time reverse-transcription polymerase chain reaction
SARS-CoV-2Severe Acute Respiratory Syndrome-CoronaVirus 2
VICCariance inflaction factor
WBCWhite Blood Cells
WHOWorld Health Organization

References

  1. Lai, C.C.; Liu, Y.H.; Wang, C.Y.; Wang, Y.H.; Hsueh, S.C.; Yen, M.Y.; Ko, W.C.; Hsueh, P.R. Asymptomatic carrier state, acute respiratory disease, and pneumonia due to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2): Facts and myths. J. Microbiol. Immunol. 2020, 53, 404–412. [Google Scholar] [CrossRef] [PubMed]
  2. Winichakoon, P.; Chairwarith, R.; Liwsrisakun, C.; Salee, P.; Goonna, A.; Limsukon, A.; Kaewpoowat, Q. Negative Nasopharyngeal and Oropharingeal swabs do not rule out COVID-19. J. Clin. Microbiol. 2020, 58, e00297-20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Yang, Y.; Yang, M.; Shen, C.; Wang, F.; Yuan, J.; Li, J.; Zhang, M.; Wang, Z.; Xing, L.; Wei, J.; et al. Evaluating the Accuracy of Different Respiratory Specimens in the Laboratory Diagnosis and Monitoring the Viral Shedding of 2019-nCoV Infections. Available online: https://www.medrxiv.org/content/10.1101/2020.02.11.20021493v2.full.pdf (accessed on 26 June 2020).
  4. Zhang, W.; Du, R.H.; Li, B.; Zheng, X.S.; Yang, X.S.; Hu, B.; Wang, Y.Y.; Ziao, G.F.; Yan, B.; Shi, Z.L.; et al. Molecular and serological investigation of 2019-nCoV infected patients: Implication of multiple shedding routes. Emerg. Microbes Infect. 2020, 17, 386–389. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. De Jager, C.P.C.; Wever, P.C.; Gemen, E.F.A.; Kusters, R.; Van Gageldonk-Lafeber, A.B.; Van Der Poll, T.; Laheij, R.J.F. The Neutrophil-Lymphocyte Count Ratio in Patients with Community-Acquired Pneumonia. PLoS ONE 2012, 7, e46561. [Google Scholar] [CrossRef] [PubMed]
  6. Uslu, A.U.; Kucuk, A.; Sahin, A.; Ugan, Y.; Yilmaz, R.; Gungor, T.; Bagcaci, S.; Kucuksen, S. Two new inflammatory markers associated with disease activity Score-28 in patients with rheumatoid arthritis: Neutrophil-lymphocyte ratio and platelet-lymphocyte ratio. Int. J. Rheum. Dis. 2015, 18, 731–735. [Google Scholar] [CrossRef]
  7. Hasselbalch, I.C.; Sondergaard, H.B.; Koch-Henriksen, N.; Olsson, A.; Ullum, H.; Sellebjerg, F.; Oturai, A.B. The Neutrophil-to-lymphocyte ratio is associated with multiple sclerosis. Mult. Scler. J. Exp. Transl. Clin. 2018, 4, 2055217318813183. [Google Scholar] [CrossRef] [Green Version]
  8. Yayla, M.E.; Ilgen, U.; Okatan, I.E.; Uslu Yurteri, E.; Torgutalp, M.; Kelesoglu Dincer, A.B.; Aydemir Guloksuz, E.G.; Sezer, S.; Turgay, T.M.; Kinikli, G.; et al. Association of simple haematological parameters with disease manifestations, activity, and severity in patients with systemic sclerosis. Clin. Rheumatol. 2020, 39, 77–83. [Google Scholar] [CrossRef]
  9. Cataudella, E.; Giraffa, C.M.; Di Marca, S.; Pulvirenti, A.; Alaimo, S.; Pisano, M.; Terranova, V.; Corriere, T.; Ronsisvalle, M.L.; Di Quattro, R.; et al. Neutrophil-to-Lymphocyte Ratio: An emerging marker predicting prognosis in elderly adults with Community-Acquired Pneumonia. J. Am. Geriatr. Soc. 2017, 65, 1796–1801. [Google Scholar] [CrossRef]
  10. Corriere, T.; Di Marca, S.; Cataudella, E.; Pulvirenti, A.; Alaimo, S.; Stancanelli, B.; Malatino, L. Neutrophil-to-Lymphocyte Ratio is a strong predictor of atherosclerotic carotid plaques in older adults. Nutr. Metab. Cardiovasc. Dis. 2018, 28, 23–27. [Google Scholar] [CrossRef]
  11. Banna, G.L.; Di Quattro, R.; Malatino, L.; Fornarini, G.; Addeo, A.; Maruzzo, M.; Urzia, V.; Rungo, F.; Lipari, H.; De Giorgi, U.; et al. Neutrophil-to-lymphocyte ratio and lactate dehydrogenase as biomarkers for urothelial cancer treated with immunotherapy. Clin. Transl. Oncol. 2020. [Google Scholar] [CrossRef]
  12. Yang, A.P.; Liu, J.; Tao, W.Q.; Li, H.M. The diagnostic and predictive role of NLR, d-NLR and PLR in COVID-19 patients. Int. Immunopharmacol. 2020, 84, 106504. [Google Scholar] [CrossRef] [PubMed]
  13. Liu, F.; Xu, A.; Zhang, Y.; Xuan, W.; Yan, T.; Pan, K.; Yu, W.; Zhang, J. Patients of COVID-19 may benefit from sustained lopinavir-combined regimen and the increase of eosinophil may predict the outcome of COVID-19 progression. Int. J. Infect. Dis. 2020, 95, 183–191. [Google Scholar] [CrossRef] [PubMed]
  14. Tan, L.; Wang, Q.; Zhang, D.; Ding, J.; Huang, Q.; Tang, Y.Q.; Wang, Q.; Miao, H. Lymphopenia predicts disease severity of COVID-19: A descriptive and predictive study. Signal Transduct. Target Ther. 2020, 5, 33. [Google Scholar] [CrossRef] [PubMed]
  15. Zhang, J.J.; Dong, X.; Cao, Y.Y.; Yuan, Y.D.; Yang, Y.B.; Yan, Y.Q.; Akdis, C.A.; Gao, Y.D. Clinical characteristics of 140 patients infected with SARS-CoV-2 in Wuhan, China. Allergy 2020, 75, 1730–1741. [Google Scholar] [CrossRef] [PubMed]
  16. Pencina, M.J.; Demler, O.V. Novel metrics for evaluating improvement in discrimination: Net reclassification and integrated discrimination improvement for normal variables and nested models. Stat. Med. 2012, 31, 101–113. [Google Scholar] [CrossRef] [Green Version]
  17. Harrel, F.E.; Lee, K.L.; Mark, D.B. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat. Med. 1996, 15, 361–387. [Google Scholar] [CrossRef]
  18. Rogerson, P.A. Statistical Methods for Geography; SAGE Publications Ltd.: London, UK, 2001; ISBN -13 978-1446295731. [Google Scholar]
  19. Hanley, J.A.; McNeil, B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143, 29–36. [Google Scholar] [CrossRef] [Green Version]
  20. Youden, W.J. Index for rating diagnostic tests. Cancer 1950, 3, 32–35. [Google Scholar] [CrossRef]
  21. Fu, J.; Kong, J.; Wang, W.; Wu, M.; Yao, L.; Wang, Z.; Jin, J.; Wu, D.; Yu, X. The clinical implication of dynamic Neutrophil to lymphocyte ratio and D-dimer in COVID-19: A retrospective study in Suzhou China. Thromb. Res. 2020, 192, 3–8. [Google Scholar] [CrossRef]
  22. Huang, K.J.; Su, I.J.; Theron, M.; Wu, Y.C.; Lai, S.K.; Liu, C.C.; Lei, H.Y. An Interferon-gamma-related cytokine storm in SARS patients. J. Med. Virol. 2005, 75, 185–194. [Google Scholar] [CrossRef]
  23. De Bruin, A.M.; Buitenhuis, M.; Van der Sluijs, K.F.; Van Gisbergen, K.P.; Boon, L.; Nolte, M.A. Eosinophil differentiation in the bone marrow is inhibited by T cell-derived IFN-gamma. Blood 2010, 116, 2559–2569. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Zhou, Y.G.; Fu, B.Q.; Zheng, X.H.; Wang, D.S.; Zhao, C.C.; Qi, Y.J.; Sun, R.; Tian, Z.G.; Xu, X.L.; Wei, H.M. Pathogenic T cells and inflammatory monocytes incite inflammatory storm in severe COVID-19 patients. Natl. Sci. Rev. 2020, 7, 998–1002. [Google Scholar] [CrossRef] [Green Version]
  25. Fu, B.; Xu, X.; Wei, H. Why tocilizumab could be an effective treatment for severe COVID-19? J. Transl. Med. 2020, 18, 164. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Pascutti, M.F.; Erkelens, M.N.; Nolte, M.A. Impact of viral infections on hematopoiesis: From beneficial to detrimental effects on bone marrow output. Front. Immunol. 2016, 7, 364. [Google Scholar] [CrossRef] [Green Version]
  27. Yang, M.; Ng, M.H.; Li, C.K. Thrombocytopenia in patients with severe acute respiratory syndrome (review). Hematology 2005, 10, 101–105. [Google Scholar] [CrossRef] [Green Version]
  28. Zini, G.; Bellesi, S.; Ramundo, F.; D’Onofrio, G. Morphological anomalies of circulating blood cells in COVID-19. Am. J. Hematol. 2020, 95, 870–872. [Google Scholar] [CrossRef] [Green Version]
  29. Zuo, Y.; Yalavarthi, S.; Shi, H.; Gockman, K.; Zuo, M.; Madison, J.A.; Blair, C.N.; Weber, A.; Barnes, B.J.; Egeblad, M.; et al. Neutrophil extracellular traps in COVID-19. JCI Insight 2020, 5, e138999. [Google Scholar] [CrossRef] [Green Version]
  30. Del Papa, N.; Sambataro, G.; Minniti, A.; Pignataro, F.; Caporali, R. Novel COronaVIrus Disease 2019 (COVID-19) epidemic: What are the risks for systemic sclerosis patients? Autoimmun. Rev. 2020, 19, 102558. [Google Scholar] [CrossRef]
  31. Jain, S.; Self, W.H.; Wunderink, R.G.; Fakhran, S.; Balk, R.; Bramley, A.M.; Reed, C.; Grijalva, C.G.; Anderson, E.J.; Courtney, D.M.; et al. Community-acquired Pneumonia requiring Hospitalization among U.S. adults. N. Eng. J. Med. 2015, 373, 415–427. [Google Scholar] [CrossRef] [Green Version]
  32. Skipper, C.; Pastick, K.A.; Engen, N.W.; Bangdiwala, A.S.; Abassi, M.; Lofgren, S.M.; Williams, D.A.; Okafor, E.C.; Pullen, M.F.; Nicol, M.R.; et al. Hydroxychloroquine in Nonhospitalized Adults With Early COVID-19: A Randomized Trial. Ann. Intern. Med. 2020. [Google Scholar] [CrossRef]
  33. Mei, X.; Lee, H.C.; Diao, K.Y.; Huang, M.; Lin, B.; Liu, C.; Xie, Z.; Ma, Y.; Robson, P.M.; Chung, M.; et al. Artificial Intelligence-enabled rapid diagnosis of patients with COVID-19. Nat. Med. 2020, 26, 1224–1228. [Google Scholar] [CrossRef] [PubMed]
  34. Woloshin, S.; Patel, N.; Kesselheim, A.S. False Negative Tests for SARS-CoV-2 Infection- Challenges and Implications. N. Eng. J. Med. 2020, 383, e38. [Google Scholar] [CrossRef] [PubMed]
  35. Giuffrè, M.; Macor, D.; Masutti, F.; Abazia, C.; Tinè, F.; Bedogni, G.; Tiribelli, C.; Crocè, L.S. Spleen Stiffness Probability Index (SSPI): A simple and accurate method to detect esophageal varices in patients with compensated liver cirrhosis. Ann. Hepatol. 2020, 19, 53–61. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Univariate models probability plot. The vertical axis shows the probability of being SARS-CoV-2 positive according to each model. The horizontal axis shows the values of blood leukocytes (i.e., WBC, NEUT, LYM, and MON) and platelets, which are reported as leukocytes//platelets. Given the different amplitude of leukocytes and platelets blood concentration, their respective units of measure, as reported in the figure, should be multiplied by a factor of 103 (e.g., 1.5 leukocytes × 103/mm3 are equivalent to 1500 cells/mm3 and 60 platelets × 103/µL are equivalent to 60,000 cells/µL). WBC: white blood cell; NEUT: neutrophils; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Figure 1. Univariate models probability plot. The vertical axis shows the probability of being SARS-CoV-2 positive according to each model. The horizontal axis shows the values of blood leukocytes (i.e., WBC, NEUT, LYM, and MON) and platelets, which are reported as leukocytes//platelets. Given the different amplitude of leukocytes and platelets blood concentration, their respective units of measure, as reported in the figure, should be multiplied by a factor of 103 (e.g., 1.5 leukocytes × 103/mm3 are equivalent to 1500 cells/mm3 and 60 platelets × 103/µL are equivalent to 60,000 cells/µL). WBC: white blood cell; NEUT: neutrophils; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Diagnostics 10 00619 g001
Figure 2. Multivariate model performance in training and validation cohorts. (A) The training cohort on the vertical axis represents the probability of being SARS-CoV-2 positive according to the Model for possible Early COvid-19 Recognition (MECOR) Score (horizontal axis). Logistic regression coefficients of probability are represented with robust 95% confidence intervals (light red area); (B) the validation cohort on the vertical axis represents the probability of being SARS-CoV-2 positive according to the MECOR Score (horizontal axis). Logistic regression coefficients of probability are represented with robust 95% confidence intervals (light blue area).
Figure 2. Multivariate model performance in training and validation cohorts. (A) The training cohort on the vertical axis represents the probability of being SARS-CoV-2 positive according to the Model for possible Early COvid-19 Recognition (MECOR) Score (horizontal axis). Logistic regression coefficients of probability are represented with robust 95% confidence intervals (light red area); (B) the validation cohort on the vertical axis represents the probability of being SARS-CoV-2 positive according to the MECOR Score (horizontal axis). Logistic regression coefficients of probability are represented with robust 95% confidence intervals (light blue area).
Diagnostics 10 00619 g002
Figure 3. Discriminative ability of the MECOR Score in the training cohort (red line) and in the internal validation cohort (blue line).
Figure 3. Discriminative ability of the MECOR Score in the training cohort (red line) and in the internal validation cohort (blue line).
Diagnostics 10 00619 g003
Table 1. Demographics and laboratory characteristics among patients in the training and validation cohort. As auspicated, there was no statistically significant difference between the two cohorts.
Table 1. Demographics and laboratory characteristics among patients in the training and validation cohort. As auspicated, there was no statistically significant difference between the two cohorts.
Training Cohortn
n = 525
Validation Cohortn
n = 250
Significance
Gender, Male (n, %)331 (63%)164 (65.6%)NS
Age (years), Median (IQR)64 (52–77)63 (53–77)NS
SARS-CoV-2 Positive Individuals, (n, %)283 (53.9%)135 (54%)NS
CAP Pathogen NE
 Nonidentified138 (57.1%)69 (60%)
Streptococcus. pneumoniae35 (14.5%)15 (13%)
Klebsiella pneumoniae20 (8.3%)8 (7%)
Mycoplasma pneumoniae14 (5.8%)6 (5.2%)
 Influenza12 (5%)7 (6%)
Mycobaterium tuberculosis6 (2.5%)3 (2.6%)
Legionella. pneumophila5 (2%)2 (1.7%)
 Metapneumovirus3 (1.2%)1 (0.9%)
Chlamydia spp.2 (0.82%)1 (0.9%)
Haemophiluls influenzae2 (0.82%)1 (0.9%)
Staphilococcus aureus2 (0.82%)1 (0.9%)
Pseudomonas aeruginosa2 (0.82%)1 (0.9%)
 Adenovirus1 (0.41%)0 (0%)
WBC (cells/mm3), Median (IQR)7900 (5400–12,080)7800 (5300–11,800)NS
NEUT (cells/mm3), Median (IQR)6000 (3720–9520)5910 (3600–9630)NS
LYM (cells/mm3), Median (IQR)970 (640–1470)1010 (630–1495)NS
MON (cells/mm3), Median (IQR)510 (340–840)530 (350–830)NS
EOS (cells/mm3), Median (IQR)0 (0–50)0 (0–60)NS
PLT (cells/µL), Median (IQR)221,000 (159,000–295,000)210,000 (156,000–294,000)NS
CAP: Community-Acquired Pneumonia; IQR: interquartile range; WBC: white blood cell; NEUT: neutrophils; NS: not significant; NE: not evaluated; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Table 2. Intracohort differences in demographics and laboratory characteristics.
Table 2. Intracohort differences in demographics and laboratory characteristics.
Training Cohort
SARS-CoV-2
Negative
n = 242
SARS-CoV-2
Positive
n = 283
Significance
Gender, Male (n, %)154 (63.6%)177 (62.5%)NS
Age (years), Median (IQR)66 (50–79)68 (57–77)NS
WBC (cells/mm3), Median (IQR)11,465 (8205–15,475)5930 (4305–80,100)p < 0.001
Patients with WBC < 4000 (cells/mm3), (n, %)7 (2.9%)60 (21.2%)p < 0.001
NEUT (cells/mm3), Median (IQR)8925 (5985–12,675)4300 (2980–6415)p < 0.001
Patients with NEUT < 1500 (cells/mm3), (n, %)5 (2.1%)9 (3.2%)NS
LYM (cells/mm3), Median (IQR)1185 (820–1768)830 (505–1200)p < 0.001
Patients with LYM < 1000 (cells/mm3), (n, %)92 (38%)178 (62.9%)p < 0.001
MON (cells/mm3), Median (IQR)755 (450–1048)430 (300–600)p < 0.001
Patients with MON < 200 (cells/mm3), (n, %)11 (4.5%)18 (6.4%)NS
EOS (cells/mm3), Median (IQR)20 (0–98)0 (0–10)p < 0.001
Patients with EOS < 50 (cells/mm3), (n, %)151 (62.4%)237 (83.7%)p < 0.001
PLT (cells/µL), Median (IQR)251,000 (191,000–330,000)186,000 (144,500–258,000)p < 0.001
Patients with PLT < 150,000 (cells/µL), (n, %)33 (13.6%)77 (27.2%)p = 0.001
Validation Cohort
SARS-Co-2V
Negative
n = 115
SARS-CoV-2
Positive
n = 135
Significance
Gender, Male (n, %)74 (64.3%)90 (66.6%)NS
Age (years), Median (IQR)67 (55–77)70 (54–78)NS
WBC (cells/mm3), Median (IQR)11,480 (8545–15,595)5800 (4345–7600)p < 0.001
Patients with WBC < 4000 (cells/mm3), (n, %)2 (1.7%)28 (20.7%)p < 0.001
NEUT (cells/mm3), Median (IQR)9190 (6325–12,865)4180 (2995–5900)p < 0.001
Patients with NEUT < 1500 (cells/mm3), (n, %)3 (2.6%)5 (3.7%)NS
LYM (cells/mm3), Median (IQR)1190 (780–1810)880 (505–1200)p < 0.001
Patients with LYM < 1000 (cells/mm3), (n, %)44 (38.3%)78 (57.7%)p = 0.002
MON (cells/mm3), Median (IQR)770 (420–110)430 (305–600)p < 0.001
Patients with MON < 200 (cells/mm3), (n, %)9 (7.8%)9 (6.6%)NS
EOS (cells/mm3), Median (IQR)30 (0–100)0 (0–20)p < 0.001
Patients with EOS < 50 (cells/mm3), (n, %)67 (58.2%)108 (80%)p = 0.001
PLT (cells/µL), Median (IQR)238,000 (184,500–317,000)181,000 (144,000–251,000)p < 0.001
Patients with PLT < 150,000 (cells/µL), (n, %)18 (15.6)37 (27.4%)p = 0.025
IQR: interquartile range; NS: not significant; WBC: white blood cell; NEUT: neutrophils; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Table 3. Univariate Analysis. Intracohort statistically significant values were studied univariately.
Table 3. Univariate Analysis. Intracohort statistically significant values were studied univariately.
Univariate Analysis
Training Set
(M1)
WBC
(M2)
NEUT
(M3)
LYM
(M4)
MON
(M5)
EOS
(M6)
PLT
Intercept (β0)3.042.281.251.570.481.59
Intercept (β0)—Standard Error0.280.230.190.190.10.24
Intercept (β0)—Significancep < 0.001p < 0.001p < 0.001p < 0.001p < 0.001p < 0.001
Coefficient (β1)−3.24 × 10−4−3.04 × 10−4−9.65 × 10−4−2.18 × 10−3−8 × 10−3−6 × 10−6
Coefficient (β1)—Standard Error3.1 × 10−53.1 × 10−51.53 × 10−42.9 × 10−42 × 10−39.48 × 10−7
Coefficient (β1)—Significancep < 0.001p < 0.001p < 0.001p < 0.001p < 0.001p < 0.001
AUROC0.82 (0.78–0.87)0.80 (0.76–0.83)0.68 (0.64–0.73)0.72 (0.67–0.76)0.71 (0.66–0.75)0.67 (0.66–0.75)
Nagelkerke Pseudo-R20.4100.3500.1400.1900.0110.120
Hosmer–Lemeshow p-Value0.0320.1780.7820.090<0.0010.450
AIC538572668649684679
BIC546580677657692689
WBC: white blood cell; NEUT: neutrophils; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Table 4. Multivariate Model Information. The multivariate model was built employing those variables that univariately showed an AUROC > 0.65 and a Hosmer–Lemeshow p-Value > 0.05. Variables were transformed employing natural logarithmic and arctangent functions. Globally, the model was shown to be more balanced in its discrimination and calibration metrics if compared to each of the univariate models.
Table 4. Multivariate Model Information. The multivariate model was built employing those variables that univariately showed an AUROC > 0.65 and a Hosmer–Lemeshow p-Value > 0.05. Variables were transformed employing natural logarithmic and arctangent functions. Globally, the model was shown to be more balanced in its discrimination and calibration metrics if compared to each of the univariate models.
Multivariate ModelVariable 1
log e ( WBC )
Variable 2
log e ( LYM )
Variable 3
arctan ( MON ×   NEUT PLT )
VIF1.721.051.80
Coefficient−3.23−0.7611.94
Coefficient—Standard Error0.340.183.88
Coefficient—Significancep < 0.001p = 0.001p = 0.002
Intercept18.47
Intercept—Standard Error3.92
Intercept—Significancep < 0.001
AUROC0.86 (0.83; 0.90)
Nagelkerke Pseudo-R20.5
Hosmer-Lemeshow p-Value0.9
AIC516
BIC533
WBC: white blood cell; NEUT: neutrophils; LYM: lymphocytes; MON: monocytes; EOS: eosinophils; PLT: platelets.
Table 5. Cut-off Selection. Cut-off values were chosen in the training cohort in order to maximize either sensitivity or specificity or according to the Youden’s Index criteria. The same cut-off values were applied to the validation cohorts and showed comparable performance.
Table 5. Cut-off Selection. Cut-off values were chosen in the training cohort in order to maximize either sensitivity or specificity or according to the Youden’s Index criteria. The same cut-off values were applied to the validation cohorts and showed comparable performance.
Cut-Off ParameterMaximize Sensitivity ≤ −2.54Maximize Specificity ≥ +4Youden’s Index ≥ −0.13
TrainingValidationTrainingValidationTrainingValidation
Sensitivity100 (99–100)%100 (92–100)%2 (0.5–5)%2 (0.5–7)%84 (78–88)%88 (81–93)%
Specificity10 (6–15)%12 (7–20)%100 (99–100)%100 (99–100)%72 (67–77)%73 (64–81)%
PPV56 (55–57)%58 (55–59)%100%100%78 (74–81)%79 (74–84)%
NPV100%100 %47 (46–48)%47 (45–48)%79 (73–83)%84 (76–90)%
+LR1.11 (1.06–1.16)1.14 (1.06–1.22)002.92 (2.38–3.59)3.27 (2.41–4.45)
−LR000.98 (0.97–1)0.98 (0.95–1)0.23 (0.18–0.31)0.16 (0.10–0.26)
Accuracy59 (54–63)%60 (60–66)%47 (42–52)%47 (40–54)%80 (76–84)%81 (76–86)%
PPV: positive predictive value; NPV: negative predictive value; +LR: positive likelihood ratio; −LR: negative likelihood ratio.

Share and Cite

MDPI and ACS Style

Sambataro, G.; Giuffrè, M.; Sambataro, D.; Palermo, A.; Vignigni, G.; Cesareo, R.; Crimi, N.; Torrisi, S.E.; Vancheri, C.; Malatino, L.; et al. The Model for Early COvid-19 Recognition (MECOR) Score: A Proof-of-Concept for a Simple and Low-Cost Tool to Recognize a Possible Viral Etiology in Community-Acquired Pneumonia Patients during COVID-19 Outbreak. Diagnostics 2020, 10, 619. https://doi.org/10.3390/diagnostics10090619

AMA Style

Sambataro G, Giuffrè M, Sambataro D, Palermo A, Vignigni G, Cesareo R, Crimi N, Torrisi SE, Vancheri C, Malatino L, et al. The Model for Early COvid-19 Recognition (MECOR) Score: A Proof-of-Concept for a Simple and Low-Cost Tool to Recognize a Possible Viral Etiology in Community-Acquired Pneumonia Patients during COVID-19 Outbreak. Diagnostics. 2020; 10(9):619. https://doi.org/10.3390/diagnostics10090619

Chicago/Turabian Style

Sambataro, Gianluca, Mauro Giuffrè, Domenico Sambataro, Andrea Palermo, Giovanna Vignigni, Roberto Cesareo, Nunzio Crimi, Sebastiano Emanuele Torrisi, Carlo Vancheri, Lorenzo Malatino, and et al. 2020. "The Model for Early COvid-19 Recognition (MECOR) Score: A Proof-of-Concept for a Simple and Low-Cost Tool to Recognize a Possible Viral Etiology in Community-Acquired Pneumonia Patients during COVID-19 Outbreak" Diagnostics 10, no. 9: 619. https://doi.org/10.3390/diagnostics10090619

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop