- Original Article
- Open access
- Published:
Emergency teleradiological activity is an epidemiological estimator and predictor of the covid-19 pandemic in mainland France
Insights into Imaging volume 12, Article number: 103 (2021)
Abstract
Background
COVID-19 pandemic highlighted the need for real-time monitoring of diseases evolution to rapidly adapt restrictive measures. This prospective multicentric study aimed at investigating radiological markers of COVID-19-related emergency activity as global estimators of pandemic evolution in France. We incorporated two sources of data from March to November 2020: an open-source epidemiological dataset, collecting daily hospitalisations, intensive care unit admissions, hospital deaths and discharges, and a teleradiology dataset corresponding to the weekly number of CT-scans performed in 65 emergency centres and interpreted remotely. CT-scans specifically requested for COVID-19 suspicion were monitored. Teleradiological and epidemiological time series were aligned. Their relationships were estimated through a cross-correlation function, and their extremes and breakpoints were compared. Dynamic linear models were trained to forecast the weekly hospitalisations based on teleradiological activity predictors.
Results
A total of 100,018 CT-scans were included over 36 weeks, and 19,133 (19%) performed within the COVID-19 workflow. Concomitantly, 227,677 hospitalisations were reported. Teleradiological and epidemiological time series were almost perfectly superimposed (cross-correlation coefficients at lag 0: 0.90–0.92). Maximal number of COVID-19 CT-scans was reached the week of 2020-03-23 (1 086 CT-scans), 1 week before the highest hospitalisations (23,542 patients). The best valid forecasting model combined the number of COVID-19 CT-scans and the number of hospitalisations during the prior two weeks and provided the lowest mean absolute percentage (5.09%, testing period: 2020-11-02 to 2020-11-29).
Conclusion
Monitoring COVID-19 CT-scan activity in emergencies accurately and instantly predicts hospitalisations and helps adjust medical resources, paving the way for complementary public health indicators.
Key points
-
Teleradiological activity in emergency centres is correlated with the number of hospitalisations due to COVID-19 at a nationwide scale in mainland France.
-
Monitoring teleradiological activity in emergency centres could improve the detection of COVID-19 resurgence.
-
Teleradiological indicators could help forecasting the evolution of the pandemic.
Background
Coronavirus disease 2019 (COVID-19) has rapidly spread worldwide since its identification in China in December 2019, putting populations, health services and economies under high pressure. To adapt restrictive social and economic measures, governments and national public health agencies require reliable markers to instantly monitor the pandemic.
In France, this mission was assigned to Santé Publique France (SPF), which collects daily data from various sources, such as numbers of teleconsultations, laboratory tests, hospitalisations, visits in emergency services, intensive care unit (ICU) admissions, deaths at home or hospital and cases in nursing homes [1].
Retrieving these data from each sub-territory for aggregation at the national level requires considerable resources because of the lack of interoperability and homogenisation of information and technology frameworks in healthcare systems [2, 3].
Among these indicators, the incidence of hospitalisations is particularly scrutinised, as it is closely followed by the incidence of ICU admissions and deaths. Decisions to put countries under lockdown were mostly guided by these figures to avoid overwhelming health services and having to choose which patients to treat.
Teleradiology is a recent human and technological solution that uses homogeneous and interoperable information and technology tools to remotely interpret medical images coming from various healthcare centres. Our structure is dedicated to emergency imaging with a network of partner emergency centres distributed across mainland France. Images are centralised in three interpretation centres where teams of radiologists use the same tools to interpret images and report findings to emergency physicians. Moreover, resource organisation and structured processes, particularly chest CT, provide high diagnostic accuracy with strong inter-observer agreement between on-call teleradiologists with varying degrees of experience and senior radiologists [4]. Indeed, thanks to our structured organisation, we already showed that teleradiology enabled us to monitor the impact of the COVID-19 pandemic management on emergency activities, showing a global decrease in the population's use of care during the first lockdown in France [5]. As we observed similarities between the teleradiology emergency time series and the hospital time series published by SPF, the purpose of this study was to investigate whether structured emergency teleradiology activity could help public health agencies monitor COVID-19 pandemic on a nationwide scale [6].
Methods
Study design and epidemiological data
This prospective multicentric observational study was approved by the French radiological ethics review board (N° CRM-2012-120). The flow chart is displayed in Fig. 1. All teleradiology patients gave written informed consent for the reuse of anonymised data.
The epidemiological dataset was retrieved from data.gouv.fr, an open-source platform storing public datasets promoted by the French government [7]. We used the ‘hospital dataset’, which contains the daily incidences of ICU admissions and standard hospitalisations, deaths in hospital and discharges to home per territorial area. We excluded French overseas departments. We computed the weekly number of hospitalisations, ICU admissions and deaths from Monday to Sunday and indexed this number on the first day of the week. Since the dataset began on Thursday 2020-03-19, we windowed the study from the following Monday (2020-03-23) to the last Sunday of November (2020-11-29).
Emergency teleradiological data collection
Our teleradiology structure is dedicated to emergency imaging (radiographs, CT-scans and MRI), 24 h a day, 7 days a week, with its main activity during weekends and on-call duty periods (6 pm to 8.30 am). During the study period, 52–65 emergency partner centres distributed across mainland France performed CT-scans that were reviewed by teams of teleradiologists gathered in 3 teleradiology centres in Bordeaux, Lyon and Marseille. Through our dedicated Radiological Information System (ITIS, DeepLink Medical, Lyon, France), a COVID-19 workflow has been implemented since 2020-03-09 that combines a standardised CT request form for requesting physicians, standardised acquisition protocols, structured CT reports and systematic review by a senior radiologist. Regarding the CT-scan acquisitions, chest CT examinations were performed by using 16- or 64-detector row CT scanners with a standardised non-contrast enhanced COVID-19 chest CT protocol for all partner hospitals. The slice thickness ranged from 1 to 1.25 for the lung kernel, and from 2 to 2.5 mm for the mediastinal kernel. If pulmonary embolism was suspected, CT pulmonary angiographic protocol with bolus tracking intravenous iodine contrast agent administration at a rate of 3–4 mL/s was used instead.
The inclusion criteria for the teleradiological cohort were: request for a chest CT-scan in the COVID-19 workflow because of suspicion, diagnosis or clinical aggravation by an emergency physician; achievement of this chest CT-scan and availability of the report. None of the examination were scheduled and/or performed for late stage of the disease or post-COVID-19 symptoms. All requests had to follow the guidelines from the French National High Authority for Health (‘Haute Autorité de Santé”) [8].
This process enabled us to prospectively collect the weekly number of CT-scans performed for COVID-19 suspicion, diagnosis or clinical aggravation and to calculate the percentage of activity of this workflow (defined as this number divided by the total number of CT-scans and MRIs reported the same week in our structure). As of 2020-07-06, the number of CT-scans with conclusions stating compatibility with/strongly suggestive of COVID-19 diagnosis (in agreement with the French Society of Radiology standardised report) was prospectively collected [9]. Thus, the percentage of chest CT-scans with compatible/strongly suggestive findings among the chest CT-scans performed in the COVID-19 workflow was calculated for each week following 2020-07-06.
Statistical analyses
Statistical analyses were performed from 2020-03-23 to 2020-11-29 with R (version 3.5.3, R Foundation for Statistical Computing). A p value < 0.05 was deemed significant.
Correlations between time series
The cross-correlation function (CCF) was used to identify linear relationships between lagged values of the teleradiological time series and the weekly number of hospitalisations [10]. For each k lag between two time series x(t) and y(t) composed of n observations with SDx(t) and SDy(t) as their standard deviations, respectively, the following coefficient was calculated:
A significant correlation was retained if it was above or below \(- \frac{1}{n} \pm 2/\sqrt n\).
Extreme values and structural changes
We reported the minimal and maximal values of each variable and the corresponding weeks when these values were reached. The breakpoints function (“strucchange” package) was applied to investigate structural changes and breaks during the inter-wave period that could have helped identify a 2nd wave primer [11]. This function uses a dynamic programming algorithm and identifies the optimal number of breakpoints in a time series (considered piecewise linear models) that minimises the residual sum of squares as well as the number of parameters in the model.
Forecasting. The dataset was divided into one training set (from 2020-03-23 to 2020-11-02) and one validation set (from 2020-11-03 to 2020-11-29). By using the auto.arima function (“forecast” package), we developed dynamic regression models to predict the number of hospitalisations in a given week (H(t)) in the training set depending on the following possible predictors: number of CT-scans performed the same week (CT(t)), one week before (CT(t − 1)), and two weeks before (CT(t − 2)); number of hospitalisations one week before (H(t − 1)), and two weeks before ((H(t − 2)); and occurrence of national lockdown (Ld(t)) [12, 13]. In dynamic regressions, a time series y(t) is expressed as a linear function of k predictor time series plus an error term (η(t)) that may contain auto-correlation with its prior values (η(t − 1), η(t − 2), …etc.) and is assumed to follow an auto-regressive integrated moving average (ARIMA) model with the p and q parameters corresponding to the order of the auto-regressive part and the order of the moving average part, respectively, as follows [14]:
where xk are the predictors, βk are their coefficients, β0 is the intercept, ε is white noise (following a Gaussian law), and φ and θ are the key parameters of the auto-regressive part and moving average part of the model, respectively. Herein, no integrated part was needed. We evaluated the quality of the fitted models with the corrected Akaike information criterion (AICC), which penalises models that incorporate large numbers of predictors. We verified the validity of the models using the Ljung–Box Q test, which assesses whether the residuals of the model behave like a white noise series [15]. Models with a p value < 0.05 were considered to have a lack of fit. Finally, the performance of the models in the training and testing sets was evaluated with the mean average percentage (MAPE), which is a measure of prediction accuracy for forecast models, defined as:
where N is the number of observations and \(\widehat{{H\left( t \right)}}\) is the fitted value of the number of hospitalisations during week t. The smallest value of the MAPE in the test set indicated the best model [13, 16].
Results
Visualisation of the epidemiological (nationwide data) and teleradiological time series (teleradiological data)
At the national level, our teleradiological dataset was composed of 100,018 CT-scans performed during the 36 weeks of the study period. Among those, 19,133 (19.1%) were carried out in the COVID-19 workflow. Table 1 shows how these examinations were distributed across the 10 mainland regions and the 65 partner emergency centres. The epidemiological datasets included 227,677 hospitalisations, 35,970 ICU admissions and 35,993 deaths in hospital. Figure 2 depicts and aligns the epidemiological and teleradiological time series, highlighting a similar shape for all of them, with two spikes corresponding to the first and the second French waves (in March–April and October–November 2020, respectively) separated by an inter-wave period centred on July 2020.
Correlations between epidemiological and teleradiological time series
To assess correlations between the number of hospitalisations and the teleradiological time series on the same week and during prior and past weeks, we applied the CCF. Figure 3 and Table 2 show significant correlations (1) between the weekly number of hospitalisations and the weekly number of CT-scans performed in the COVID-19 workflow from 4 weeks before to 3 weeks after (range of cross-correlation coefficients: 0.42–0.93, the highest being found at lag 0, i.e. the same week) and (2) between the weekly number of hospitalisations and the percentage of activity of the COVID-19 workflow from 5 weeks before to 2 weeks after (range of cross-correlation coefficients: 0.37–0.9, the maximum being also found at lag 0). The coefficients obtained from lag − 2 to lag + 3 were slightly higher with the absolute number of CT-scans than with the percentage of activity. Correlations at higher lags (approximately 15 weeks) corresponded to the similarity between the first and second waves. Details regarding correlations at lag 0 are given in Additional file 1: Data 1.
Identification of primers of the second wave
Table 3 displays the maximal values of each time series during each wave. Regarding the first wave, the maximal number of CT-scans in the COVID-19 workflow and the maximum percentage of activity were reached during the week of 2020-03-23 (1086 CT-scans, 53.1% [1086/2047] activity percentage), while the maximal number of hospitalisations was reached one week later (23,542 patients). Regarding the second wave, the maximal number of hospitalisations, CT-scans and percentage of activity in the COVID-19 workflow were obtained in the week of 2020-11-02 (19,735 patients, 1202 CT-scans and 35.8% [1202/3362], respectively). The maximal percentage of CT-scans compatible with or strongly suggestive of COVID-19 was achieved one week later (74.4%, [702/943]). The ratio between the maximums of the first wave and second wave was higher with the percentage of activity than with the absolute number of CT-scans (0.90 [1086/1202] vs. 1.48 [53.1/35.8]).
Figure 4 shows the significant breakpoints and structural changes in the number of hospitalisations, CT-scans performed in the COVID-19 workflow and percentage of COVID-19–compatible/strongly suggestive CT-scans from the complete end of the restrictive measures of the first wave to the end of the study. In the three time series, a first plateau could be seen in the second half of August (Fig. 4a–c), which translated to a spike in the differenced time series (Fig. 4d–e). The corresponding breakpoints were identified in the week of 2020-08-24 with the percentage of positive CT-scans in the COVID-19 workflow, 2020-08-31 with the number of CT-scans in the COVID-19 workflow and 2020-09-07 with the number of hospitalisations. The second breakpoints were all identified on the same week, i.e. 2020-10-12.
Forecasting number of hospitalisations with teleradiological data
The model that passed the Ljung–Box test with the lowest AICC and lowest MAPE in the test set was based on CT(t − 1), CT(t − 2), H(t − 1) and H(t − 2) (p = 0.1182, AICC = 509.2 and MAPEtest = 5.1) (Table 4). Table 4 also presents the performance of models that were based only on CT(t), CT(t − 1) and CT(t − 2), highlighting large errors when considering only the number of CT-scans in the COVID-19 workflow two weeks before to predict the number of hospitalisations in a given week (MAPEtest = 127.1), while the other models showed similar intermediate performance (MAPEtest = 20 and 20.7, respectively).
The details related to the fitting and performance of the models based on the different combinations of explanatory variables to predict H(t) are given in Additional file 1: Data 2. Figure 5 shows the superimposition of the fitting and forecasting of the best model, as well as the models based on the number of CT-scans in the COVID-19 workflow alone.
Time series relationships at the regional scale
We focused on four French areas (Nouvelle-Aquitaine [southwest], Hauts-de-France and Grand-Est [northeast], Provence-Alpes-Côte d’Azur [southeast] and Auvergne-Rhône-Alpes [central east]) to investigate whether emergency teleradiology indicators could also be used to help monitor the pandemic at the regional level (Fig. 6). The extremes and their corresponding dates for both waves, as well as the low values in the inter-wave period and the intermediate plateau at the end of summer, were superimposed in the four cases.
Discussion
This nationwide multicentric prospective study shows that real-time prospective and structured radiological data, possible in our teleradiology structure dedicated to emergency centres, can provide relevant real-time predictive markers of the evolution of COVID-19 pandemic on a national scale. Indeed, our results, gathered since the beginning of the outbreak in France, highlight the strong correlations between the number of hospitalisations per week and the number of CT-scans related to COVID-19 performed in our partner hospitals, especially in the two preceding weeks. These complementary early predictive markers could be used by public health agencies to instantly confirm tendencies or outbreak resurgence or even as new predictors in forecasting models. Furthermore, our findings could translate to smaller geographical levels and help monitor the pandemic over mainland territories.
Despite the growing interest in imaging data integration into population health management [17], the value of nationwide imaging data to monitor and predict the evolution of COVID-19 pandemic through time series analysis has never been demonstrated. Imaging is frequently the gateway to patients’ diagnosis and treatment, and such an approach makes sense. Unfortunately, this approach has been undermined by several factors: heterogeneous practices, lack of compatibility of information and technology tools, time, or free exchange platforms for medical specialists. The rare time series analyses involving imaging mostly depicted trends in general or emergency radiological activity and sometimes developed forecasting models [18,19,20]. Conversely, analysis of the radiological activity during COVID-19 pandemic has generally consisted of examining changes compared to usual general or emergency activity, but the predictive value of these changes in terms of public health has been poorly investigated, with cohorts of fewer than 5000 patients [21,22,23].
It should be noted that additional correlations could have been investigated with our cohort, for instance, with the number of ICU admissions, deaths or discharges to home, all provided by data.gouv.fr. However, as the chronological succession from hospitalization to ICU admission to death is well described, we purposely chose to focus on the first interaction between COVID-19 patients and the hospital system, namely conventional hospitalisations. Second, we decided to use the absolute number of CT-scans in the COVID-19 workflow instead of the percentage of activity of this workflow because the superimposition of the teleradiological and epidemiological time series during the second wave was less pronounced than during the first wave. We believe that this result was due to the preservation of non-COVID-19 activity during this period, which probably led to lower cross-correlation coefficients from lag − 2 to lag + 2 with the percentage of activity than the absolute values. Furthermore, the weekly number of COVID-19–compatible or strongly suggestive CT-scans was not prospectively collected before the beginning of the inter-wave period, which is why we noted its potential as a sensitive primer for a second wave but not for the elaboration of forecasting models due to too many missing data. Indeed, it is worth noting that this teleradiological variable underwent a significant structural change two weeks before the number of hospitalisations.
The centralised organisation of our teleradiology structure has favoured the implementation of early standardised COVID-19 practices. This COVID-19 workflow label has enabled our support teams to constantly monitor teleradiology activity since the week of 2020-03-09 (i.e. one week before the open-source publication of COVID-19 numbers by SPF), with the main initial intent to rapidly adjust our medical and material resources in this unprecedented context. Eventually, this teleradiological variable could also be used to (1) adapt emergency staff resources, (2) evaluate and adapt lockdown measures at national or regional scales, (3) organise inter-town/state patient transfers and (4) reduce global morbidity and mortality.
For example, our statistics were transmitted weekly to the Regional Health Agencies of Auvergne-Rhône-Alpes and Nouvelle Aquitaine upon their request.
Our study has limitations. First, although more than 100,018 CT-scans performed in our partner hospitals were screened for this study, the regional distribution of activity was not homogeneous, leading to marked noise in some regions in the sub-analysis. In addition, the distribution of activity was not perfectly superimposed with COVID-19 spread in France. For instance, our structure has only three emergency partners in the Ile de France (or Parisian) region, though it was the most seriously impacted (70,217 hospitalisations versus 361 CT-scans performed in the COVID-19 workflow among a total of 2184 CT-scans [16.5%]). Second, we did not include overseas departments because the dynamics of the outbreak did not follow the same curve as in mainland due to geographical isolation. Third, other forecasting algorithms, accuracy measurements and non-radiological predictors (based on meteorological, governmental, behavioural or social data, for example) could improve the model’s performance. However, our demonstration used open-source epidemiological data and a robust and classical algorithm with distinct training and validation sets. Fourth, we did not prospectively collect for which precise reason a CT-scan was required in the emergency services (for instance, initial diagnosis, assessment of the disease extent or worsening in patients already diagnosed as COVID-19 positive). Though all the CT-scans performed for these reasons led to an increase in the global emergency radiological activity due to COVID-19, deepening our assessment with complementary variables (such as: numbers of CT-scans performed for initial diagnosis, for assessment of the disease extent in COVID-19 positive patients and for clinical worsening in COVID-19 positive patients) could have provided more powerful estimators. However, it would have required additional work from the emergency physicians and possible difficulties to choose between the three options.
Fifth, although in general patients come only once at the emergency service for less than 48 h before either returning home or being hospitalised in other departments, we cannot exclude that some patients had more than one chest CT-scan in the COVID-19 workflow. Due to the anonymisation of the full cohort, we were not able to compute the exact number of patients with multiple scans. However, based on another study from our group in which 5 out 938 CT-scans (≈ 0.5%) were performed in a same patient during their visit to the emergency for COVID-19, we could estimate, by extrapolating this ratio, that ≈ 100 patients had two CT-scans in our teleradiological dataset [24]. Consequently, comparing this number with the total number of CT-scans (i.e. 100,018) and the total number of CT-scans in the COVID-19 workflow (i.e. 19,133), we do not believe that it could have significantly biased our findings. Sixth, as previously explained, we chose not to use the number of chest CT-scan with a positive report (i.e. with findings strongly suggestive/compatible with the COVID-19 diagnosis) in the forecasting models because these data were only prospectively collected since the French inter-wave period. We would have had to exclude all the observations from the first wave. However, we believe that using the French Society of Radiology scoring system could provide more powerful predictors in future radiological forecasting models—although strongly suggestive/compatible conclusions with COVID-19 diagnosis do not systematically mean positive RT-PCR despite the excellent accuracy of the French Society of Radiology scoring system [4]. Finally, it is important to consider that existing indicators based on hospitalisations should become less accurate with vaccination, necessitating original indicators. Teleradiology variables could be valuable given that (1) emergency imaging will always remain a gateway to patients’ diagnosis and (2) our structured organisation allows real-time analysis of COVID-19 workflow data.
Conclusion
In conclusion, this prospective nationwide study demonstrates that structured radiological networks enable the rapid aggregation of early relevant indicators of COVID-19 pandemic on a national scale. Our results suggest that scrutinising the dynamics of radiological activity in emergencies could provide early and accurate estimation of the number of hospitalisations in the same period at the national level but also predict the short-term evolution of the pandemic. This approach paves the way for original real-time complementary indicators for public health agencies to improve public health models and monitor preventive measures, as well as adjust human resources. Thus, our findings illustrate the potential value of integrating radiological data to support public health management and stress the need for collaborative nationwide and international radiological networks and platforms.
Availability of data and material
Epidemiological dataset is available on Santé Publique France website.
Radiological dataset can be requested to the corresponding author.
Abbreviations
- 95% CI:
-
95% Confidence interval
- AICC:
-
Akaike information criterion corrected
- ARIMA:
-
Auto-regressive integrated moving average
- CCF:
-
Cross-correlation function
- COVID-19:
-
Coronavirus disease 2019
- CT(t):
-
Number of CT-scans performed in the COVID-19 workflow in a given week ‘t’
- H(t):
-
Number of hospitalisations in a given week ‘t’
- ICU:
-
Intensive care unit
- MAPE:
-
Mean absolute percentage error
- SPF:
-
Santé Publique France (French Public Health Agency
References
Santé Publique France (2020) Surveillance épidémiologique du Covid-19. https://www.santepubliquefrance.fr/presse/2020/surveillance-epidemiologique-du-covid-19. Accessed 31 Mar 2020
Shanbehzadeh M, Kazemi-Arpanahi H, Mazhab-Jafari K, Haghiri H (2020) Coronavirus disease 2019 (COVID-19) surveillance system: development of COVID-19 minimum data set and interoperable reporting framework. J Educ Health Promot. https://doi.org/10.4103/jehp.jehp_456_20
Aliabadi A, Sheikhtaheri A, Ansari H (2020) Electronic health record–based disease surveillance systems: a systematic literature review on challenges and solutions. J Am Med Inform Assoc. https://doi.org/10.1093/jamia/ocaa186
Nivet H, Crombé A, Schuster P et al (2020) The accuracy of teleradiologists in diagnosing COVID-19 based on a French multicentric emergency cohort. Eur Radiol. https://doi.org/10.1007/s00330-020-07345-z
Vatele J, Gentile S, Thomson V et al (2021) Teleradiology as a relevant indicator of the impact of COVID-19 pandemic management on Emergency Room activities: a nationwide worrisome survey. Insights Imaging 12(1):30. https://doi.org/10.1186/s13244-021-00964-0
Gorincour G, Crombé A, Seux M, et al (2020) Letter to Editor : How teleradiology can help public health COVID-19 management. Eur Radiol. https://www.european-radiology.org/opinions/how-teleradiology-can-help-public-health-covid-19-management/. Accessed 17 Dec 2020
Santé Publique France Données hospitalières relatives à l’épidémie de COVID-19. data.gouv.fr. https://www.data.gouv.fr/fr/datasets/donnees-hospitalieres-relatives-a-lepidemie-de-covid-19/. Accessed 27 Mar 2020
Guideline for performing chest CT-scan in patients with a COVID-19 diagnosis or suspected of COVID-19. https://www.has-sante.fr/jcms/p_3178626/fr/place-du-scanner-thoracique. Accessed 10 Apr 2020
Société Française de Radiologie (2020) La société d’Imagerie Thoracique propose un compte-rendu structuré de scanner thoracique pour les patients suspects de COVID-19. e-Bulletin. https://ebulletin.radiologie.fr/actualites-covid-19/societe-dimagerie-thoracique-propose-compte-rendu-structure-scanner-thoracique. Accessed 7 Jun 2020
Derrick TR, Thomas JM (2004) Time series analysis: the cross-correlation function. Human Kinetics Publishers, Champaign, pp 189–205
Zeileis A, Leisch F, Homik K, Kleiber C (2002) strucchange: an R package for testing for structural change. J Stat Softw 7:1–38
Hyndman RJ, Khandakar Y (2008) Automatic time series forecasting: the forecast package for R. J Stat Softw 27:22
Athanasopoulos G, Hyndman RJ (2018) Forecasting: principles and practice, 2nd edn. OTexts, Melbourne
Box GEP, Jenkins GM, Reinsel GC, Ljung GM (2015) Time series analysis: forecasting and control, 5th edn. Wiley, Hoboken
Ljung GM, Box GEP (1978) On a measure of lack of fit in time series models. Biometrika 65:297–303. https://doi.org/10.1093/biomet/65.2.297
Flores BE (1986) A pragmatic view of accuracy measurement in forecasting. Omega 14:93–98. https://doi.org/10.1016/0305-0483(86)90013-7
O’Connor M (2020) RSNA 2020: it’s time for radiology to turn its eye toward population health. In: RSNA 2020. https://www.healthimaging.com/topics/conferences/rsna-radiology-population-health. Accessed 30 Nov 2020
Sistrom CL, Dang PA, Weilburg JB, Dreyer KJ, Rosenthal DI, Thrall JH (2009) Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Radiology 251:147–155. https://doi.org/10.1148/radiol.2511081174
Côté MJ, Smith MA (2018) Forecasting the demand for radiology services. Heal Syst 7:79–88. https://doi.org/10.1080/20476965.2017.1390056
Zhang Y, Luo L, Zhang F et al (2020) Emergency patient flow forecasting in the radiology department. Health Inform J. https://doi.org/10.1177/1460458220901889
Parikh KD, Ramaiya NH, Kikano EG et al (2020) COVID-19 pandemic impact on decreased imaging utilization: a single institutional experience. Acad Radiol 27:1204–1213. https://doi.org/10.1016/j.acra.2020.06.024
Parikh KD, Ramaiya NH, Kikano EG et al (2020) Quantifying the decrease in emergency department imaging utilization during the COVID-19 pandemic at a multicenter healthcare system in Ohio. Emerg Radiol 27:765–772. https://doi.org/10.1007/s10140-020-01848-4
Davenport MS, Fruscello T, Chatfield M, Weinstein S, Sensakovic WF, Larson DB (2020) CT volumes from 2,398 radiology practices in the United States: a real-time indicator of the effect of COVID-19 on routine care, January to September 2020. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2020.10.010
Schuster P, Crombé A, Nivet H et al (2021) Practical clinical and radiological models to diagnose COVID-19 based on a multicentric teleradiological emergency chest CT cohort. Sci Rep 11:8994. https://doi.org/10.1038/s41598-021-88053-6
Acknowledgements
We would like to sincerely thank all our partner centres, and the support teams at Imadis Teleradiology and in particular Alexandra Campoy and Tiffany Desmurs.
Funding
The authors state that this work has not received any funding.
Author information
Authors and Affiliations
Contributions
AC participated in conceptualisation, formal analysis, methodology, validation and writing—original draft. JCL participated in formal analysis, validation and writing—review and editing. NB, KT and HN participated in validation, and writing—review and editing. MS participated in data curation, project administration and writing—review and editing. NB, KT and HN participated in conceptualisation, validation, supervision and writing—review and editing. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Institutional Review Board approval was obtained from the French radiological ethics review board (N° CRM-2012-120). All patients gave written informed consent for the reuse of anonymised data.
Consent for publication
Not applicable.
Competing interests
Two authors of this manuscript declare relationships with the following companies: VT and GG have shares in DeepLink Medical. The other authors of this manuscript (AC, JCL, NB, KT, MS and HN) declare no relationships with any companies, whose products or services may be related to the subject matter of the article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Supplementary data.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Crombé, A., Lecomte, JC., Banaste, N. et al. Emergency teleradiological activity is an epidemiological estimator and predictor of the covid-19 pandemic in mainland France. Insights Imaging 12, 103 (2021). https://doi.org/10.1186/s13244-021-01040-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13244-021-01040-3