Next Article in Journal / Special Issue
Computer Assisted Patient Monitoring: Associated Patient, Clinical and ECG Characteristics and Strategy to Minimize False Alarms
Previous Article in Journal / Special Issue
Automated ECG Interpretation—A Brief History from High Expectations to Deepest Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Electrocardiographic Predictors of Mortality: Data from a Primary Care Tele-Electrocardiography Cohort of Brazilian Patients

by
Gabriela M. M. Paixão
1,
Emilly M. Lima
1,
Paulo R. Gomes
1,
Derick M. Oliveira
2,
Manoel H. Ribeiro
3,
Jamil S. Nascimento
1,
Antonio H. Ribeiro
4,
Peter W. Macfarlane
5 and
Antonio L. P. Ribeiro
1,*,†
1
Telehealth Network of Minas Gerais, Hospital das Clínicas and Faculdade de Medicina, Universidade Federal de Minas Gerais, Avenida Professor Alfredo Balena 110, Belo Horizonte 30130-100, Brazil
2
Computer Science Department, Universidade Federal de Minas Gerais, Belo Horizonte 31270-901, Brazil
3
School of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland
4
Department of Information Technology, Uppsala University, 752 37 Uppsala, Sweden
5
Division of Cardiovascular and Medical Sciences, University of Glasgow, Scotland G12 8QQ, UK
*
Author to whom correspondence should be addressed.
Courrent Address: Telehealth Center, Hospital das Clínicas da UFMG Av. Alfredo Balena, 110, Sala 106 Sul, Belo Horizonte 30130-100, Brazil.
Hearts 2021, 2(4), 449-458; https://doi.org/10.3390/hearts2040035
Submission received: 27 August 2021 / Revised: 24 September 2021 / Accepted: 27 September 2021 / Published: 29 September 2021
(This article belongs to the Special Issue The Application of Computer Techniques to ECG Interpretation)

Abstract

:
Computerized electrocardiography (ECG) has been widely used and allows linkage to electronic medical records. The present study describes the development and clinical applications of an electronic cohort derived from a digital ECG database obtained by the Telehealth Network of Minas Gerais, Brazil, for the period 2010–2017, linked to the mortality data from the national information system, the Clinical Outcomes in Digital Electrocardiography (CODE) dataset. From 2,470,424 ECGs, 1,773,689 patients were identified. A total of 1,666,778 (94%) underwent a valid ECG recording for the period 2010 to 2017, with 1,558,421 patients over 16 years old; 40.2% were men, with a mean age of 51.7 [SD 17.6] years. During a mean follow-up of 3.7 years, the mortality rate was 3.3%. ECG abnormalities assessed were: atrial fibrillation (AF), right bundle branch block (RBBB), left bundle branch block (LBBB), atrioventricular block (AVB), and ventricular pre-excitation. Most ECG abnormalities (AF: Hazard ratio [HR] 2.10; 95% CI 2.03–2.17; RBBB: HR 1.32; 95%CI 1.27–1.36; LBBB: HR 1.69; 95% CI 1.62–1.76; first degree AVB: Relative survival [RS]: 0.76; 95% CI0.71–0.81; 2:1 AVB: RS 0.21 95% CI0.09–0.52; and RS 0.36; third degree AVB: 95% CI 0.26–0.49) were predictors of overall mortality, except for ventricular pre-excitation (HR 1.41; 95% CI 0.56–3.57) and Mobitz I AVB (RS 0.65; 95% CI 0.34–1.24). In conclusion, a large ECG database established by a telehealth network can be a useful tool for facilitating new advances in the fields of digital electrocardiography, clinical cardiology and cardiovascular epidemiology.

1. Introduction

Cardiovascular diseases are the main cause of mortality both worldwide and in Brazil, and are responsible for 31.2% of total deaths and a mortality rate standardized by age of 256.0 per 100,000 inhabitants [1]. The electrocardiogram (ECG) is a low-cost, easy-access and non-invasive exam used for cardiovascular assessment, and possesses both diagnostic and prognostic value.
Epidemiological studies using the ECG began in the 1940s with the first cardiovascular cohorts [2]. However, ECG reports were very heterogeneous due to the lack of an established coding system appropriate to epidemiological and population-based studies [3]. The Minnesota Code [4] was created in 1960 to standardize ECG classification and enable comparison between different populations. In the following decades, many papers were published on the use of the ECG in population-based studies, showing the prognostic value of different electrocardiographic abnormalities [5,6,7,8,9,10,11].
Simultaneously, the evolution of computerized ECG and automated interpretation had a great impact on cardiovascular epidemiological studies [12,13]. Systems that are capable of transmitting electrocardiographic tracings over the Internet and software packages that enable automatic analysis and coding of tracings have revolutionized the electrocardiography of population-based studies, enhancing its applications and facilitating the study of large populations [14,15,16,17].
The identification of new electrocardiographic variables as predictors for cardiovascular events is an important objective of research among electronic cohorts, especially when performing ECG for population screening remains controversial [18,19] and the benefit of the traditional ECG markers with cardiovascular risk scores for discrimination and reclassification is questionable [18,20]. The use of new technologies such as artificial intelligence (AI) is a promising tool in this field for the recognition of potential non-traditional electrocardiographic risk factors.
Despite many studies on ECG abnormalities and their prognostic value having been published, their data are usually from cohorts that typically include hundreds or thousands of patients, or even from secondary care or an inpatient setting, resulting in very specific populations. Big data sets with over one million patients are relatively new, especially in the outpatient setting, and can provide more precise estimates of the risk related to each ECG abnormality in the community setting. This information should be useful for physicians in the primary care setting, and may help to support clinical decisions. Thus, the present study aims to describe the development and clinical applications of an electronic cohort, entitled the Clinical Outcomes in Digital Electrocardiography (CODE) study [21]. This cohort is derived from a digital ECG database obtained by the Telehealth Network of Minas Gerais (TNMG), Brazil [22], from 2010 to 2017, and linked to the mortality data from the national information system with more than 1.5 million patients.

2. Methods

2.1. Study Design

This study is based on a retrospective cohort of primary care patients from Minas Gerais, Brazil, whose ECGs were analyzed by the Telehealth Network of Minas Gerais (TNMG) cardiologists between 2010 and 2017. TNMG currently covers 817 of the 853 counties in Minas Gerais and nearly 400 in other Brazilian states. It has already acquired more than five million ECGs since its implementation [23].

2.2. Inclusion Criteria

Patients older than 16 years with 12-lead ECGs performed at TNMG between 2010 and 2017 were included in the study. For the specific analysis of ventricular pre-excitation, all age groups were included.

2.3. Exclusion Criteria

Isoelectric recordings and those with interference, reversal or poor positioning of electrodes, which compromised the analysis, were excluded (6.03%). For the analysis of electrocardiographic changes, patients who underwent more than one ECG had only the first exam analyzed; subsequent recordings were excluded (28.20%).

2.4. Data Collection

ECGs were performed by the local primary care professional using digital electrocardiographs manufactured by Tecnologia Eletrônica Brasileira model ECGPC (São Paulo, Brazil) or Micromed Biotecnologia model ErgoPC 13 (Brasilia, Brazil).
Clinical data (age, sex and comorbidities) were collected using a standardized questionnaire. Clinical conditions included self-reported smoking, hypertension, diabetes, dyslipidemia, Chagas disease, previous myocardial infarction and chronic obstructive pulmonary disease.
Specific software, developed in-house, was able to capture an ECG tracing, upload the ECG and the patient’s clinical history, and then transmit the data to the TNMG analysis center via the internet. The clinical information, ECG tracings and reports were stored in a specific database. All data managed and transferred followed the national law for security and protection of the database. For the purpose of the present study, the Glasgow 12-lead ECG analysis program (license 28.4.1, approved for use on 16 June 2009) was used to automatically interpret all ECGs available in the database, exporting the diagnosis as interpreted by both Glasgow and Minnesota codes.

2.5. Data Analysis

Major Electrocardiographic Abnormalities

The major electrocardiographic abnormalities included were atrial fibrillation (AF), right bundle branch block (RBBB), left bundle branch block (LBBB), first, second and third degree atrioventricular blocks (AVB) and ventricular pre-excitation [24].
ECGs were analyzed by a team of fourteen trained cardiologists using standardized criteria [24]. Each ECG was interpreted by only one cardiologist.
The ECG report was recorded as an unstructured free text. To recognize ECG abnormalities among these million reports, a computational linguistics program was used. First, the cardiologist’s text was preprocessed by removing “stop-words” (such as: the, is, at, which and on) and generating n-grams, defined as a contiguous sequence of n items from a given sample of text or speech. Then, we used a self-supervised learning classification model based on artificial intelligence, using a recurrent neural network as a classifier [25,26], which was built with a 2800-sample dictionary manually created by specialists based on text from real diagnoses. The final report with the ECG abnormalities was obtained by imputing the classifier results for recognition of each ECG abnormality. The classification model was tested on 4557 medical reports manually labeled by two cardiologists with 80.7% positive predictive value, 94.3% sensitivity and 87.0% F1 score for AF; 86.1% positive predictive value, 95.4% sensitivity and 90.9% F1 score for RBBB; 91.4% positive predictive value, 86.0% sensitivity and 88.6% F1 score for LBBB; 75.6% positive predictive value, 93.5% sensitivity and 83.6% F1 score for AVB, and 96.7% positive predictive value, 96.7% sensitivity and 96.7% F1 score for ventricular pre-excitation [27]. F1 score is a measure of the model’s accuracy and it is calculated from the positive predictive value and the sensitivity of the test.
The diagnosis of electrocardiographic abnormalities was accepted, without manual review, when there was agreement in the cardiologist’s report with one of the automatic systems (Minnesota or Glasgow). The ECGs in which the abnormality was reported by the cardiologist only or by the two automatic systems were manually reviewed by trained staff (Figure 1). For LBBB and RBBB, 17,903 ECGs were revised, while for AVB 9038, AF 4343 and ventricular pre-excitation 1090 tracings were amended. This represents 1.3% of the total number processed, or 2.4 million ECGs.

2.6. Outcomes

The primary end point was all-cause mortality. All International Classification of Diseases (ICD) codes were considered for all-cause mortality. The secondary end point was cardiovascular mortality, defined by nine groups of cardiovascular disease through ICD coding: rheumatic heart disease (I01–I01.9, I02.0, I05–I09.9), ischemic heart disease (I20–I25.9), cerebrovascular disease (G45–G46.8, I60–I61.9, I62.0, I63–I63.9, I65–I66.9, I67.0–I67.3, I67.5–I67.6, I68.1–I68.2, I69.0–I69.3), hypertensive heart disease (I11), myocarditis (A39.52, B33.2–B33.24, D86.85, I40–I43.9, I51.4–I51.5), atrial fibrillation or flutter (I48), aortic aneurysm (I71), peripheral artery disease (I70.2–I70.7, I73–I73.9) and endocarditis (A39.51, I33–I33.9, I38–I39.9). The secondary outcome was evaluated only for AF, LBBB and RBBB diagnoses.

2.7. Probabilistic Linkage

The electronic cohort was obtained linking data from the ECG exams (name, sex, date of birth, city of residence) and those from the national mortality information system, using standard probabilistic linkage methods (FRIL: Fine-grained record linkage software, v.2.1.5, Atlanta, GA, USA) [21,28].

2.8. Statistical Analysis

Qualitative variables were described by frequency distribution. Data obtained from continuous quantitative variables were expressed as mean and standard deviation or median with interquartile range.
For the analysis of the electrocardiographic abnormalities, the time elapsed between the date of the electrocardiogram (index event) and the event of interest (date of death) was considered a dependent variable. The presence of the electrocardiographic abnormality was an independent variable, along with the clinical characteristics of the population. The comparison group was patients without major electrocardiographic changes, which included both those with a normal ECG and those with all other abnormalities. Patients who did not present with an event of interest by the end of follow-up were censored, but were included in our analysis with follow-up time until the study’s end date (September 2017).
The non-parametric Kaplan–Meier method was used to calculate survival. The level of statistical significance was defined for p values less than 0.05, calculated by the Log rank test. The Cox proportional regression multivariate model was used for all analyses, except for AVB, in which we used the Log-normal model, since the assumptions of the Cox model could not be achieved. Hazard ratio (HR) with 95% confidence interval was used for the ECG abnormalities analysis, except for the AVB survival analysis, in which relative survival risk (RS) was used. RS under 1 means lower survival rate, while RS over 1 means higher survival rate. Analyses were adjusted for age, sex and comorbidities. The R statistical program (version 3.4.3, Vienna, Austria) was used for all analyses.

3. Results

3.1. CODE Cohort

From 2,470,424 ECGs, 1,773,689 patients were identified. A total of 1,666,778 (94%) underwent a valid ECG recording from 2010 to 2017, with 1,558,421 patients over 16 years old. Most patients were women (60.8%), and mean age was 51.6 (SD ±17.6) years. The overall mortality rate was 3.31% in a mean follow-up of 3.7 years. The clinical conditions of all adult patients and the prevalence of the studied abnormalities are described in Table 1.

3.2. Survival Analysis: ECG Abnormalities

All ECG abnormalities, with the exception of ventricular pre-excitation and second degree AVB Mobitz I, were associated with higher mortality for all causes. Patients with AF and LBBB were also at higher risk of cardiovascular mortality (Table 2, Figure 2).

4. Discussion

The resulting dataset has several potential applications, both for technical and clinical-epidemiological studies. Previous studies from our group showed that ECG abnormalities that are considered important, such as pre-excitation syndrome, have no prognostic impact in a community setting. On the other hand, the risk of dying for a person with RBBB is almost as high as with LBBB, the latter being considered a much stronger marker of risk in general cardiology practice [28,29,30]. Patients with AF were at a higher risk of mortality compared to the other abnormalities. First degree AVB was a more severe ECG abnormality than Mobitz I, which had a benign prognosis in this population. A 2:1 AVB in the 12-lead ECG was associated with 79% reduction of relative survival, probably indicating an infranodal block.
According to the World Health Organization, primary health care is an integral part of a country’s health system, with a main focus on the social and economic development of the community [31]. Its essence is to treat people, not specific diseases and conditions. Actions related to health promotion and both primary and secondary prevention of cardiovascular diseases are necessary to improve collective health. In this context, the search for new features that are capable of predicting individual cardiovascular risk and, therefore, stimulating development of cost-effective preventive actions, is a matter of great importance.
Several tests, such as coronary calcium score, carotid and vertebral echodoppler, and serum measurement of ultrasensitive C-reactive protein have already been recommended for re-stratification of cardiovascular risk [32], although their cost-effectiveness is questionable [32], especially in the context of public health. On the other hand, an inexpensive and widely available exam, such as the ECG, could diagnose abnormalities such as AF, RBBB, LBBB and AVB that imply a higher risk for mortality regardless of age, sex or previous comorbidities.
Stratification of cardiovascular risk by ECG could be a potentially useful tool for clinical practice, especially in primary health care. Identifying the patient who will benefit most from tighter control of blood pressure, diabetes, and cholesterol levels may prevent cardiac events in the future. Electrocardiographic abnormalities draw attention to the potential severity of the patient’s condition and the importance of more intensive treatment. In addition, they may help to rationalize and prioritize referrals to secondary or tertiary referral centers.
Electronic cohorts with a large amount of data are powerful sources for the development of population based studies, and, therefore, provide more strong evidence to be used in healthcare. Information on ECG parameters or abnormalities from big data sets [33] may have a major impact by distinguishing between benign and potentially life-threatening cardiac conditions. Each population has specific features, such as social, racial and lifestyle characteristics, that have an impact in their health [34]. Chagas disease, for example, is prevalent in Brazil and is associated with major ECG abnormalities [35], while it is very rare in United States and Europe.
AI in healthcare is the future pathway to managing big data from electronic cohorts. The development of machine learning (ML) models for disease prediction and diagnosis is in a state of exponential growth. In electrocardiography, AI algorithms have been extensively studied for both the automatic diagnosis of electrocardiographic alterations [36] as well as for the prediction of cardiovascular events and identification of new cardiovascular risk factors [37]. Estimation of age and sex by electrocardiographic tracing alone has also been demonstrated [38]. Furthermore, the isolated analysis of the 12-lead ECG can predict mortality within one year with good accuracy, even in tracings reported as normal [39]. AI can extract information from the electrocardiogram that is undervalued and/or unrecognized by conventional methods of analysis, adding diagnostic and prognostic value.
The CODE study is now also working with ML techniques. We found good performance of a deep neural network in the recognition of six ECG abnormalities [36]. In the field of prognosis and health promotion, the concept of an electrocardiographic age via AI, compared with the patient’s biological age, is promising [40]. This new promising cardiac biomarker can summarize the individual electrocardiographic characteristics simply and intuitively. It has the potential to provide patients with accessible and understandable information about their cardiovascular risk. More of our results will soon be available and should highlight the importance of ECG epidemiological studies with both traditional and AI methods.
Our study has limitations. Data on comorbidities were self-reported, and thus might have been under-reported. The clinical data came from a predetermined questionnaire not tailored for this study. Therefore, some important variables with impacts on the cardiovascular prognosis, such as heart failure, were unavailable and not considered as comorbidities in the multivariate analysis. The AI classifier used for ECG report classification had good accuracy, sensitivity and positive predictive value, but can make errors. In order to minimize this problem, we included the automatic classification of Glasgow and Minnesota in the diagnostic algorithm. Furthermore, manual revision was done in more than 30,000 ECGs to confirm the presence of the ECG abnormality. The quality of the data from the national mortality information system varies according to region within the state of Minas Gerais; therefore, the information from the national mortality system is heterogeneous among the regions of Minas Gerais such that misclassification of the basic cause of death can occur. The probabilistic linkage also has some issues, such as less than perfect sensitivity and the possibility of false pairs. We defined a high cut off point (94 of 100) for true pairs and made manual revisions in doubtful cases.

5. Conclusions

Electrocardiographic markers are predictors of mortality in the TNMG population. AF, LBBB, RBBB and AVB are associated with a higher risk of death from all causes, regardless of age, sex and associated comorbidities. AF and LBBB are independent predictors of higher cardiovascular mortality. Ventricular pre-excitation and Mobitz I second-degree AVB are not associated with higher overall mortality. An electronic cohort with a large amount of ECG data can be a useful prognostic tool and provide a stimulus for future developments in the fields of digital electrocardiography, clinical cardiology and cardiovascular epidemiology.

Author Contributions

Conceptualization, G.M.M.P. and A.L.P.R.; methodology, E.M.L., G.M.M.P. and A.L.P.R.; software, A.H.R., D.M.O., M.H.R., P.R.G.; validation, G.M.M.P., P.R.G., J.S.N.; formal analysis, E.M.L.; resources, A.L.P.R.; data curation, P.R.G.; writing—original draft preparation, G.M.M.P.; writing—review and editing, G.M.M.P., P.W.M. and A.L.P.R.; visualization, P.W.M. and A.L.P.R.; supervision, A.L.P.R.; project administration, A.L.P.R.; funding acquisition, A.L.P.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study complied with all relevant ethical regulations. The CODE Study was approved by the Research Ethics Committee of the Universidade Federal de Minas Gerais, protocol 49368496317.7.0000.5149. Since this is a secondary analysis of anonymized data stored in the TNMG, informed consent was not required by the Research Ethics Committee for the present study. All researchers who deal with datasets signed terms of confidentiality and data utilization.

Informed Consent Statement

Not applicable.

Data Availability Statement

Researchers affiliated with educational or research institutions can make requests to access the datasets. Requests should be made to the corresponding author of this paper. They will be forwarded and considered on an individual basis by the Telehealth Network of Minas Gerais. The estimated time needed for data access requests to be evaluated is three months. If approved, any data use will be restricted to non-commercial research purposes. The data will only be made available on the execution of appropriate data use agreements.

Acknowledgments

This research was partly supported by the Brazilian Agencies CNPq, CAPES, and FAPEMIG, and also by project IATS. A.H.R. and A.L.P.R. are recipients of unrestricted research scholarships from CNPq; E.M.L. and A.H.R. received scholarships from CAPES and CNPq; and D.M.O., M.H.R. and A.L.P.R. received a Google Latin America Research Award scholarship.

Conflicts of Interest

None of the authors has financial or non-financial competing interests.

References

  1. Brant, L.C.C.; Nascimento, B.R.; Passos, V.M.A.; Duncan, B.B.; Bensenõr, I.J.M.; Malta, D.C.; Souza, M.F.M.; Ishitani, L.H.; França, E.; Oliveira, M.S.; et al. Variações e diferenciais da mortalidade por doença cardiovascular no Brasil e em seus estados, em 1990 e 2015: Estimativas do Estudo Carga Global de Doença. Rev. Bras. Epidemiol. 2017, 20 (Suppl. 1), 116–128. [Google Scholar] [CrossRef] [Green Version]
  2. Dawber, T.R.; Kannel, W.B.; Love, D.E.; Streeper, R.B. The electrocardiogram in heart disease detection; a comparison of the multiple and single lead procedures. Circulation 1952, 5, 559–566. [Google Scholar] [CrossRef] [Green Version]
  3. Blackburn, H.; Keys, A.; Simonson, E.; Rautaharju, P.; Punsar, S. The electrocardiogram in population studies. A classification system. Circulation 1960, 5, 559–566. [Google Scholar]
  4. Marty, A.T. Minnesota Code Manual of Electrocardiographic Findings. Crit. Care Med. 1983, 11, 583. [Google Scholar] [CrossRef]
  5. Blackburn, H.; Taylor, H.L.; Keys, A. Coronary heart disease in seven countries. XVI. The electrocardiogram in prediction of five-year coronary heart disease incidence among men aged forty through fifty-nine. Circulation 1970, 41 (Suppl. 4), 154–161. [Google Scholar] [CrossRef] [PubMed]
  6. Kannel, W.B.; Gordon, T.; Castelli, W.P.; Margolis, J.R. Electrocardiographic left ventricular hypertrophy and risk of coronary heart disease. The Framingham study. Ann. Intern. Med. 1970, 72, 813–822. [Google Scholar] [CrossRef] [PubMed]
  7. Pooling Project ResearchGroup. Relationship of blood pressure, serum cholesterol, smoking habit, relative weight and ECG abnormalities to incidence of major coronary events: Final report of the pooling project. J. Chronic Dis. 1978, 31, 201–306. [Google Scholar] [CrossRef]
  8. Zhang, Z.M.; Prineas, R.J.; Soliman, E.Z.; Baggett, C.; Heiss, G. Prognostic significance of serial Q/ST-T changes by the Minnesota Code and Novacode in the Atherosclerosis Risk in Communities [ARIC] study. Eur. J. Prev. Cardiol. 2012, 19, 1430–1436. [Google Scholar] [CrossRef] [Green Version]
  9. Zhang, Z.; Prineas, R.J.; Eaton, C.B. Evaluation and Comparison of the Minnesota Code and Novacode for Electrocardiographic Q-ST Wave Abnormalities for the Independent Prediction of Incident Coronary Heart Disease and Total Mortality [from the Women’s Health Initiative]. Am. J. Cardiol. 2010, 106, 18–25. [Google Scholar] [CrossRef]
  10. Machado, D.B.; Crow, R.S.; Boland, L.L.; Hannan, P.J.; Taylor, H.A.; Folsom, A.R. Electrocardiographic Findings and Incident Coronary Heart Disease Among Participants in the Atherosclerosis Risk in Communities [ARIC] Study. Am. J. Cardiol. 2006, 97, 1176–1181. [Google Scholar] [CrossRef]
  11. Greenland, P.; Xie, X.; Liu, K.; Colangelo, L.; Liao, Y.; Daviglus, M.L.; Agulnek, A.N.; Stamler, J. Impact of minor electrocardiographic ST-segment and/or T-wave abnormalities on cardiovascular mortality during long-term follow-up. Am. J. Cardiol. 2003, 91, 1068–1074. [Google Scholar] [CrossRef]
  12. Savage, D.D.; Rautaharju, P.M.; Bailey, J.J.; Horton, M.R.; Hadden, W.; Lacroix, A.Z.; Haynes, S.G.; Wolf, H.K.; Prineas, R.J. The emerging prominence of computer electrocardiography in large population-based surveys. J. Electrocardiol. 1987, 20, 48–52. [Google Scholar]
  13. Ribeiro, A.L.; da Cunha Pereira, S.V.; Bergmann, K.; Ladeira, R.M.; Oliveira, R.A.M.; Lotufo, P.A.; Mill, J.G.; Barreto, S.M. Challenges to implementation of the ECG reading center in ELSA-Brazil. Rev. Saude Publica 2013, 47 (Suppl. 2), 87–94. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Van der Ende, M.Y.; Siland, J.E.; Snieder, H.; Van der Harst, P.; Rienstra, M. Population-based values and abnormalities of the electrocardiogram in the general Dutch population: The LifeLines Cohort Study. Clin. Cardiol. 2017, 40, 865–872. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Palhares, D.M.F.; Marcolino, M.S.; Santos, T.M.M.; da Silva, J.L.P.; Gomes, P.R.; Ribeiro, L.B.; Macfarlane, P.W.; Ribeiro, A.L.P. Normal limits of the electrocardiogram derived from a large database of Brazilian primary care patients. BMC Cardiovasc. Disord. 2017, 17, 152. [Google Scholar] [CrossRef] [PubMed]
  16. Goldman, A.; Hod, H.; Chetrit, A.; Dankner, R. Incidental abnormal ECG findings and long-term cardiovascular morbidity and all-cause mortality: A population based prospective study. Int. J. Cardiol. 2019, 295, 36–41. [Google Scholar] [CrossRef]
  17. Strauss, D.G.; Mewton, N.; Verrier, R.L.; Nearing, B.D.; Marchlinski, F.E.; Killian, T.; Moxley, J.; Tereshchenko, L.G.; Wu, K.C.; Winslow, R.; et al. Screening entire health system ecg databases to identify patients at increased risk of death. Circ. Arrhythmia Electrophysiol. 2013, 6, 1156–1162. [Google Scholar] [CrossRef] [Green Version]
  18. Curry, S.J.; Krist, A.H.; Owens, D.K.; Barry, M.J.; Caughey, A.B.; Davidson, K.W.; Doubeni, C.A.; Epling, J.W., Jr.; Kemper, A.R.; Kubik, M.; et al. Screening for cardiovascular disease risk with electrocardiography us preventive services task force recommendation statement. JAMA J. Am. Med. Assoc. 2018, 319, 2308–2314. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Goff, D.C., Jr.; Lloyd-Jones, D.M.; Bennett, G.; Coady, S.; D’Agostino, R.B.; Gibbons, R.; Greenland, P.; Lackland, D.T.; Levy, D.; O’Donnell, C.J.; et al. American College of Cardiology/American Heart Association Task Force on Practice Guidelines. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014, 129 (Suppl. 2), 49–73. [Google Scholar] [CrossRef] [Green Version]
  20. Shah, A.J.; Vaccarino, V.; Janssens, A.C.J.W.; Flanders, W.D.; Kundu, S.; Veledar, E.; Wilson, P.W.F.; Soliman, E.Z. An electrocardiogram-based risk equation for incident cardiovascular disease from the National Health and Nutrition Examination Survey. JAMA Cardiol. 2016, 1, 779–786. [Google Scholar] [CrossRef] [Green Version]
  21. Ribeiro, A.L.P.; Paixão, G.M.M.; Gomes, P.R.; Ribeiro, M.H.; Ribeiro, A.H.; Canazart, J.A.; Oliveira, D.M.; Ferreira, M.P.; Lima, E.M.; Moraes, J.L.; et al. Tele-electrocardiography and bigdata: The CODE (Clinical Outcomes in Digital Electrocardiography) study. J. Electrocardiol. 2019, 57, 75–78. [Google Scholar] [CrossRef] [PubMed]
  22. Alkmim, M.B.; Figueira, R.M.; Marcolino, M.S.; Cardoso, C.D.; Abreu, M.P.; Cunha, L.; Cunha, D.F.; Antunes, A.P.; Resende, A.G.A.; Resende, E.S.; et al. Improving patient access to specialized health care: The Telehealth Network of Minas Gerais, Brazil. Bull. World Health Organ. 2012, 90, 373–378. [Google Scholar] [CrossRef] [PubMed]
  23. Alkmim, M.B.; Silva, C.B.G.; Figueira, R.M.; Santos, D.V.V.; Ribeiro, L.B.; Da Paixão, M.C.; Marcolino, M.S.; Paiva, J.C.; Ribeiro, A.L.P. Brazilian national service of telediagnosis in electrocardiography. Stud. Health Technol. Inform. 2019, 264, 1635–1636. [Google Scholar] [CrossRef] [PubMed]
  24. Kligfield, P.; Gettes, L.S.; Bailey, J.J.; Childers, R.; Deal, B.J.; Hancock, E.W.; van Herpen, G.; Kors, J.A.; Macfarlane, P.W.; Mirvis, D.M.; et al. Recommendations for the Standardization and Interpretation of the Electrocardiogram. Circulation 2007, 115, 1306–1324. [Google Scholar] [CrossRef] [Green Version]
  25. Hochreiter, S.; Schmidhuber, J. Long Short-term Memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
  26. Mikolov, T.; Karafiát, M.; Burget, L.; Cernocký, J.; Khudanpur, S. Recurrent neural network based language model. In Proceedings of the 11th Annual Conference of the International Speech Communication Association, Interspeech, Chiba, Japan, 26–30 September 2010; Volume 2, pp. 1045–1048. [Google Scholar]
  27. Pedrosa, J.A.O.; Oliveira, D.; Meira, W., Jr.; Ribeiro, A. Automated classification of cardiology diagnoses based on textual medical reports. In Proceedings of the Symposium On Knowledge Discovery, Mining And Learning (Kdmile), Porto Alegre, Brazil, 20 October 2020; Volume 8, pp. 185–192. [Google Scholar] [CrossRef]
  28. Paixão, G.M.M.; Silva, L.G.S.; Gomes, P.R.; Lima, E.M.; Ferreira, M.P.F.; Oliveira, D.M.; Ribeiro, M.H.; Ribeiro, A.H.; Nascimento, J.N.; Canazart, J.A.; et al. Evaluation of Mortality in Atrial Fibrillation: Clinical Outcomes in Digital Electrocardiography [CODE] Study. Glob. Heart 2020, 15, 48. [Google Scholar] [CrossRef]
  29. Paixão, G.M.M.; Lima, E.M.; Gomes, P.R.; Ferreira, M.P.F.; Oliveira, D.M.; Ribeiro, M.H.; Ribeiro, A.H.; Nascimento, J.N.; Canazart, J.A.; Ribeiro, L.B.; et al. Evaluation of mortality in bundle branch block patients from an electronic cohort: Clinical Outcomes in Digital Electrocardiography [CODE] study. J. Electrocardiol. 2019, 57, 56–60. [Google Scholar] [CrossRef]
  30. Paixão, G.M.M.; Lima, E.M.; Batista, L.M.; Santos, L.F.; Araujo, S.L.O.; Araujo, R.M.; Oliveira, D.M.; Nascimento, J.N.; Gomes, P.R.; Ribeiro, A.L.P. Ventricular pre-excitation in primary care patients: Evaluation of the risk of mortality. J. Cardiovasc. Electrophysiol. 2021, 32, 1290–1295. [Google Scholar] [CrossRef]
  31. Faquim, J.P.S.; Guerra, L.D.S.; Carnut, L.; Zilbovicius, C. Atenção Primária à Saúde. J. Manag. Prim. Health Care 2021, 12, 1–7. [Google Scholar] [CrossRef]
  32. Lin, J.S.; Evans, C.V.; Johnson, E.; Redmond, N.; Coppola, E.L.; Smith, N. Nontraditional risk factors in cardiovascular disease risk assessment: Updated evidence report and systematic review for the US preventive services task force. JAMA J. Am. Med. Assoc. 2018, 320, 281–297. [Google Scholar] [CrossRef] [Green Version]
  33. Chen, M.; Mao, S.; Liu, Y. Big data: A survey. Mob. Netw. Appl. 2014, 19, 171–209. [Google Scholar] [CrossRef]
  34. Ferreira, J.P.; Rossignol, P.; Dewan, P.; Lamiral, Z.; White, W.B.; Pitt, B.; Mc Murray, J.J.V.; Zannad, F. Income level and inequality as complement to geographical differences in cardiovascular trials. Am. Heart J. 2019, 218, 66–74. [Google Scholar] [CrossRef] [PubMed]
  35. Marcolino, M.S.; Palhares, D.M.; Ferreira, L.R.; Ribeiro, A.L. Electrocardiogram and Chagas Disease A Large Population Database of Primary Care Patients. Glob. Heart 2015, 10, 167–172. [Google Scholar] [CrossRef] [PubMed]
  36. Ribeiro, A.H.; Ribeiro, M.H.; Paixão, G.M.M.; Oliveira, D.M.; Gomes, P.R.; Canazart, J.A.; Ferreira, M.P.S.; Andersson, C.R.; Macfarlane, P.W.; Meira, W., Jr. Automatic diagnosis of the 12-lead ECG using a deep neural network. Nat. Commun. 2020, 11, 1760. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Attia, Z.I.; Noseworthy, P.A.; Lopez-Jimenez, F.; Asirvatham, S.J.; Deshmukh, A.J.; Gersh, B.J.; Carter, R.E.; Yao, X.; Rabinstein, A.A.; Erickson, B.J.; et al. An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: A retrospective analysis of outcome prediction. Lancet 2019, 394, 861–867. [Google Scholar] [CrossRef]
  38. Attia, Z.I.; Friedman, P.A.; Noseworthy, P.A.; Lopez-Jimenez, F.; Ladewig, D.J.; Satam, G.; Pellikka, P.A.; Munger, T.M.; Asirvatham, S.J.; Scott, C.G.; et al. Age and Sex Estimation Using Artificial Intelligence From Standard 12-Lead ECGs. Circ. Arrhythm Electrophysiol. 2019, 12, e007284. [Google Scholar] [CrossRef]
  39. Raghunath, S.; Ulloa Cerna, A.E.; Jing, L.; Van Maanen, D.P.; Stough, J.; Hartzel, D.N.; Nemani, A.; Carbonati, T.; Johnson, K.W.; Young, K.; et al. Prediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network. Nat. Med. 2020, 26, 886–891. [Google Scholar] [CrossRef]
  40. Lima, E.M.; Ribeiro, A.H.; Paixão, G.M.M.; Ribeiro, M.H.; Pinto-Filho, M.M.; Gomes, P.R.; Oliveira, D.M.; Sabino, E.C.; Duncan, B.B.; Giatti, L.; et al. Deep neural network-estimated electrocardiographic age as a mortality predictor. Nat. Commun. 2021, 12, 5117. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Diagram for ECG abnormality diagnosis. Concordance between the cardiologist’s report and one of the automatic systems (Glasgow or Minnesota) was required for a diagnosis to be accepted without manual revision.
Figure 1. Diagram for ECG abnormality diagnosis. Concordance between the cardiologist’s report and one of the automatic systems (Glasgow or Minnesota) was required for a diagnosis to be accepted without manual revision.
Hearts 02 00035 g001
Figure 2. Kaplan–Meier curves for overall mortality.
Figure 2. Kaplan–Meier curves for overall mortality.
Hearts 02 00035 g002
Table 1. Prevalence of comorbidities and ECG abnormalities from a total of 1,558,421 patients.
Table 1. Prevalence of comorbidities and ECG abnormalities from a total of 1,558,421 patients.
N%
Comorbidities
Hypertension492,63731.611
Diabetes101,4706.511
Current smoking108,8146.982
Dyslipidemia60,5903.888
Chagas disease34,5902.220
Myocardial infarction11,6040.745
COPD11,2660.723
ECG abnormalities
Atrial fibrillation20,7821.334
Left bundle branch block20,2261.298
Right bundle branch block37,0312.376
Ventricular pre-excitation *10900.065
First degree AVB20,6441.325
Second degree AVB Mobitz I2120.014
Second degree AVB 2:1610.004
Third degree AVB6210.040
COPD: chronic obstructive pulmonary disease; AVB: atrioventricular block; * 1,666,778 patients were included in the ventricular pre-excitation analysis.
Table 2. Prognostic value of ECG abnormalities, adjusted for age, sex and clinical conditions *.
Table 2. Prognostic value of ECG abnormalities, adjusted for age, sex and clinical conditions *.
ECG AbnormalitiesSurvival Analysis EstimateOverall Mortality
95% CI
p-ValueCardiovascular Mortality
[HR; 95% CI]
p-Value
Atrial fibrillationHR2.10 [2.03–2.17]<0.0012.06 [1.86–2.29]<0.001
Left bundle branch blockHR1.69 [1.62–1.76]<0.0011.76 [1.55–2.01]<0.001
Right bundle branch blockHR1.32 [1.27–1.36]<0.0011.12 [0.99–1.28]0.06
Ventricular pre-excitationHR1.41 [0.56–3.57]0.470NA
First degree AVBRS0.76 [0.71–0.81]<0.001NA
Second degree AVB Mobitz IRS0.65 [0.34–1.24]0.269NA
Second degree AVB 2:1RS0.21 [0.09–0.52]0.005NA
Third degree AVBRS0.36 [0.26–0.49]<0.001NA
HR: Hazard ratio; RS: relative survival; AVB: atrioventricular block; NA: not available; * age, sex, hypertension, diabetes, current smoking, dyslipidemia, Chagas disease, myocardial infarction and chronic obstructive pulmonary disease.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Paixão, G.M.M.; Lima, E.M.; Gomes, P.R.; Oliveira, D.M.; Ribeiro, M.H.; Nascimento, J.S.; Ribeiro, A.H.; Macfarlane, P.W.; Ribeiro, A.L.P. Electrocardiographic Predictors of Mortality: Data from a Primary Care Tele-Electrocardiography Cohort of Brazilian Patients. Hearts 2021, 2, 449-458. https://doi.org/10.3390/hearts2040035

AMA Style

Paixão GMM, Lima EM, Gomes PR, Oliveira DM, Ribeiro MH, Nascimento JS, Ribeiro AH, Macfarlane PW, Ribeiro ALP. Electrocardiographic Predictors of Mortality: Data from a Primary Care Tele-Electrocardiography Cohort of Brazilian Patients. Hearts. 2021; 2(4):449-458. https://doi.org/10.3390/hearts2040035

Chicago/Turabian Style

Paixão, Gabriela M. M., Emilly M. Lima, Paulo R. Gomes, Derick M. Oliveira, Manoel H. Ribeiro, Jamil S. Nascimento, Antonio H. Ribeiro, Peter W. Macfarlane, and Antonio L. P. Ribeiro. 2021. "Electrocardiographic Predictors of Mortality: Data from a Primary Care Tele-Electrocardiography Cohort of Brazilian Patients" Hearts 2, no. 4: 449-458. https://doi.org/10.3390/hearts2040035

Article Metrics

Back to TopTop