Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Clinical Prediction Rule for Stratifying Risk of Pulmonary Multidrug-Resistant Tuberculosis

  • Dalila Martínez,

    Affiliation Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima, Perú

  • Gustavo Heudebert,

    Affiliations Division of General Internal Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States of America, Birmingham Veterans Affairs Medical Center, Birmingham, Alabama, United States of America

  • Carlos Seas,

    Affiliation Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima, Perú

  • German Henostroza,

    Affiliation Division of Infectious Diseases, University of Alabama at Birmingham, Birmingham, Alabama, United States of America

  • Martin Rodriguez,

    Affiliation Division of Infectious Diseases, University of Alabama at Birmingham, Birmingham, Alabama, United States of America

  • Carlos Zamudio,

    Affiliation Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima, Perú

  • Robert M. Centor,

    Affiliations Division of General Internal Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States of America, Birmingham Veterans Affairs Medical Center, Birmingham, Alabama, United States of America

  • Cesar Herrera,

    Affiliation Peruvian Tuberculosis Program, Ministry of Health, Lima, Perú

  • Eduardo Gotuzzo,

    Affiliation Institute of Tropical Medicine “Alexander von Humboldt”, Universidad Peruana Cayetano Heredia, Lima, Perú

  • Carlos Estrada

    cestrada@uab.edu

    Affiliations Division of General Internal Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States of America, Birmingham Veterans Affairs Medical Center, Birmingham, Alabama, United States of America

Abstract

Background

Multidrug-resistant tuberculosis (MDR-TB), resistance to at least isoniazid and rifampin, is a worldwide problem.

Objective

To develop a clinical prediction rule to stratify risk for MDR-TB among patients with pulmonary tuberculosis.

Methods

Derivation and internal validation of the rule among adult patients prospectively recruited from 37 health centers (Perú), either a) presenting with a positive acid-fast bacillus smear, or b) had failed therapy or had a relapse within the first 12 months.

Results

Among 964 patients, 82 had MDR-TB (prevalence, 8.5%). Variables included were MDR-TB contact within the family, previous tuberculosis, cavitary radiologic pattern, and abnormal lung exam. The area under the receiver-operating curve (AUROC) was 0.76. Selecting a cut-off score of one or greater resulted in a sensitivity of 72.6%, specificity of 62.8%, likelihood ratio (LR) positive of 1.95, and LR negative of 0.44. Similarly, selecting a cut-off score of two or greater resulted in a sensitivity of 60.8%, specificity of 87.5%, LR positive of 4.85, and LR negative of 0.45. Finally, selecting a cut-off score of three or greater resulted in a sensitivity of 45.1%, specificity of 95.3%, LR positive of 9.56, and LR negative of 0.58.

Conclusion

A simple clinical prediction rule at presentation can stratify risk for MDR-TB. If further validated, the rule could be used for management decisions in resource-limited areas.

Introduction

Multidrug-resistant tuberculosis (MDR-TB), defined as resistance to at least isoniazid and rifampin, is a growing problem [1]. Worldwide, the number of MDR-TB cases reached an estimated 390,000–510,000 in 2008, or 3.6% of all incident TB cases [2]. The global expenditures in diagnosis and treating MDR-TB and extremely drug-resistant tuberculosis (XDR-TB) were estimated at U.S. $700 million for 2009 [3]. The cost of treating a person with MDR-TB is estimated to be 50 to 200 times higher than treating a patient with drug-susceptible TB [2], or $10,000 versus $100 for a susceptible TB case [3].

Culture with drug susceptibility testing (DST) and molecular markers are essential for properly managing drug susceptible and MDR-TB. Unfortunately, such tests are lengthy, costly, and not universally available in resource-limited settings, which bear the major burden of MDR- and XDR-TB. WHO estimates that up to 96% of patients with MDR-TB are not being diagnosed and treated according to international guidelines [4], [5], [6]. Therefore, it is imperative to develop new methodologies for faster and affordable DST, as well as low-cost techniques, for easier identification of patients at risk for MDR-TB.

Clinical prediction rules (CPR) are simple, standardized clinical tools that utilize components of history, physical examination and basic testing to stratify risk, help make a diagnosis, or predict an outcome [7], [8], [9]. In tuberculosis, CPR were developed to focus on infection control decisions [10], [11], [12], the diagnosis of smear-negative pulmonary TB [13], and prognosis [14]. In a recent retrospective study, a CPR was developed to predict the presence of drug-resistant TB in a high HIV prevalent area – Thailand [15]. We developed a clinical prediction rule, with prospectively collected data, to stratify risk for MDR-TB among patients with pulmonary tuberculosis.

Methods

Ethics Statement

The Ethics Committee of Universidad Peruana Cayetano Heredia approved the clinical trial protocol, where all patients provided written informed consent for their information to be stored in the hospital database and used for research. The Ethics Committee of Universidad Peruana Cayetano Heredia and the Institutional Review Board of the University of Alabama at Birmingham approved the use of the existing data for the purposes of this study (patient consent was not obtained again).

Design and Patients

We derive the clinical prediction rule from data collected in a prospective cohort study, from a phase 3 clinical trial to evaluate rapid diagnostic tests for MDR-TB conducted in Lima, Perú from May 2004 to June 2005 [16]; patients were enrolled from 37 health care centers. The health centers are located in poor shantytown areas of Lima (population 7.5 million). Patients were enrolled in the trial if: a) there was a clinical suspicion of pulmonary TB with an initial positive acid-fast bacillus (AFB) smear, or b) had failed therapy or if they had a relapse within the first 12 months; all patients underwent a sputum culture. At the time the trial was conducted, the prevalence of MDR-TB was 5·3% in the area of Lima where it was executed [17].

The data obtained comprises demographic characteristics, risk factors for acquiring MDR-TB, associated conditions, symptoms, physical exam and radiographic findings. The risk factors studied were history of prior TB (failed therapy or relapse within the first 12 months of standard therapy) [18], [19], [20], [21], [22], MDR-TB contact [20], HIV [18], [20], history of imprisonment [21], [22], [23], and health care workers [20], [24]. Physical exam findings were classified as normal or abnormal; for example, for the lung exam, the presence of crackles, decreased breath sounds, or other abnormalities. Study physicians classified chest radiographic findings and supplemented data collection by concurrent medical record review. Susceptibility testing was performed by the indirect proportion method on Lowenstein-Jensen media at the National Institute of Health in Lima; personnel performing the culture were unaware of these clinical or radiological characteristics.

Statistical Analysis

The analytical strategy was as follows: first, we defined the patients to be included in the dataset to derive the CPR. Then, we performed bivariate analyses of all of the candidate variables with culture positive MDR-TB as the main outcome of interest. The third step was building a logistic regression model including the variables identified in the bivariate analyses. Finally, we conducted analyses to determine the discrimination characteristics of the tool and tested its validity and robustness.

Score Derivation

Patients included in the derivation cohort were at least 18 years of age, had an initial suspicion of pulmonary TB with a positive AFB smear, and had culture-proven pulmonary TB.

We performed bivariate analyses using the chi-square test for nominal categories and the t-test for continuous variables to narrow the list of potential predictor variables.

We then performed a forward logistic regression model using candidate variables that had the two following characteristics: first the variable had to be identified in the bivariate analyses at a p level of <0·20; second this variable had to be present in at least 5% of the study sample. Variables with a p level of <0·05 were retained in the final model. Only patients with complete data on all covariates were included in this step.

We calculated the area under the receiver operating curve (AUROC) after computing the predicted probability for each patient using the logistic regression coefficients to assess the discrimination of the model.

The final model was used to derive a simple and clinically applicable risk score. We assigned 1 point to the smallest regression coefficient and serving it as the least common denominator for assigning point values for the score items; then we rounded it up to the next integer as described by Le Gal and colleagues [25]. To avoid negative numbers in the overall score, we added a minimum integer to re-scale the lowest value to zero. We then explored the predictive accuracy of the score by the proportion of patients with pulmonary MDR-TB in each category (prevalence or pretest probability) and calculated the 95% confidence intervals for incremental likelihood ratios [26].

Model Validation

We performed internal validation of the modeling approach and the final model in two ways. First, we tested the predictive ability of the model by determining the goodness-of-fit with the Hosmer-Lemeshow test; a p-value >0·05 suggests a non-significant discrepancy between the observed and predictive events. Second, we bootstrapped the full model 2,000 times and obtained bias-corrected and accelerated (BCa) 95% confidence intervals to assess the stability of the regression coefficients from logistic regression. We decided to utilize bootstrapping as it requires less distributional assumptions and utilizes a larger sample size as compared to other methods (split sample or jackknife). The BCa method adjusts for bias in the bootstrapped sampling distributions [27].

We performed nested logistic regression and computed sequential partial R tests to assess the relative contribution of adding the variables included in the final model. The first partial R test was calculated when all identified clinical variables were included. The second partial R test was calculated after adding the radiological findings. The final R test was calculated after we forced two important social risk factors (prior imprisonment and health care workers). We chose this strategy because the radiological variable was available only in a subset of patients and because prior imprisonment and health care workers have been associated with MDR-TB [21], [22], [23]. Finally, we compared AUROCs for these three models.

We used STATA 10·1 software for all statistical analyses (StataCorp, College Station, TX, USA).

Results

Among 964 patients with proven pulmonary TB, 82 had MDR-TB (prevalence, 8.51%; 95% confidence interval, 6.75%–10.27%). Complete data on all covariates was available for 75·6% (729/964). Table 1 presents the demographic, clinical and radiographic characteristics of the derivation sample.

Score Derivation

In the bivariate analysis, we found an association at p<0·20 between pulmonary MDR-TB and four risk factors, two co-morbidities, five symptoms, seven physical exam findings, and one radiographic pattern (Table 1).

In the logistic regression analysis, variables retained in the full model included prior TB, MDR-TB contact within family, abnormal lung exam, and cavitary pattern in the chest radiographs (adjusted R2 = 21.%, p<0·001). The AUROC was 0.76 (95% CI 0.68 to 0.84).

Table 2 presents the derived risk score. The prevalence of MDR-TB increased by clinical probability category, low (3.2%), intermediate (6.0%), and high (41.8%) (p<0.001), Table 3. Similarly, the likelihood ratios (LR) increased by clinical probability category, (LR 0.4), intermediate (LR 0.8), and high (LR 9.6), Table 3.

thumbnail
Table 2. Multidrug-Resistance Pulmonary Tuberculosis (MDR-TB) Score.

https://doi.org/10.1371/journal.pone.0012082.t002

thumbnail
Table 3. Proportion of Patients Classified by the MDR-TB Score and Likelihood Ratios.

https://doi.org/10.1371/journal.pone.0012082.t003

Selecting a cut-off score of one or greater, resulted in a sensitivity of 72.6%, specificity of 62.8%, LR positive of 1.95, and LR negative of 0.44 (correctly classified 63.5%). Similarly, selecting a cut-off score of two or greater, resulted in a sensitivity of 60.8%, specificity of 87.5%, LR positive of 4.85, and LR negative of 0.45 (correctly classified 85.6%). Finally, selecting a cut-off score of three or greater, resulted in a sensitivity of 45.1%, specificity of 95.3%, LR positive of 9.56, and LR negative of 0.58 (correctly classified 91.8%).

A history of prior TB had a sensitivity of 40.2% and a specificity of 95.8%; a history of MDR-TB contact within family had a sensitivity of 18.3% and a specificity of 91.6%.

Model Validation

We did not observe a significant discrepancy between the observed and predictive number of patients with MDR-TB (p = 0.39), indicating an adequate goodness-of-fit for the full model. The bias-corrected and accelerated (BCa) 95% confidence intervals estimated from bootstrapping are shown in Table 2; the bounds were similar as compared to the 95% confidence intervals from the logistic regression model (data not shown).

The nested logistic regression illustrated the added explanatory power of the covariate blocks. The adjusted R2 for the model with clinical variables (prior TB, MDR-TB contact in family, abnormal lung exam) was 18.8% (p<0·001); the explanatory power increased by the addition of the radiologic cavitary pattern (adjusted R2 = 20.2%, p = 0.02); and finally, the explanatory power did not increase by forcing the two social risk factors, history of imprisonment and health care worker (adjusted R2 = 21.3%, p = 0.15). Among patients with complete data (n = 729), the AUROC for the models with the clinical variables alone (0.75, 95% CI 0.67 to 0.83), the clinical and radiologic pattern (0.76, 95% CI 0.68 to 0.84) and the full model (0.77, 95% CI 0.69 to 0.85) were not statistically different (p = 0.6). Among patients with complete data on the clinical variables (n = 964), the AUROC was 0.72 (95% CI 0.65 to 0.78).

Discussion

Our findings suggest that a simple CPR can stratify the risk for MDR-TB among patients with pulmonary TB in an endemic area. The rule includes and combines four readily available variables: MDR-TB contact within family, history of prior TB, having an abnormal lung exam, and cavitary patterns on the chest radiographs. The strongest clinical predictors were previous history of TB (failed or relapsed after the standard regimen) and MDR-TB contact within family.

Our findings are consistent with other studies describing independent risk factors for MDR-TB. Risk factors that have been associated with MDR-TB include: prior TB [18], [19], [20], [21], [22], known TB contacts [20], age younger than 45 years [18], [21], HIV positivity [18], [20], health-care workers [20], [24], and previous imprisonment [21], [22], [23]. We did not find association with age as our population was predominantly young. Similar to other countries in Latin America, the prevalence of HIV co-infection was low, thus assessing the association with MDR-TB was not possible [28]. Even though we did not find statistical association with health care workers and history of imprisonment; we forced them into the model, because these variables have been associated with resistant TB [18], [19], [20], [21], [22], [23], [24]. However, they did not contribute to improve the goodness of fit in the final model. These results might be explained by the low number of patients with these risk factors into the sample. We found that MDR-TB patients are more likely to have cavitary lesions in accordance with previous studies [29], [30]; perhaps because such patients often have had active TB for longer periods of time and the greater prevalence of cavitation may just reflect the prolonged time with active TB. We can only speculate for the seemingly protective effect of an abnormal lung exam finding for MDR-TB risk. A protective effect for MDR-TB indicates a higher risk for sensitive TB; since patients with cavitary lesions are more likely to have MDR-TB, patients with sensitive TB may have an interstitial radiographic pattern that can elicit crackles in the lung exam (this hypothesis warrants further confirmation).

Other CPR models have been developed to assist the decision for respiratory isolation of patients with suspected TB [10], [11], [12], or in the diagnosis of smear-negative pulmonary TB [13], as well as to predict the clinical course among patients with known TB [14]. Clinical features identified in these studies were weight loss, fever or night sweats, hemoptysis, age >45 years old, productive cough, and upper-lobe infiltrate on chest radiograph or cavities.

We are not aware of any other CPR developed specifically to stratify the risk of MDR-TB among patients with TB in endemic or non-endemic areas. We should note a previous study performed in Thailand [15]. Boonsarngsuk and colleagues found that chest radiograph features, relapse after previous treatment, and prior incomplete treatment were associated with an increased risk for either isoniazid or rifampin resistance; a cut-off score of greater than two had a sensitivity of 58% and a specificity of 68% [15]. However, the study was retrospective, had a small sample size (290 patients), patients were selected base on physicians' judgment, patients were treated in a referral hospital, and included microbiological results from invasive procedures (bronchoalveolar lavage fluid); the prevalence of MDR-TB was 2.4% (7 cases) and HIV was 16%. In our study, selecting a cut-off score of two or greater, resulted in a sensitivity of 60.8% and specificity of 87.5%. We built a new CPR by validating previously identified risk factors for MDR-TB [18], [19], [20], [21], [22], [23], [24] as well as clinical and radiographic findings in MDR-TB patients [29], [30] for inclusion in the model; adjusting them for multiple independent factors single score. Furthermore, we identified the relative weighs of independent factors and combined them in a single score. If further validated, such a rule could be used for testing and treatment decisions.

The present study has several strengths: first, the sample size was large and representative of a highly prevalent area for MDR-TB, where patients were enrolled from 37 health care centers. Second, the data was collected prospectively in an operational setting. Third, the culture and DST were done in a reference laboratory that follows the standard WHO guidelines [4], furthermore the personnel performing the DST was unaware of the patients' clinical or radiographic findings. Finally, we followed recommended methodology to develop a CPR, adjusted for independent factors and performed internal validation. Thus, our study fulfills validity criteria for the development of a CPR.

Our study has some limitations. First, while all patients had chest radiographs, not all films were available for interpretations as it was not requirement for the original clinical trial. However, we do not expect selection bias because the AUROC excluding chest radiographs was 0.72 (n = 964) and 0.74 among patients with complete data (n = 729). Second, our findings may not apply to areas with higher prevalence of HIV/TB co-infection; in our setting, all patients with TB are tested for HIV. Finally, similar to other real-world operational settings, we only included patients with positive AFB smear. As compared to culture media, the sensitivity of AFB smear is <80%; however, routine culture in all patients is neither universally accepted nor a feasible practice in developing countries.

In summary, diagnosing MDR-TB requires the use of techniques that are of limited availability and high expense for developing countries, such as culture in liquid media with DST, or line probe assays [31], [32], [33], [34], [35], [36]. Developing improved and affordable diagnostic tools for MDR-TB represent priority areas in public health research. We have developed a CPR based on easily obtainable clinical findings (prior TB, MDR-TB contact, abnormal lung exam) and one radiological pattern (cavity) in patients with pulmonary TB to stratify the risk of MDR-TB in resource-limited and endemic area such as Perú. If further validated, such a tool may help TB programs examine the costs and benefits implications of sensitivity testing, especially in resource-limited endemic areas. For example, in our sample, in the 60.4% of patients who were deemed at low risk according to the rule, the prevalence of MDR-TB was 3.2%. In the Peruvian Tuberculosis Program such patients do not receive culture and sensitivity testing initially, this 3.2% of patients may continue transmission of MDR-TB. Exploring the costs and benefits implications of testing all patients at low risk is warranted. We are not advocating the immediate use and implementation of such a clinical-prediction rule. Finally, cost-effectiveness studies are needed to evaluate the potential impact of this tool in decisions regarding treatment regimens or infection control measures.

Acknowledgments

Dr. Estrada had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. The opinions expressed in this article are those of the authors alone and do not reflect the views of the Department of Veterans Affairs.

Data sharing: no additional data available.

Previous Presentation: Presented in part at the Southern American Federation for Medical Research meeting, New Orleans, LA, February 25–27, 2010.

Author Contributions

Conceived and designed the experiments: DM GH CS GH RMC CH EG CE. Performed the experiments: DM GH GH CZ RMC EG CE. Analyzed the data: DM GH GH MR RMC CE. Contributed reagents/materials/analysis tools: DM GH CS GH MR CZ RMC CH EG CE. Wrote the paper: DM GH CS GH MR CZ RMC CH EG CE.

References

  1. 1. Wright A, Zignol M, Van Deun A, Falzon D, Gerdes SR, et al. (2009) Epidemiology of antituberculosis drug resistance 2002-07: an updated analysis of the Global Project on Anti-Tuberculosis Drug Resistance Surveillance. Lancet 373: 1861–1873.
  2. 2. WHO (2010) Multidrug and extensively drug-resistant TB (M/XDR-TB): 2010 global report on surveillance and response. World Health Organization.
  3. 3. WHO (2009) Global Tuberculosis control and patient care. A ministerial meeting of high M/XDR-TB burden countries. Beijing, China: pp. 1–3 April 2009.
  4. 4. WHO (2008) Guidelines for the programmatic management of drug-resistant tuberculosis. Emergency update 2008. Geneva: World Health Organization.
  5. 5. Enarson D, Rieder H, Arnadottir T, Trébucq A (2000) Management of tuberculosis: a guide for low income countries. In: IUATLD , editor. International Union against Tuberculosis and Lung Disease. Paris: 5th ed.
  6. 6. WHO (2006) The Stop TB Strategy. Building on and enhancing DOTS to meet the TB-related Millennium Development Goals. Geneva: World Health Organization.
  7. 7. Laupacis A, Sekar N, Stiell IG (1997) Clinical prediction rules. A review and suggested modifications of methodological standards. JAMA 277: 488–494.
  8. 8. Wasson JH, Sox HC, Neff RK, Goldman L (1985) Clinical prediction rules. Applications and methodological standards. N Engl J Med 313: 793–799.
  9. 9. McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, et al. (2000) Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA 284: 79–84.
  10. 10. Wisnivesky JP, Serebrisky D, Moore C, Sacks HS, Iannuzzi MC, et al. (2005) Validity of clinical prediction rules for isolating inpatients with suspected tuberculosis. A systematic review. J Gen Intern Med 20: 947–952.
  11. 11. Rakoczy KS, Cohen SH, Nguyen HH (2008) Derivation and validation of a clinical prediction score for isolation of inpatients with suspected pulmonary tuberculosis. Infect Control Hosp Epidemiol 29: 927–932.
  12. 12. Solari L, Acuna-Villaorduna C, Soto A, Agapito J, Perez F, et al. (2008) A clinical prediction rule for pulmonary tuberculosis in emergency departments. Int J Tuberc Lung Dis 12: 619–624.
  13. 13. Soto A, Solari L, Agapito J, Acuna-Villaorduna C, Lambert ML, et al. (2008) Development of a clinical scoring system for the diagnosis of smear-negative pulmonary tuberculosis. Braz J Infect Dis 12: 128–132.
  14. 14. Wejse C, Gustafson P, Nielsen J, Gomes VF, Aaby P, et al. (2008) TBscore: Signs and symptoms from tuberculosis patients in a low-resource setting have predictive value and may be used to assess clinical course. Scand J Infect Dis 40: 111–120.
  15. 15. Boonsarngsuk V, Tansirichaiya K, Kiatboonsri S (2009) Thai drug-resistant tuberculosis predictive scores. Singapore Med J 50: 378–384.
  16. 16. Acuna-Villaorduna C, Vassall A, Henostroza G, Seas C, Guerra H, et al. (2008) Cost-effectiveness analysis of introduction of rapid, alternative methods to identify multidrug-resistant tuberculosis in middle-income countries. Clin Infect Dis 47: 487–495.
  17. 17. WHO (2008) Anti-Tuberculosis Drug Resistance in the World, Fourth Global Report. The WHO/IUATLD Global Project on Anti-Tuberculosis Drug Resistance Surveillance 2002-2007. Geneva: World Health Organization.
  18. 18. Faustini A, Hall AJ, Perucci CA (2006) Risk factors for multidrug resistant tuberculosis in Europe: a systematic review. Thorax 61: 158–163.
  19. 19. Espinal MA, Laserson K, Camacho M, Fusheng Z, Kim SJ, et al. (2001) Determinants of drug-resistant tuberculosis: analysis of 11 countries. Int J Tuberc Lung Dis 5: 887–893.
  20. 20. Casal M, Vaquero M, Rinder H, Tortoli E, Grosset J, et al. (2005) A case-control study for multidrug-resistant tuberculosis: risk factors in four European countries. Microb Drug Resist 11: 62–67.
  21. 21. Kliiman K, Altraja A (2009) Predictors of extensively drug-resistant pulmonary tuberculosis. Ann Intern Med 150: 766–775.
  22. 22. Ruddy M, Balabanova Y, Graham C, Fedorin I, Malomanova N, et al. (2005) Rates of drug resistance and risk factor analysis in civilian and prison patients with tuberculosis in Samara Region, Russia. Thorax 60: 130–135.
  23. 23. Kimerling ME, Kluge H, Vezhnina N, Iacovazzi T, Demeulenaere T, et al. (1999) Inadequacy of the current WHO re-treatment regimen in a central Siberian prison: treatment failure and MDR-TB. Int J Tuberc Lung Dis 3: 451–453.
  24. 24. Jereb JA, Klevens RM, Privett TD, Smith PJ, Crawford JT, et al. (1995) Tuberculosis in health care workers at a hospital with an outbreak of multidrug-resistant Mycobacterium tuberculosis. Arch Intern Med 155: 854–859.
  25. 25. Le Gal G, Righini M, Roy PM, Sanchez O, Aujesky D, et al. (2006) Prediction of pulmonary embolism in the emergency department: the revised Geneva score. Ann Intern Med 144: 165–171.
  26. 26. Koopman P (1984) Confidence intervals for the ratio of two binomial proportions. Biometrics 40: 513–517.
  27. 27. Haukoos JS, Lewis RJ (2005) Advanced statistics: bootstrapping confidence intervals for statistics with “difficult” distributions. Acad Emerg Med 12: 360–365.
  28. 28. UNAIDS/WHO (2009) Epidemiological Fact Sheet on HIV and AIDS: Peru 2008 Update. Geneva, Switzerland: UNAIDS/WHO.
  29. 29. Granich RM, Oh P, Lewis B, Porco TC, Flood J (2005) Multidrug resistance among persons with tuberculosis in California, 1994–2003. JAMA 293: 2732–2739.
  30. 30. Ben-Dov I, Mason GR (1987) Drug-resistant tuberculosis in a southern California hospital. Trends from 1969 to 1984. Am Rev Respir Dis 135: 1307–1310.
  31. 31. Balabanova Y, Drobniewski F, Nikolayevskyy V, Kruuner A, Malomanova N, et al. (2009) An integrated approach to rapid diagnosis of tuberculosis and multidrug resistance using liquid culture and molecular methods in Russia. PLoS One 4: e7129.
  32. 32. O'Riordan P, Schwab U, Logan S, Cooke G, Wilkinson RJ, et al. (2008) Rapid molecular detection of rifampicin resistance facilitates early diagnosis and treatment of multi-drug resistant tuberculosis: case control study. PLoS One 3: e3173.
  33. 33. Albert H, Bwanga F, Mukkada S, Nyesiga B, Ademun JP, et al. (2010) Rapid screening of MDR-TB using molecular Line Probe Assay is feasible in Uganda. BMC Infect Dis 10: 41.
  34. 34. Huyen MN, Tiemersma EW, Lan NT, Cobelens FG, Dung NH, et al. (2010) Validation of the GenoType MTBDRplus assay for diagnosis of multidrug resistant tuberculosis in South Vietnam. BMC Infect Dis 10: 149.
  35. 35. Richter E, Rusch-Gerdes S, Hillemann D (2009) Drug-susceptibility testing in TB: current status and future prospects. Expert Rev Respir Med 3: 497–510.
  36. 36. Minime-Lingoupou F, Pierre-Audigier C, Kassa-Kelembho E, Barilone N, Zandanga G, et al. (2010) Rapid identification of multidrug-resistant tuberculosis isolates in treatment failure or relapse patients in Bangui, Central African Republic. Int J Tuberc Lung Dis 14: 782–785.