skip to main content
research-article
Open Access

The Design and Evaluation of a Mobile System for Rapid Diagnostic Test Interpretation

Authors Info & Claims
Published:30 March 2021Publication History
Skip Abstract Section

Abstract

Rapid diagnostic tests (RDTs) provide point-of-care medical screening without the need for expensive laboratory equipment. RDTs are theoretically straightforward to use, yet their analog colorimetric output leaves room for diagnostic uncertainty and error. Furthermore, RDT results within a community are kept isolated unless they are aggregated by healthcare workers, limiting the potential that RDTs can have in supporting public health efforts. In light of these issues, we present a system called RDTScan for detecting and interpreting lateral flow RDTs with a smartphone. RDTScan provides real-time guidance for clear RDT image capture and automatic interpretation for accurate diagnostic decisions. RDTScan is structured to be quickly configurable to new RDT designs by requiring only a template image and some metadata about how the RDT is supposed to be read, making it easier to extend than a data-driven approach. Through a controlled lab study, we demonstrate that RDTScan's limit-of-detection can match, and even exceed, the performance of expert readers who are interpreting the physical RDTs themselves. We then present two field evaluations of smartphone apps built on the RDTScan system: (1) at-home influenza testing in Australia and (2) malaria testing by community healthcare workers in Kenya. RDTScan achieved 97.5% and 96.3% accuracy compared to RDT interpretation by experts in the Australia Flu Study and the Kenya Malaria Study, respectively.

References

  1. Konstantinos Agoritsas, Kathy Mack, Bema K Bonsu, Debbie Goodman, Douglas Salamon, and Mario J Marcon. 2006. Evaluation of the Quidel QuickVue test for detection of influenza A and B viruses in the pediatric emergency medicine setting by use of three specimen collection methods. Journal of clinical microbiology 44, 7 (2006), 2638--2641.Google ScholarGoogle ScholarCross RefCross Ref
  2. Chukwuemeka CA Azikiwe, C C Ifezulike, Iyeopu M Siminialayi, Louis U Amazu, J C Enye, and O E Nwakwunite. 2012. A comparative laboratory diagnosis of malaria: Microscopy versus rapid diagnostic test kits. Asian Pacific Journal of Tropical Biomedicine 2, 4 (apr 2012), 307--310. https://doi.org/10.1016/S2221-1691(12)60029-XGoogle ScholarGoogle ScholarCross RefCross Ref
  3. BankMyCell. 2020. How Many Smartphones Are In The World? 26 pages. https://www.bankmycell.com/blog/how-many-phones-are-in- the-worldGoogle ScholarGoogle Scholar
  4. Anabela Berenguer, Jorge Goncalves, Simo Hosio, Denzil Ferreira, Theodoros Anagnostopoulos, and Vassilis Kostakos. 2017. Are Smartphones Ubiquitous?: An in-depth survey of smartphone adoption by seniors. IEEE Consumer Electronics Magazine 6, 1 (jan 2017), 104--110. https://doi.org/10.1109/MCE.2016.2614524Google ScholarGoogle ScholarCross RefCross Ref
  5. L. Bissonnette and M. G. Bergeron. 2010. Diagnosing infections-current and anticipated technologies for point-of-care diagnostics and home-based testing., 1044-1053 pages. https://doi.org/10.1111/j.1469-0691.2010.03282.xGoogle ScholarGoogle Scholar
  6. Scott Carter, John Adcock, John Doherty, and Stacy Branham. 2010. NudgeCam: Toward targeted, higher quality media capture. In MM'10 - Proceedings of the ACM Multimedia 2010 International Conference. 615--618. https://doi.org/10.1145/1873951.1874034Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Centers for Disease Control and Prevention. 2016. Influenza Signs and Symptoms and the Role of Laboratory Diagnostics. https://www.cdc.gov/flu/professionals/diagnosis/labrolesprocedures.htmGoogle ScholarGoogle Scholar
  8. Francine Chen, Scott Carter, Laurent Denoue, and Jayant Kumar. 2013. SmartDCap: Semi-automatic capture of higher quality document images from a smartphone. In International Conference on Intelligent User Interfaces, Proceedings IUI. 287--296. https://doi.org/10.1145/2449396.2449433Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. F Chiadmi, J Schlatter, B Mounkassa, P Ovetchkine, and N Vermerie. 2004. Fast diagnostic tests in the management of group A beta-heamolytic streptococcal pharyngitis. Annales de biologie clinique 62, 5 (sep 2004), 573--577.Google ScholarGoogle Scholar
  10. Claudiu Cobârzan, Marco A. Hudelist, Klaus Schoeffmann, and Manfred Jürgen Primus. 2015. Mobile Image Analysis: Android vs. iOS. In MultiMedia Modeling, Xiangjian He, Suhuai Luo, Dacheng Tao, Changsheng Xu, Jie Yang, and Muhammad Abul Hasan (Eds.). Springer International Publishing, Cham, 99--110.Google ScholarGoogle Scholar
  11. Nicola Dell and Gaetano Borriello. 2013. Mobile tools for point-of-care diagnostics in the developing world. In Proc. DEV '13. ACM Press, New York, New York, USA, 1--10. https://doi.org/10.1145/2442882.2442894Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Nicola Dell, Ian Francis, Haynes Sheppard, Raiva Simbi, and Gaetano Borriello. 2014. Field evaluation of a camera-based mobile health system in low-resource settings. In Proc. MobileHCI '14. 33--42. https://doi.org/10.1145/2628363.2628366Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Denso ADC. 2011. QR Code Essentials. Technical Report. 1--12 pages. http://www.nacs.org/LinkClick.aspx?fileticket=D1FpVAvvJuo={&}tabid=1426{&}mid=480Google ScholarGoogle Scholar
  14. Centers for Disease Control and Prevention. [n.d.]. https://www.cdc.gov/flu/professionals/diagnosis/table-ridt.htmlGoogle ScholarGoogle Scholar
  15. Philippe Gillet, Marcella Mori, Jef Van Den Ende, and Jan Jacobs. 2010. Buffer substitution in malaria rapid diagnostic tests causes false-positive results. Malaria Journal 9, 1 (jul 2010), 215. https://doi.org/10.1186/1475-2875-9-215Google ScholarGoogle ScholarCross RefCross Ref
  16. Douglas Gollin and Christian Zimmermann. 2007. Malaria: Disease Impacts and Long-Run Income Differences. Department of Economics Working Paper Series 2997 (2007), 33. https://doi.org/10.1126/science.1061573Google ScholarGoogle Scholar
  17. Nikolai Gorski, Valery Anisimov, Emmanuel Augustin, Olivier Baret, and Sergey Maximov. 2001. Industrial bank check processing: The A2iA CheckReader™. International Journal on Document Analysis and Recognition 3, 4 (2001), 196--206. https://doi.org/10.1007/PL00013561Google ScholarGoogle ScholarCross RefCross Ref
  18. N. Gorski, V. Anisimov, E. Augustin, O. Baret, D. Price, and J. C. Simon. 1999. A2iA Check Reader: A family of bank check recognition systems. In Proceedings of the International Conference on Document Analysis and Recognition, ICDAR. IEEE Computer Society, 527--530. https://doi.org/10.1109/ICDAR.1999.791840Google ScholarGoogle Scholar
  19. GSMA. 2020. The Mobile Economy Sub-Saharan Africa. Technical Report. https://www.gsma.com/mobileeconomy/sub-saharan-africa/Google ScholarGoogle Scholar
  20. Steven A Harvey, Larissa Jennings, Masela Chinyama, Fred Masaninga, Kurt Mulholland, and David R Bell. 2008. Improving community health worker use of malaria rapid diagnostic tests in Zambia: package instructions, job aid and job aid-plus-training. Malaria Journal 7, 1 (dec 2008), 160. https://doi.org/10.1186/1475-2875-7-160Google ScholarGoogle ScholarCross RefCross Ref
  21. Nigel Hawkes. 2019. Flu: Australia sees early start to season. BMJ (Clinical research ed.) 366 (jul 2019), l4603. https://doi.org/10.1136/bmj.l4603Google ScholarGoogle Scholar
  22. Sócrates Herrera, Andrés F Vallejo, Juan P Quintero, Myriam Arévalo-Herrera, Marcela Cancino, and Santiago Ferro. 2014. Field evaluation of an automated RDT reader and data management device for Plasmodium falciparum/Plasmodium vivax malaria in endemic areas of Colombia. Malaria Journal 13, 1 (mar 2014), 87. https://doi.org/10.1186/1475-2875-13-87Google ScholarGoogle ScholarCross RefCross Ref
  23. Shichu Huang, Koji Abe, Steven Bennett, Tinny Liang, Paula D. Ladd, Lindsay Yokobe, Caitlin E. Anderson, Kamal Shah, Josh Bishop, Mike Purfield, Peter C. Kauffman, Sai Paul, AnneMarie E. Welch, Bonnie Strelitz, Kristin Follmer, Kelsey Pullar, Luis Sanchez-Erebia, Emily Gerth-Guyette, Gonzalo Domingo, Eileen Klein, Janet A. Englund, Elain Fu, and Paul Yager. 2017. Disposable Autonomous Device for Swab-to-Result Diagnosis of Influenza. Analytical Chemistry 89, 11 (jun 2017), 5776--5783. https://doi.org/10.1021/acs.analchem.6b04801Google ScholarGoogle ScholarCross RefCross Ref
  24. L. Huette, P. Barbosa-Pereira, O. Bougeois, J. V. Moreau, B. Plessis, P. Courtellemont, and Y. LeCourtier. 1997. Multi-Bank Check Recognition System: Consideration on the Numeral Amount Recognition Module. 133--156. https://doi.org/10.1142/9789812797681_0006Google ScholarGoogle Scholar
  25. Jan Jacobs, Barbara Barbé, Philippe Gillet, Michael Aidoo, Elisa Serra-Casas, Jan Van Erps, Joelle Daviaud, Sandra Incardona, Jane Cunningham, and Theodoor Visser. 2014. Harmonization of malaria rapid diagnostic tests: Best practices in labelling including instructions for use. Malaria Journal 13, 1 (dec 2014), 505. https://doi.org/10.1186/1475-2875-13-505Google ScholarGoogle ScholarCross RefCross Ref
  26. Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P. Bigham. 2011. Supporting blind photography. In ASSETS'11: Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 203--210. https://doi.org/10.1145/2049536.2049573Google ScholarGoogle Scholar
  27. Eleni Kakalou, Vasileios Papastamopoulos, Panagiotis Ioannidis, Kostas Papanikolaou, Ourania Georgiou, and Athanasios Skoutelis. 2014. Early HIV diagnosis through use of rapid diagnosis test (RDT) in the community and direct link to HIV care: a pilot project for vulnerable populations in Athens, Greece. Journal of the International AIDS Society 17 (nov 2014), 19619. https://doi.org/10.7448/ias.17.4.19619Google ScholarGoogle ScholarCross RefCross Ref
  28. J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics 33, 1 (1977), 159--174. http://www.jstor.org/stable/2529310Google ScholarGoogle ScholarCross RefCross Ref
  29. Stefan Leutenegger, Margarita Chli, and Roland Y Siegwart. 2011. BRISK: Binary robust invariant scalable keypoints. In 2011 International conference on computer vision. Ieee, 2548--2555.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. David G. Lowe. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2 (nov 2004), 91--110. https://doi.org/10.1023/B:VISI.0000029664.99615.94 arXiv:cs/0112017Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Victoria Lyon, Monica Zigman Suchsland, Monique Chilver, Nigel Stocks, Barry Lutz, Philip Su, Shawna Cooper, Chunjong Park, Libby Rose Lavitt, Alex Mariakakis, et al. 2020. Diagnostic accuracy of an app-guided, self-administered test for influenza among individuals presenting to general practice with influenza-like illness: study protocol. BMJ open 10, 11 (2020), e036298.Google ScholarGoogle Scholar
  32. David Mabey, Rosanna W. Peeling, Andrew Ustianowski, and Mark D. Perkins. 2004. Diagnostics for the developing world., 231--240 pages. https://doi.org/10.1038/nrmicro841Google ScholarGoogle Scholar
  33. Christine Manyando, Eric M Njunju, Justin Chileshe, Seter Siziya, and Clive Shiff. 2014. Rapid diagnostic tests for malaria and health workers' adherence to test results at health facilities in Zambia. Malaria Journal 13, 1 (may 2014), 166. https://doi.org/10.1186/1475-2875-13-166Google ScholarGoogle ScholarCross RefCross Ref
  34. Ronald E. McGaughey, Steven M. Zeltmann, and Mark E. McMurtrey. 2013. Motivations and obstacles to smartphone use by the elderly: Developing a research framework. International Journal of Electronic Finance 7, 3-4 (2013), 177--195. https://doi.org/10.1504/IJEF.2013.058601Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Quinn McNemar. 1947. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12, 2 (jun 1947), 153--157. https://doi.org/10.1007/BF02295996Google ScholarGoogle ScholarCross RefCross Ref
  36. Pablo J Montoya, Sheila A Lukehart, Paula E Brentlinger, Ana J Blanco, Florencia Floriano, Josefa Sairosse, and Stephen Gloyd. 2006. Comparison of the diagnostic accuracy of a rapid immunochromatographic test and the rapid plasma reagin test for antenatal syphilis screening in Mozambique. Bulletin of the World Health Organization 84, 2 (2006), 97--104. https://doi.org/10.2471/BLT.04.018663Google ScholarGoogle ScholarCross RefCross Ref
  37. Onur Mudanyali, Stoyan Dimitrov, Uzair Sikora, Swati Padmanabhan, Isa Navruz, and Aydogan Ozcan. 2012. Integrated rapid-diagnostic-test reader platform on a cellphone. Lab on a Chip 12, 15 (aug 2012), 2678--2686. https://doi.org/10.1039/c2lc40235aGoogle ScholarGoogle Scholar
  38. David Mukanga, James K. Tibenderana, Juliet Kiguli, George W. Pariyo, Peter Waiswa, Francis Bajunirwe, Brian Mutamba, Helen Counihan, Godfrey Ojiambo, and Karin Kallander. 2010. Community acceptability of use of rapid diagnostic tests for malaria by community health workers in Uganda. Malaria Journal 9, 1 (2010). https://doi.org/10.1186/1475-2875-9-203Google ScholarGoogle ScholarCross RefCross Ref
  39. Marshal M. Mweu, Juliana Wambua, Fixtan Njuga, Philip Bejon, and Daniel Mwanga. 2019. Bayesian evaluation of the performance of three diagnostic tests for Plasmodium falciparum infection in a low-transmission setting in Kilifi County, Kenya. Wellcome Open Research 4 (oct 2019), 67. https://doi.org/10.12688/wellcomeopenres.152043Google ScholarGoogle Scholar
  40. Anthony T Newall, Paul A Scuffham, and Brent Hodgkinson. 2007. Economic Report into the Cost of Influenza to the Australian Health System Report to the Influenza Specialist Group Executive summary. Technical Report March. http://www.isg.org.au/assets/assets/isg-cost-influenza-report-30- 2007.pdfGoogle ScholarGoogle Scholar
  41. World Health Organization. [n.d.]. https://www.who.int/malaria/areas/diagnosis/rapid-diagnostic-tests/rdt-rd7-final-list-of-products.pdfGoogle ScholarGoogle Scholar
  42. Aydogan Ozcan. 2014. Mobile phones democratize and cultivate next-generation imaging, diagnostics and measurement tools. Lab on a Chip 14, 17 (2014), 3187--3194. https://doi.org/10.1039/c4lc00010bGoogle ScholarGoogle Scholar
  43. Haydar Ozkan and Osman Semih Kayhan. 2016. A Novel Automatic Rapid Diagnostic Test Reader Platform. Computational and Mathematical Methods in Medicine 2016 (apr 2016), 1--10. https://doi.org/10.1155/2016/7498217Google ScholarGoogle Scholar
  44. Nitika Pant Pai, Caroline Vadnais, Claudia Denkinger, Nora Engel, and Madhukar Pai. 2012. Point-of-Care Testing for Infectious Diseases: Diversity, Complexity, and Barriers in Low- And Middle-Income Countries. PLoS Medicine 9, 9 (sep 2012). https://doi.org/10.1371/journal.pmed.1001306Google ScholarGoogle ScholarCross RefCross Ref
  45. Chunjong Park, Alex Mariakakis, Jane Yang, Diego Lassala, Yasamba Djiguiba, Youssouf Keita, Hawa Diarra, Beatrice Wasunna, Fatou Fall, Marème Soda Gaye, et al. 2020. Supporting Smartphone-Based Image Capture of Rapid Diagnostic Tests in Low-Resource Settings. In Proceedings of the 2020 International Conference on Information and Communication Technologies and Development. 1--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. J L Pech-Pacheco, G Crist, J Chamorro-Mart Nez, and & J Fern Andez-Valdivia. [n.d.]. Diatom autofocusing in brightteld microscopy: a comparative study. Technical Report. www.iv.optica.csic.essprojectssautof.htmlGoogle ScholarGoogle Scholar
  47. Stephen M Pizer, E. Philip Amburn, John D Austin, Robert Cromartie, Ari Geselowitz, Trey Greer, Bart ter Haar Romeny, John B Zimmerman, and Karel Zuiderveld. 1987. Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing 39, 3 (1987), 355--368. https://doi.org/10.1016/S0734-189X(87)80186-XGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  48. S. W. Ryu, J. H. Lee, J. Kim, M. A. Jang, J. H. Nam, M. S. Byoun, and C. S. Lim. 2016. Comparison of two new generation influenza rapid diagnostic tests with instrument-based digital readout systems for influenza virus detection. British Journal of Biomedical Science 73, 3 (sep 2016), 115--120. https://doi.org/10.1080/09674845.2016.1189026Google ScholarGoogle ScholarCross RefCross Ref
  49. Osama M.E. Seidahmed, Muneir M.N. Mohamedein, Afrah A. Elsir, Fayez T. Ali, El Fatih M. Malik, and Eldirdieri S. Ahmed. 2008. End-user errors in applying two malaria rapid diagnostic tests in a remote area of Sudan. Tropical Medicine & International Health 13, 3 (feb 2008), 406--409. https://doi.org/10.1111/j.1365-3156.2008.02015.xGoogle ScholarGoogle ScholarCross RefCross Ref
  50. Shri Prakash Singh, Siddhivinayak Hirve, M. Mamun Huda, Megha Raj Banjara, Narendra Kumar, Dinesh Mondal, Shyam Sundar, Pradeep Das, Chitra Kumar Gurung, Suman Rijal, C. P. Thakur, Beena Varghese, and Axel Kroeger. 2011. Options for active case detection of visceral leishmaniasis in endemic districts of India, Nepal and Bangladesh, comparing yield, feasibility and costs. PLoS Neglected Tropical Diseases 5, 2 (2011). https://doi.org/10.1371/journal.pntd.0000960Google ScholarGoogle Scholar
  51. Rene Ning Teh, Irene Ule Ngole Sumbele, Gillian Asoba Nkeudem, Derick Ndelle Meduke, Samuel Takang Ojong, and Helen Kuokuo Kimbi. 2019. Concurrence of CareStart™ Malaria HRP2 RDT with microscopy in population screening for Plasmodium falciparum infection in the Mount Cameroon area: predictors for RDT positivity. Tropical medicine and health 47, 1 (2019), 17.Google ScholarGoogle Scholar
  52. Kentaro Toyama. 2015. Geek heresy: Rescuing social change from the cult of technology.Google ScholarGoogle Scholar
  53. Piia Von Lode. 2005. Point-of-care immunotesting: Approaching the analytical performance of central laboratory methods., 591--606 pages. https://doi.org/10.1016/j.clinbiochem.2005.03.008Google ScholarGoogle Scholar
  54. Siriorn Watcharananan, Sasisopin Kiertiburanakul, and Wasun Chantratita. 2010. Rapid influenza diagnostic test during the outbreak of the novel influenza A/H1N1 2009 in Thailand: An Experience with Better Test Performance in Resource Limited Setting. Journal of Infection 60, 1 (jan 2010), 86--87. https://doi.org/10.1016/j.jinf.2009.10.049Google ScholarGoogle ScholarCross RefCross Ref
  55. Samuel White, Hanjie Ji, and Jeffrey P. Bigham. 2010. EasySnap: Real-time audio feedback for blind photography. In UIST 2010 - 23rd ACM Symposium on User Interface Software and Technology, Adjunct Proceedings. 409--410. https://doi.org/10.1145/1866218.1866244Google ScholarGoogle Scholar
  56. Rapeeporn Wongkanya, Tippawan Pankam, Shauna Wolf, Supanit Pattanachaiwit, Jureeporn Jantarapakde, Supabhorn Pengnongyang, Prasopsuk Thapwong, Apichat Udomjirasirichot, Yutthana Churattanakraisri, Nanthika Prawepray, Apiluk Paksornsit, Thidadaow Sitthipau, Sarayut Petchaithong, Raruay Jitsakulchaidejt, Somboon Nookhai, Cheewanan Lertpiriyasuwat, Sumet Ongwandee, Praphan Phanuphak, and Nittaya Phanuphak. 2018. HIV rapid diagnostic testing by lay providers in a key population-led health service programme in Thailand. Journal of virus eradication 4, 1 (jan 2018), 12--15. http://www.ncbi.nlm.nih.gov/pubmed/29568547Google ScholarGoogle ScholarCross RefCross Ref
  57. World Health Organization. 2019. World Malaria Report. Technical Report. 1--232 pages. https://www.who.int/publications-detail/world-malaria- report-2019Google ScholarGoogle Scholar
  58. Hassan Zaraket and Reiko Saito. 2016. Japanese Surveillance Systems and Treatment for Influenza. Current Treatment Options in Infectious Diseases 8, 4 (dec 2016), 311--328. https://doi.org/10.1007/s40506-016-0085-5Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. The Design and Evaluation of a Mobile System for Rapid Diagnostic Test Interpretation

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader