skip to main content
research-article

V2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing

Authors Info & Claims
Published:15 June 2020Publication History
Skip Abstract Section

Abstract

Given the significant amount of time people spend in vehicles, health issues under driving condition have become a major concern. Such issues may vary from fatigue, asthma, stroke, to even heart attack, yet they can be adequately indicated by vital signs and abnormal activities. Therefore, in-vehicle vital sign monitoring can help us predict and hence prevent these issues. Whereas existing sensor-based (including camera) methods could be used to detect these indicators, privacy concern and system complexity both call for a convenient yet effective and robust alternative. This paper aims to develop V2iFi, an intelligent system performing monitoring tasks using a COTS impulse radio mounted on the windshield. V2iFi is capable of reliably detecting driver's vital signs under driving condition and with the presence of passengers, thus allowing for potentially inferring corresponding health issues. Compared with prior work based on Wi-Fi CSI, V2iFi is able to distinguish reflected signals from multiple users, and hence provide finer-grained measurements under more realistic settings. We evaluate V2iFi both in lab environments and during real-life road tests; the results demonstrate that respiratory rate, heart rate, and heart rate variability can all be estimated accurately. Based on these estimation results, we further discuss how machine learning models can be applied on top of V2iFi so as to improve both physiological and psychological wellbeing in driving environments.

References

  1. Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections. In Proc. of the 10th USENIX NSDI. 317--329.Google ScholarGoogle Scholar
  2. Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart Homes That Monitor Breathing and Heart Rate. In Proc. of the 33rd ACM CHI. 837--846.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Muhammad Awais, Nasreen Badruddin, and Micheal Drieberg. 2017. A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability. Sensors 17, 9 (2017), 1991.Google ScholarGoogle ScholarCross RefCross Ref
  4. Amerjeet S Banning and G Andre Ng. 2012. Driving and Arrhythmia: A Review of Scientific Basis for International Guidelines. European Heart Journal 34, 3 (2012), 236--244.Google ScholarGoogle ScholarCross RefCross Ref
  5. Thomas Benichou, Bruno Pereira, Martial Mermillod, Igor Tauveron, Daniela Pfabigan, Salwan Maqdasy, and Frederic Dutheil. 2018. Heart Rate Variability in Type 2 Diabetes Mellitus: A Systematic Review and Meta-Analysis. PLOS One 13, 4 (2018), e0195166.Google ScholarGoogle ScholarCross RefCross Ref
  6. Svante Björklund, Anders Nelander, and Mats I Pettersson. 2015. Fast-Time and Slow-Time Space-Time Adaptive Processing for Bistatic Radar Interference Suppression. In 2015 IEEE Radar Conference (Radarcon). 0674--0678.Google ScholarGoogle Scholar
  7. BMW AG. 2019. Smartsenior: Intelligente Dienste Und Dienstleistungen Für Senioren. http://www1.smart-senior.de/pdf/presse/SmartSenior_CeBIT_Partnerflyer_BMW_DE_EN_2012_final.pdf. Accessed: 2019-10-09.Google ScholarGoogle Scholar
  8. Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein, et al. 2011. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends® in Machine learning 3, 1 (2011), 1--122.Google ScholarGoogle Scholar
  9. Karel A Brookhuis and Dick de Waard. 2010. Monitoring Drivers' Mental Workload in Driving Simulators using Physiological Measures. Accident Analysis & Prevention 42, 3 (2010), 898--903.Google ScholarGoogle ScholarCross RefCross Ref
  10. JR Catterall, PMA Calverley, V Brezinova, NJ Douglas, HM Brash, CM Shapiro, and DC Flenley. 1982. Irregular Breathing and Hypoxaemia During Sleep in Chronic Stable Asthma. The Lancet 319, 8267 (1982), 301--304.Google ScholarGoogle Scholar
  11. John A Chalmers, Daniel S Quintana, Maree J Abbott, Andrew H Kemp, et al. 2014. Anxiety Disorders Are Associated with Reduced Heart Rate Variability: A Meta-Analysis. Frontiers in Psychiatry 5 (2014), 80.Google ScholarGoogle ScholarCross RefCross Ref
  12. Hyunggi Cho, Young-Woo Seo, BVK Vijaya Kumar, and Ragunathan Raj Rajkumar. 2014. A Multi-Sensor Fusion System for Moving Object Detection and Tracking in Urban Driving Environments. In IEEE International Conference on Robotics and Automation (ICRA). 1836--1843.Google ScholarGoogle ScholarCross RefCross Ref
  13. Eric Chern-Pin Chua, Wen-Qi Tan, Sing-Chen Yeo, Pauline Lau, Ivan Lee, Ivan Ho Mien, Kathiravelu Puvanendran, and Joshua J. Gooley. 2012. Heart Rate Variability Can Be Used to Estimate Sleepiness-related Decrements in Psychomotor Vigilance during Total Sleep Deprivation. Sleep 35, 3 (03 2012), 325--334.Google ScholarGoogle Scholar
  14. Vivian L Clark and James A Kruse. 1990. Clinical Methods: The History, Physical, and Laboratory Examinations. Jama 264, 21 (1990), 2808--2809.Google ScholarGoogle Scholar
  15. Michelle A Cretikos, Rinaldo Bellomo, Ken Hillman, Jack Chen, Simon Finfer, and Arthas Flabouris. 2008. Respiratory Rate: The Neglected Vital Sign. Medical Journal of Australia 188, 11 (2008), 657--659.Google ScholarGoogle ScholarCross RefCross Ref
  16. Dirk Cysarz, Silke Lange, Peter F Matthiessen, and Peter van Leeuwen. 2007. Regular Heartbeat Dynamics Are Associated with Cardiac Health. Am. J. Physiol 292, 1 (2007), R368-R372.Google ScholarGoogle ScholarCross RefCross Ref
  17. Daimler AG. 2019. Attention Assist: Drowsiness-Detection System Warns Drivers to Prevent Them Falling Asleep Momentarily -Daimler Global Media Site. https://media.daimler.com/marsMediaSite/en/instance/ko/ATTENTION-ASSIST-Drowsiness-detection-system-warns-drivers-to-prevent-them-falling-asleep-momentarily.xhtml?oid=9361586. Accessed: 2019-10-09.Google ScholarGoogle Scholar
  18. Chacko John Deepu, Zhihao Chen, Ju Teng Teo, Soon Huat Ng, Xiefeng Yang, and Yong Lian. 2012. A Smart Cushion for Real-Time Heart Rate Monitoring. In 2012 IEEE Biomedical Circuits and Systems Conference. 53--56.Google ScholarGoogle ScholarCross RefCross Ref
  19. Jason P DePasquale, E Scott Geller, Steven W Clarke, and Lawrence C Littleton. 2001. Measuring Road Rage: Development of The Propensity for Angry Driving Scale. J. Saf. Res. 32, 1 (2001), 1--16.Google ScholarGoogle ScholarCross RefCross Ref
  20. Konstantin Dragomiretskiy and Dominique Zosso. 2013. Variational Mode Decomposition. IEEE Transactions on Signal Processing 62, 3 (2013), 531--544.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Malcolm Elliott and Alysia Coventry. 2012. Critical Care: the Eight Vital Signs of Patient Monitoring. British Journal of Nursing 21, 10 (2012), 621--625.Google ScholarGoogle ScholarCross RefCross Ref
  22. Sigrid Elsenbruch, Michael J Harnish, and William C Orr. 1999. Heart Rate Variability During Waking and Sleep in Healthy Males and Females. Sleep 22, 8 (1999), 1067--1071.Google ScholarGoogle ScholarCross RefCross Ref
  23. Martin Eriksson and Nikolaos P Papanikotopoulos. 1997. Eye-Tracking for Detection of Driver Fatigue. In Proc. of Conference on Intelligent Transportation Systems. 314--319.Google ScholarGoogle ScholarCross RefCross Ref
  24. Gernot Ernst. 2017. Heart-Rate Variability-More than Heart Beats? Frontiers in Public Health 5 (2017), 240.Google ScholarGoogle ScholarCross RefCross Ref
  25. John F Fieselmann, Michael S Hendryx, Charles M Helms, and Douglas S Wakefield. 1993. Respiratory Rate Predicts Cardiopulmonary Arrest for Internal Medicine Inpatients. Journal of General Internal Medicine 8, 7 (1993), 354--360.Google ScholarGoogle ScholarCross RefCross Ref
  26. Diane Flatley, LA Reyner, and James A Horne. 2004. Sleep-Related Crashes on Sections of Different Road Types in the UK (1995-2001). Road Safety United States Naval School of Aviation Medicine 52 (2004).Google ScholarGoogle Scholar
  27. Koichi Fujiwara, Erika Abe, Keisuke Kamata, Chikao Nakayama, Yoko Suzuki, Toshitaka Yamakawa, Toshihiro Hiraoka, Manabu Kano, Yukiyoshi Sumi, Fumi Masuda, et al. 2018. Heart Rate Variability-Based Driver Drowsiness Detection and its Validation with EEG. IEEE Transactions on Biomedical Engineering 66, 6 (2018), 1769--1778.Google ScholarGoogle ScholarCross RefCross Ref
  28. Nicholas D Giardino, Seth D Friedman, and Stephen R Dager. 2007. Anxiety, Respiration, and Cerebral Blood Flow: Implications for Functional Brain Imaging. Comprehensive Psychiatry 48, 2 (2007), 103--112.Google ScholarGoogle ScholarCross RefCross Ref
  29. Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Sinh Huynh, Rajesh Krishna Balan, JeongGil Ko, and Youngki Lee. 2019. VitaMon: Measuring Heart Rate Variability Using Smartphone Front Camera. In Proc. of the 17th ACM Sensys. 1--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. P Jackson, C Hilditch, A Holmes, N Reed, N Merat, and L Smith. 2011. Fatigue and Road Safety: A Critical Analysis of Recent Evidence. Department for Transport, Road Safety Web Publication 21 (2011).Google ScholarGoogle Scholar
  32. Wenjia Jia, Hongjian Peng, Na Ruan, Zhiping Tang, and Wei Zhao. 2018. WiFind: Driver Fatigue Detection with Fine-Grained Wi-Fi Signal Features. IEEE Transactions on Big Data (2018), 1--14.Google ScholarGoogle Scholar
  33. Sang-Ho Jo, Jin-Myung Kim, and Dong Kyoo Kim. 2019. Heart Rate Change While Drowsy Driving. Journal of Korean Medical Science 34, 8 (2019).Google ScholarGoogle ScholarCross RefCross Ref
  34. Seong Kyu Leem, Faheem Khan, and Sung Ho Cho. 2017. Vital Sign Monitoring and Mobile Phone Usage Detection Using IR-UWB Radar for Intended Use in Car Crash Prevention. Sensors (2017).Google ScholarGoogle Scholar
  35. Gang Li, Boon-Leng Lee, and Wan-Young Chung. 2015. Smartwatch-based Wearable EEG System for Driver Drowsiness Detection. IEEE Sensors Journal 15, 12 (2015), 7169--7180.Google ScholarGoogle ScholarCross RefCross Ref
  36. Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proc. of the 17th ACM UbiComp 1, 3 (2017), 72.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. H-O Lisper, Hans Laurell, and G Stening. 1973. Effects of Experience of The Driver on Heart-Rate, Respiration-Rate, and Subsidiary Reaction Time in A Three Hours Continuous Driving Task. Ergonomics 16, 4 (1973), 501--506.Google ScholarGoogle ScholarCross RefCross Ref
  38. Mohamed Faisal Lutfi. 2015. Patterns of Heart Rate Variability and Cardiac Autonomic Modulations in Controlled and Uncontrolled Asthmatic Patients. BMC Pulmonary Medicine 15, 1 (2015), 119.Google ScholarGoogle ScholarCross RefCross Ref
  39. Zahra Mardi, Seyedeh Naghmeh Miri Ashtiani, and Mohammad Mikaili. 2011. EEG-Based Drowsiness Detection for Safe Driving Using Chaotic Features and Statistical Tests. Journal of Medical Signals and Sensors 1, 2 (2011), 130.Google ScholarGoogle ScholarCross RefCross Ref
  40. Hermann Nabi, Martica Hall, Markku Koskenvuo, Archana Singh-Manoux, Tuula Oksanen, Sakari Suominen, Mika Kivimäki, and Jussi Vahtera. 2010. Psychological and Somatic Symptoms of Anxiety and Risk of Coronary Heart Disease: the Health and Social Support Prospective Cohort Study. Biological Psychiatry 67, 4 (2010), 378--385.Google ScholarGoogle ScholarCross RefCross Ref
  41. Novelda AS. 2017. Single-Chip Radar Sensors with Sub-mm Resolution - XETHRU. https://www.xethru.com/. Accessed: 2019-10-03.Google ScholarGoogle Scholar
  42. Novelda AS. 2017. XETHRU Sensor Emissions: An In-Depth Look at Radar Safety Regulations. https://www.xethru.com/blog/posts/xethru-radar-emission-comparison. Accessed: 2019-10-03.Google ScholarGoogle Scholar
  43. Mikito Ogino and Yasue Mitsukura. 2018. Portable Drowsiness Detection Through Use of A Prefrontal Single-Channel Electroencephalogram. Sensors 18, 12 (2018), 4477.Google ScholarGoogle ScholarCross RefCross Ref
  44. Jin-Kwan Park, Yunseog Hong, Hyunjae Lee, Chorom Jang, Gi-Ho Yun, Hee-Jo Lee, and Jong-Gwan Yook. 2019. Noncontact RF Vital Sign Sensor for Continuous Monitoring of Driver Status. IEEE Transactions on Biomedical Circuits and Systems 13, 3 (2019), 493--502.Google ScholarGoogle ScholarCross RefCross Ref
  45. Eduardo Pinheiro, Octavian Postolache, and Pedro Girão. 2010. Theory and Developments in An Unobtrusive Cardiovascular System Representation: Ballistocardiography. The Open Biomedical Engineering Journal 4 (2010), 201.Google ScholarGoogle ScholarCross RefCross Ref
  46. Harold R Raemer. 1996. Radar Systems Principles. CRC press.Google ScholarGoogle Scholar
  47. Raspberry Pi Foundation. 2019. Teach, Learn and Make with Raspberry Pi - Raspberry Pi. https://https://www.raspberrypi.org/. Accessed: 2019-10-03.Google ScholarGoogle Scholar
  48. Francesco Sessa, Valenzano Anna, Giovanni Messina, Giuseppe Cibelli, Vincenzo Monda, Gabriella Marsala, Maria Ruberto, Antonio Biondi, Orazio Cascio, Giuseppe Bertozzi, et al. 2018. Heart Rate Variability As Predictive Factor for Sudden Cardiac Death. Aging (Albany NY) 10, 2 (2018), 166.Google ScholarGoogle ScholarCross RefCross Ref
  49. Fred Shaffer and JP Ginsberg. 2017. An Overview of Heart Rate Variability Metrics and Norms. Frontiers in Public Health 5 (2017), 258.Google ScholarGoogle ScholarCross RefCross Ref
  50. Fred Shaffer, Rollin McCraty, and Christopher L Zerr. 2014. A Healthy Heart Is Not A Metronome: An Integrative Review of the Heart's Anatomy and Heart Rate Variability. Frontiers in Psychology 5 (2014), 1040.Google ScholarGoogle ScholarCross RefCross Ref
  51. Anupriya Sharma, NB Hirulkar, and Payal Ranka. 2011. Effect of Hyperglycemia on Electrolytes Imbalance. Int J Pharm Biol Arch 2 (2011), 526--33.Google ScholarGoogle Scholar
  52. José Solaz, José Laparra-Hernández, Daniel Bande, Noelia Rodríguez, Sergio Veleff, José Gerpe, and Enrique Medina. 2016. Drowsiness Detection Based on the Analysis of Breathing Rate Obtained from Real-Time Image Recognition. Transportation Research Procedia 14 (2016), 3867--3876.Google ScholarGoogle ScholarCross RefCross Ref
  53. Richard Strauß, Santiago Ewig, Klaus Richter, Thomas König, Günther Heller, and Torsten T Bauer. 2014. The Prognostic Significance of Respiratory Rate in Patients with Pneumonia: A Retrospective Analysis of Data from 705 928 Hospitalized Patients in Germany from 2010-2012. Deutsches Ärzteblatt International 111, 29-30 (2014), 503.Google ScholarGoogle Scholar
  54. Thomas J Sullivan, Stephen R Deiss, and Gert Cauwenberghs. 2007. A Low-Noise, Non-Contact EEG/ECG Sensor. In 2007 IEEE Biomedical Circuits and Systems Conference. 154--157.Google ScholarGoogle Scholar
  55. John L Troutman. 2012. Variational Calculus and Optimal Control: Optimization with Elementary Convexity. Springer Science & Business Media.Google ScholarGoogle Scholar
  56. Mihoko Tsunoda, Takuro Endo, Satoko Hashimoto, Sato Honma, and Ken-Ichi Honma. 2001. Effects of Light and Sleep Stages on Heart Rate Variability in Humans. Psychiatry and Clinical Neurosciences 55, 3 (2001), 285--286.Google ScholarGoogle ScholarCross RefCross Ref
  57. Volvo Group. 2019. Driver Alert System. https://www.volvocars.com/en-th/support/manuals/s60/2014/driver-support/driver-alert-system/driver-alert-control-dac---operation. Accessed: 2019-10-09.Google ScholarGoogle Scholar
  58. Chuyu Wang, Lei Xie, Wei Wang, Yingying Chen, Yanling Bu, and Sanglu Lu. 2018. RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array. Proc. of the 17th ACM UbiComp 2, 2 (2018), 85.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. Proc. of the 17th ACM UbiComp 1, 4 (2018), 170.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. WS Waring, JY Rhee, DN Bateman, GE Leggett, and H Jamie. 2008. Impaired Heart Rate Variability and Altered Cardiac Sympathovagal Balance After Antidepressant Overdose. European Journal of Clinical Pharmacology 64, 11 (2008), 1037--1041.Google ScholarGoogle ScholarCross RefCross Ref
  61. Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55, 10 (2017), 91--97.Google ScholarGoogle ScholarCross RefCross Ref
  62. Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Linghe Kong, and Minglu Li. 2019. BreathListener: Fine-Grained Breathing Monitoring in Driving Environments Utilizing Acoustic Signals. In Proc. of the 17th ACM MobiSys. 54--66.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals. Proc. of the 18th ACM UbiComp 2, 3 (2018), 148.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Jin Zhang, Weitao Xu, Wen Hu, and Salil S Kanhere. 2017. WiCare: Towards In-Situ Breath Monitoring. In Proc. of the 14th ACM MobiQuitous. ACM, 126--135.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion Recognition Using Wireless Signals. In Proc. of the 22nd ACM MobiCom. 95--108.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. V2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
          Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 2
          June 2020
          771 pages
          EISSN:2474-9567
          DOI:10.1145/3406789
          Issue’s Table of Contents

          Copyright © 2020 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 15 June 2020
          Published in imwut Volume 4, Issue 2

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader