Abstract
Given the significant amount of time people spend in vehicles, health issues under driving condition have become a major concern. Such issues may vary from fatigue, asthma, stroke, to even heart attack, yet they can be adequately indicated by vital signs and abnormal activities. Therefore, in-vehicle vital sign monitoring can help us predict and hence prevent these issues. Whereas existing sensor-based (including camera) methods could be used to detect these indicators, privacy concern and system complexity both call for a convenient yet effective and robust alternative. This paper aims to develop V2iFi, an intelligent system performing monitoring tasks using a COTS impulse radio mounted on the windshield. V2iFi is capable of reliably detecting driver's vital signs under driving condition and with the presence of passengers, thus allowing for potentially inferring corresponding health issues. Compared with prior work based on Wi-Fi CSI, V2iFi is able to distinguish reflected signals from multiple users, and hence provide finer-grained measurements under more realistic settings. We evaluate V2iFi both in lab environments and during real-life road tests; the results demonstrate that respiratory rate, heart rate, and heart rate variability can all be estimated accurately. Based on these estimation results, we further discuss how machine learning models can be applied on top of V2iFi so as to improve both physiological and psychological wellbeing in driving environments.
- Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections. In Proc. of the 10th USENIX NSDI. 317--329.Google Scholar
- Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart Homes That Monitor Breathing and Heart Rate. In Proc. of the 33rd ACM CHI. 837--846.Google ScholarDigital Library
- Muhammad Awais, Nasreen Badruddin, and Micheal Drieberg. 2017. A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability. Sensors 17, 9 (2017), 1991.Google ScholarCross Ref
- Amerjeet S Banning and G Andre Ng. 2012. Driving and Arrhythmia: A Review of Scientific Basis for International Guidelines. European Heart Journal 34, 3 (2012), 236--244.Google ScholarCross Ref
- Thomas Benichou, Bruno Pereira, Martial Mermillod, Igor Tauveron, Daniela Pfabigan, Salwan Maqdasy, and Frederic Dutheil. 2018. Heart Rate Variability in Type 2 Diabetes Mellitus: A Systematic Review and Meta-Analysis. PLOS One 13, 4 (2018), e0195166.Google ScholarCross Ref
- Svante Björklund, Anders Nelander, and Mats I Pettersson. 2015. Fast-Time and Slow-Time Space-Time Adaptive Processing for Bistatic Radar Interference Suppression. In 2015 IEEE Radar Conference (Radarcon). 0674--0678.Google Scholar
- BMW AG. 2019. Smartsenior: Intelligente Dienste Und Dienstleistungen Für Senioren. http://www1.smart-senior.de/pdf/presse/SmartSenior_CeBIT_Partnerflyer_BMW_DE_EN_2012_final.pdf. Accessed: 2019-10-09.Google Scholar
- Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein, et al. 2011. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends® in Machine learning 3, 1 (2011), 1--122.Google Scholar
- Karel A Brookhuis and Dick de Waard. 2010. Monitoring Drivers' Mental Workload in Driving Simulators using Physiological Measures. Accident Analysis & Prevention 42, 3 (2010), 898--903.Google ScholarCross Ref
- JR Catterall, PMA Calverley, V Brezinova, NJ Douglas, HM Brash, CM Shapiro, and DC Flenley. 1982. Irregular Breathing and Hypoxaemia During Sleep in Chronic Stable Asthma. The Lancet 319, 8267 (1982), 301--304.Google Scholar
- John A Chalmers, Daniel S Quintana, Maree J Abbott, Andrew H Kemp, et al. 2014. Anxiety Disorders Are Associated with Reduced Heart Rate Variability: A Meta-Analysis. Frontiers in Psychiatry 5 (2014), 80.Google ScholarCross Ref
- Hyunggi Cho, Young-Woo Seo, BVK Vijaya Kumar, and Ragunathan Raj Rajkumar. 2014. A Multi-Sensor Fusion System for Moving Object Detection and Tracking in Urban Driving Environments. In IEEE International Conference on Robotics and Automation (ICRA). 1836--1843.Google ScholarCross Ref
- Eric Chern-Pin Chua, Wen-Qi Tan, Sing-Chen Yeo, Pauline Lau, Ivan Lee, Ivan Ho Mien, Kathiravelu Puvanendran, and Joshua J. Gooley. 2012. Heart Rate Variability Can Be Used to Estimate Sleepiness-related Decrements in Psychomotor Vigilance during Total Sleep Deprivation. Sleep 35, 3 (03 2012), 325--334.Google Scholar
- Vivian L Clark and James A Kruse. 1990. Clinical Methods: The History, Physical, and Laboratory Examinations. Jama 264, 21 (1990), 2808--2809.Google Scholar
- Michelle A Cretikos, Rinaldo Bellomo, Ken Hillman, Jack Chen, Simon Finfer, and Arthas Flabouris. 2008. Respiratory Rate: The Neglected Vital Sign. Medical Journal of Australia 188, 11 (2008), 657--659.Google ScholarCross Ref
- Dirk Cysarz, Silke Lange, Peter F Matthiessen, and Peter van Leeuwen. 2007. Regular Heartbeat Dynamics Are Associated with Cardiac Health. Am. J. Physiol 292, 1 (2007), R368-R372.Google ScholarCross Ref
- Daimler AG. 2019. Attention Assist: Drowsiness-Detection System Warns Drivers to Prevent Them Falling Asleep Momentarily -Daimler Global Media Site. https://media.daimler.com/marsMediaSite/en/instance/ko/ATTENTION-ASSIST-Drowsiness-detection-system-warns-drivers-to-prevent-them-falling-asleep-momentarily.xhtml?oid=9361586. Accessed: 2019-10-09.Google Scholar
- Chacko John Deepu, Zhihao Chen, Ju Teng Teo, Soon Huat Ng, Xiefeng Yang, and Yong Lian. 2012. A Smart Cushion for Real-Time Heart Rate Monitoring. In 2012 IEEE Biomedical Circuits and Systems Conference. 53--56.Google ScholarCross Ref
- Jason P DePasquale, E Scott Geller, Steven W Clarke, and Lawrence C Littleton. 2001. Measuring Road Rage: Development of The Propensity for Angry Driving Scale. J. Saf. Res. 32, 1 (2001), 1--16.Google ScholarCross Ref
- Konstantin Dragomiretskiy and Dominique Zosso. 2013. Variational Mode Decomposition. IEEE Transactions on Signal Processing 62, 3 (2013), 531--544.Google ScholarDigital Library
- Malcolm Elliott and Alysia Coventry. 2012. Critical Care: the Eight Vital Signs of Patient Monitoring. British Journal of Nursing 21, 10 (2012), 621--625.Google ScholarCross Ref
- Sigrid Elsenbruch, Michael J Harnish, and William C Orr. 1999. Heart Rate Variability During Waking and Sleep in Healthy Males and Females. Sleep 22, 8 (1999), 1067--1071.Google ScholarCross Ref
- Martin Eriksson and Nikolaos P Papanikotopoulos. 1997. Eye-Tracking for Detection of Driver Fatigue. In Proc. of Conference on Intelligent Transportation Systems. 314--319.Google ScholarCross Ref
- Gernot Ernst. 2017. Heart-Rate Variability-More than Heart Beats? Frontiers in Public Health 5 (2017), 240.Google ScholarCross Ref
- John F Fieselmann, Michael S Hendryx, Charles M Helms, and Douglas S Wakefield. 1993. Respiratory Rate Predicts Cardiopulmonary Arrest for Internal Medicine Inpatients. Journal of General Internal Medicine 8, 7 (1993), 354--360.Google ScholarCross Ref
- Diane Flatley, LA Reyner, and James A Horne. 2004. Sleep-Related Crashes on Sections of Different Road Types in the UK (1995-2001). Road Safety United States Naval School of Aviation Medicine 52 (2004).Google Scholar
- Koichi Fujiwara, Erika Abe, Keisuke Kamata, Chikao Nakayama, Yoko Suzuki, Toshitaka Yamakawa, Toshihiro Hiraoka, Manabu Kano, Yukiyoshi Sumi, Fumi Masuda, et al. 2018. Heart Rate Variability-Based Driver Drowsiness Detection and its Validation with EEG. IEEE Transactions on Biomedical Engineering 66, 6 (2018), 1769--1778.Google ScholarCross Ref
- Nicholas D Giardino, Seth D Friedman, and Stephen R Dager. 2007. Anxiety, Respiration, and Cerebral Blood Flow: Implications for Functional Brain Imaging. Comprehensive Psychiatry 48, 2 (2007), 103--112.Google ScholarCross Ref
- Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53.Google ScholarDigital Library
- Sinh Huynh, Rajesh Krishna Balan, JeongGil Ko, and Youngki Lee. 2019. VitaMon: Measuring Heart Rate Variability Using Smartphone Front Camera. In Proc. of the 17th ACM Sensys. 1--14.Google ScholarDigital Library
- P Jackson, C Hilditch, A Holmes, N Reed, N Merat, and L Smith. 2011. Fatigue and Road Safety: A Critical Analysis of Recent Evidence. Department for Transport, Road Safety Web Publication 21 (2011).Google Scholar
- Wenjia Jia, Hongjian Peng, Na Ruan, Zhiping Tang, and Wei Zhao. 2018. WiFind: Driver Fatigue Detection with Fine-Grained Wi-Fi Signal Features. IEEE Transactions on Big Data (2018), 1--14.Google Scholar
- Sang-Ho Jo, Jin-Myung Kim, and Dong Kyoo Kim. 2019. Heart Rate Change While Drowsy Driving. Journal of Korean Medical Science 34, 8 (2019).Google ScholarCross Ref
- Seong Kyu Leem, Faheem Khan, and Sung Ho Cho. 2017. Vital Sign Monitoring and Mobile Phone Usage Detection Using IR-UWB Radar for Intended Use in Car Crash Prevention. Sensors (2017).Google Scholar
- Gang Li, Boon-Leng Lee, and Wan-Young Chung. 2015. Smartwatch-based Wearable EEG System for Driver Drowsiness Detection. IEEE Sensors Journal 15, 12 (2015), 7169--7180.Google ScholarCross Ref
- Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proc. of the 17th ACM UbiComp 1, 3 (2017), 72.Google ScholarDigital Library
- H-O Lisper, Hans Laurell, and G Stening. 1973. Effects of Experience of The Driver on Heart-Rate, Respiration-Rate, and Subsidiary Reaction Time in A Three Hours Continuous Driving Task. Ergonomics 16, 4 (1973), 501--506.Google ScholarCross Ref
- Mohamed Faisal Lutfi. 2015. Patterns of Heart Rate Variability and Cardiac Autonomic Modulations in Controlled and Uncontrolled Asthmatic Patients. BMC Pulmonary Medicine 15, 1 (2015), 119.Google ScholarCross Ref
- Zahra Mardi, Seyedeh Naghmeh Miri Ashtiani, and Mohammad Mikaili. 2011. EEG-Based Drowsiness Detection for Safe Driving Using Chaotic Features and Statistical Tests. Journal of Medical Signals and Sensors 1, 2 (2011), 130.Google ScholarCross Ref
- Hermann Nabi, Martica Hall, Markku Koskenvuo, Archana Singh-Manoux, Tuula Oksanen, Sakari Suominen, Mika Kivimäki, and Jussi Vahtera. 2010. Psychological and Somatic Symptoms of Anxiety and Risk of Coronary Heart Disease: the Health and Social Support Prospective Cohort Study. Biological Psychiatry 67, 4 (2010), 378--385.Google ScholarCross Ref
- Novelda AS. 2017. Single-Chip Radar Sensors with Sub-mm Resolution - XETHRU. https://www.xethru.com/. Accessed: 2019-10-03.Google Scholar
- Novelda AS. 2017. XETHRU Sensor Emissions: An In-Depth Look at Radar Safety Regulations. https://www.xethru.com/blog/posts/xethru-radar-emission-comparison. Accessed: 2019-10-03.Google Scholar
- Mikito Ogino and Yasue Mitsukura. 2018. Portable Drowsiness Detection Through Use of A Prefrontal Single-Channel Electroencephalogram. Sensors 18, 12 (2018), 4477.Google ScholarCross Ref
- Jin-Kwan Park, Yunseog Hong, Hyunjae Lee, Chorom Jang, Gi-Ho Yun, Hee-Jo Lee, and Jong-Gwan Yook. 2019. Noncontact RF Vital Sign Sensor for Continuous Monitoring of Driver Status. IEEE Transactions on Biomedical Circuits and Systems 13, 3 (2019), 493--502.Google ScholarCross Ref
- Eduardo Pinheiro, Octavian Postolache, and Pedro Girão. 2010. Theory and Developments in An Unobtrusive Cardiovascular System Representation: Ballistocardiography. The Open Biomedical Engineering Journal 4 (2010), 201.Google ScholarCross Ref
- Harold R Raemer. 1996. Radar Systems Principles. CRC press.Google Scholar
- Raspberry Pi Foundation. 2019. Teach, Learn and Make with Raspberry Pi - Raspberry Pi. https://https://www.raspberrypi.org/. Accessed: 2019-10-03.Google Scholar
- Francesco Sessa, Valenzano Anna, Giovanni Messina, Giuseppe Cibelli, Vincenzo Monda, Gabriella Marsala, Maria Ruberto, Antonio Biondi, Orazio Cascio, Giuseppe Bertozzi, et al. 2018. Heart Rate Variability As Predictive Factor for Sudden Cardiac Death. Aging (Albany NY) 10, 2 (2018), 166.Google ScholarCross Ref
- Fred Shaffer and JP Ginsberg. 2017. An Overview of Heart Rate Variability Metrics and Norms. Frontiers in Public Health 5 (2017), 258.Google ScholarCross Ref
- Fred Shaffer, Rollin McCraty, and Christopher L Zerr. 2014. A Healthy Heart Is Not A Metronome: An Integrative Review of the Heart's Anatomy and Heart Rate Variability. Frontiers in Psychology 5 (2014), 1040.Google ScholarCross Ref
- Anupriya Sharma, NB Hirulkar, and Payal Ranka. 2011. Effect of Hyperglycemia on Electrolytes Imbalance. Int J Pharm Biol Arch 2 (2011), 526--33.Google Scholar
- José Solaz, José Laparra-Hernández, Daniel Bande, Noelia Rodríguez, Sergio Veleff, José Gerpe, and Enrique Medina. 2016. Drowsiness Detection Based on the Analysis of Breathing Rate Obtained from Real-Time Image Recognition. Transportation Research Procedia 14 (2016), 3867--3876.Google ScholarCross Ref
- Richard Strauß, Santiago Ewig, Klaus Richter, Thomas König, Günther Heller, and Torsten T Bauer. 2014. The Prognostic Significance of Respiratory Rate in Patients with Pneumonia: A Retrospective Analysis of Data from 705 928 Hospitalized Patients in Germany from 2010-2012. Deutsches Ärzteblatt International 111, 29-30 (2014), 503.Google Scholar
- Thomas J Sullivan, Stephen R Deiss, and Gert Cauwenberghs. 2007. A Low-Noise, Non-Contact EEG/ECG Sensor. In 2007 IEEE Biomedical Circuits and Systems Conference. 154--157.Google Scholar
- John L Troutman. 2012. Variational Calculus and Optimal Control: Optimization with Elementary Convexity. Springer Science & Business Media.Google Scholar
- Mihoko Tsunoda, Takuro Endo, Satoko Hashimoto, Sato Honma, and Ken-Ichi Honma. 2001. Effects of Light and Sleep Stages on Heart Rate Variability in Humans. Psychiatry and Clinical Neurosciences 55, 3 (2001), 285--286.Google ScholarCross Ref
- Volvo Group. 2019. Driver Alert System. https://www.volvocars.com/en-th/support/manuals/s60/2014/driver-support/driver-alert-system/driver-alert-control-dac---operation. Accessed: 2019-10-09.Google Scholar
- Chuyu Wang, Lei Xie, Wei Wang, Yingying Chen, Yanling Bu, and Sanglu Lu. 2018. RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array. Proc. of the 17th ACM UbiComp 2, 2 (2018), 85.Google ScholarDigital Library
- Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. Proc. of the 17th ACM UbiComp 1, 4 (2018), 170.Google ScholarDigital Library
- WS Waring, JY Rhee, DN Bateman, GE Leggett, and H Jamie. 2008. Impaired Heart Rate Variability and Altered Cardiac Sympathovagal Balance After Antidepressant Overdose. European Journal of Clinical Pharmacology 64, 11 (2008), 1037--1041.Google ScholarCross Ref
- Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55, 10 (2017), 91--97.Google ScholarCross Ref
- Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Linghe Kong, and Minglu Li. 2019. BreathListener: Fine-Grained Breathing Monitoring in Driving Environments Utilizing Acoustic Signals. In Proc. of the 17th ACM MobiSys. 54--66.Google ScholarDigital Library
- Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals. Proc. of the 18th ACM UbiComp 2, 3 (2018), 148.Google ScholarDigital Library
- Jin Zhang, Weitao Xu, Wen Hu, and Salil S Kanhere. 2017. WiCare: Towards In-Situ Breath Monitoring. In Proc. of the 14th ACM MobiQuitous. ACM, 126--135.Google ScholarDigital Library
- Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion Recognition Using Wireless Signals. In Proc. of the 22nd ACM MobiCom. 95--108.Google ScholarDigital Library
Index Terms
- V2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing
Recommendations
PigV2: Monitoring Pig Vital Signs through Ground Vibrations Induced by Heartbeat and Respiration
SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor SystemsPig vital sign monitoring (e.g., estimating the heart rate (HR) and respiratory rate (RR)) is essential to understand the stress level of the sow and detect the onset of parturition. It helps to maximize peri-natal survival and improve animal well-being ...
A Contactless and Non-Intrusive System for Driver's Stress Detection
UbiComp/ISWC '23 Adjunct: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable ComputingStress plays a significant role in fatal accidents, highlighting the importance of timely monitoring of driver stress to facilitate effective interventions and reduce road accidents. However, monitoring driver stress presents numerous challenges in the ...
Bi-modal transducer-based wearable system for cardiac monitoring
BioMed'06: Proceedings of the 24th IASTED international conference on Biomedical engineeringThis paper reports investigation on bi-modal piezoelectric transducer used both as an active ultrasound transceiver and passive acoustic sensor. [1]The transducer, which should have a low Q factor in order to exhibit a sufficiently broad bandwidth, is ...
Comments