Abstract
Walking while using a smartphone is becoming a major pedestrian safety concern as people may unknowingly bump into various obstacles that could lead to severe injuries. In this paper, we propose ObstacleWatch, an acoustic-based obstacle collision detection system to improve the safety of pedestrians who are engaged in smartphone usage while walking. ObstacleWatch leverages the advanced audio hardware of the smartphone to sense the surrounding obstacles and infers fine-grained information about the frontal obstacle for collision detection. In particular, our system emits well-designed inaudible beep signals from the smartphone built-in speaker and listens to the reflections with the stereo recording of the smartphone. By analyzing the reflected signals received at two microphones, ObstacleWatch is able to extract fine-grained information of the frontal obstacle including the distance, angle and size for detecting the possible collisions and to alert users. Our experimental evaluation under two real-world environments with different types of phones and obstacles shows that ObstacleWatch achieves over 92% accuracy in predicting obstacle collisions with distance estimation errors at about 2 cm. Results also show that ObstacleWatch is robust to different sizes of objects and is compatible to different phone models with low energy consumption.
- 2018. New cars are quickly getting self-driving safety features. (Mar 2018). http://saudigazette.com.sa/article/531372/Life/Drive/New-cars-are-quickly-getting-self-driving-safety-featuresGoogle Scholar
- Corey H Basch, Danna Ethan, Sonali Rajan, and Charles E Basch. 2014. Technology-related distracted walking behaviours in Manhattan's most dangerous intersections. Injury prevention (2014), injuryprev--2013.Google Scholar
- Yiu-Tong Chan and JJ Towers. 1992. Passive localization from Doppler-shifted frequency measurements. IEEE Transactions on Signal Processing 40, 10 (1992), 2594--2598. Google ScholarDigital Library
- Klaus David and Alexander Flach. 2010. Car-2-x and pedestrian safety. IEEE Vehicular Technology Magazine 5, 1 (2010), 70--76.Google ScholarCross Ref
- Education.com. 2013. The High Frequency Hearing Test. https://www.scientificamerican.com/article/bring-science-home-high-frequency-hearing/. (2013).Google Scholar
- Edward C Farnett and George H Stevens. 1990. Pulse compression radar. Radar handbook 2 (1990), 10--1.Google Scholar
- Alexander Flach and Klaus David. 2010. Combining radio transmission with filters for pedestrian safety: Experiments and simulations. In Vehicular Technology Conference Fall (VTC 2010-Fall), 2010 IEEE 72nd. IEEE, 1--5.Google ScholarCross Ref
- Tarak Gandhi and Mohan Manubhai Trivedi. 2007. Pedestrian protection systems: Issues, survey, and challenges. IEEE Transactions on intelligent Transportation systems 8, 3 (2007), 413--430. Google ScholarDigital Library
- Bill Howard. 2014. Ford and Honda stop collisions before they happen with pedestrian detection. (Oct 2014). http://www.extremetech.com/extreme/192863-ford-and-honda-stop-collisions-before-they-happen-with-pedestrian-detectionGoogle Scholar
- Tsuyoshi Ishikawa and Kaori Fujinami. 2016. Smartphone-Based Pedestrian's Avoidance Behavior Recognition towards Opportunistic Road Anomaly Detection. ISPRS International Journal of Geo-Information 5, 10 (2016), 182.Google ScholarCross Ref
- Shubham Jain, Carlo Borgiattino, Yanzhi Ren, Marco Gruteser, Yingying Chen, and Carla Fabiana Chiasserini. 2015. Lookup: Enabling pedestrian safety services via shoe sensing. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 257--271. Google ScholarDigital Library
- Shubham Jain and Marco Gruteser. 2017. Recognizing Textures with Mobile Cameras for Pedestrian Safety Applications. arXiv preprint arXiv:1711.00558 (2017).Google Scholar
- Kiran Raj Joshi, Steven Siying Hong, and Sachin Katti. 2013. PinPoint: Localizing Interfering Radios.. In NSDI. 241--253. Google ScholarDigital Library
- Keunseo Kim, Hengameh Zabihi, Heeyoung Kim, and Uichin Lee. 2017. TrailSense: A Crowdsensing System for Detecting Risky Mountain Trail Segments with Walking Pattern Analysis. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 65. Google ScholarDigital Library
- John R Klauder, AC Price, Sidney Darlington, and Walter J Albersheim. 1960. The theory and design of chirp radars. Bell Labs Technical Journal 39, 4 (1960), 745--808.Google ScholarCross Ref
- Nicholas D Lane, Yohan Chon, Lin Zhou, Yongzhe Zhang, Fan Li, Dongwon Kim, Guanzhong Ding, Feng Zhao, and Hojung Cha. 2013. Piggyback CrowdSensing (PCS): energy efficient crowdsourcing of mobile sensor data by exploiting smartphone app opportunities. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. ACM, 7. Google ScholarDigital Library
- Sugang Li, Xiaoran Fan, Yanyong Zhang, Wade Trappe, Janne Lindqvist, and Richard E Howard. 2017. Auto++: Detecting Cars Using Embedded Microphones in Real-Time. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 70. Google ScholarDigital Library
- Chi-Han Lin, Yi-Ting Chen, Jyun-Jie Chen, Wen-Chan Shih, and Wen-Tsuen Chen. 2016. psafety: A collision prevention system for pedestrians using smartphone. In Vehicular Technology Conference (VTC-Fall), 2016 IEEE 84th. IEEE, 1--5.Google ScholarCross Ref
- Jian Liu, Yan Wang, Gorkem Kar, Yingying Chen, Jie Yang, and Marco Gruteser. 2015. Snooping keystrokes with mm-level audio ranging on a single phone. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 142--154. Google ScholarDigital Library
- Xuefeng Liu, Jiannong Cao, Jiaqi Wen, and Shaojie Tang. 2017. Infrasee: An unobtrusive alertness system for pedestrian mobile phone users. IEEE Transactions on Mobile Computing 16, 2 (2017), 394--407. Google ScholarDigital Library
- Wenguang Mao, Mei Wang, and Lili Qiu. 2018. AIM: Acoustic Imaging on a Mobile. (2018).Google ScholarDigital Library
- Satish Mohan, Michael E Lockwood, Michael L Kramer, and Douglas L Jones. 2008. Localization of multiple acoustic sources with small arrays using a coherence test. The Journal of the Acoustical Society of America 123, 4 (2008), 2136--2147.Google ScholarCross Ref
- Judith Mwakalonge, Saidi Siuhi, and Jamario White. 2015. Distracted walking: examining the extent to pedestrian safety problems. Journal of traffic and transportation engineering (English edition) 2, 5 (2015), 327--337.Google ScholarCross Ref
- Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 45--57. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1515--1525. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Alex Takakuwa, Tadayoshi Kohno, and Shyamnath Gollakota. 2017. Covertband: Activity information leakage using music. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 87. Google ScholarDigital Library
- Jack L Nasar and Derek Troyer. 2013. Pedestrian injuries due to mobile phone use in public places. Accident Analysis & Prevention 57 (2013), 91--95.Google ScholarCross Ref
- Dragoş Niculescu and Badri Nath. 2004. VOR base stations for indoor 802.11 positioning. In Proceedings of the 10th annual international conference on Mobile computing and networking. ACM, 58--69. Google ScholarDigital Library
- Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. Beepbeep: a high accuracy acoustic ranging system using cots mobile devices. In Proceedings of the 5th international conference on Embedded networked sensor systems. ACM, 1--14. Google ScholarDigital Library
- Z Riaz, DJ Edwards, and A Thorpe. 2006. SightSafety: A hybrid information and communication technology system for reducing vehicle/pedestrian collisions. Automation in construction 15, 6 (2006), 719--728.Google Scholar
- HC Schau and AZ Robinson. 1987. Passive source localization employing intersecting spherical surfaces from time-of-arrival differences. IEEE Transactions on Acoustics, Speech, and Signal Processing 35, 8 (1987), 1223--1225.Google ScholarCross Ref
- Despina Stavrinos, Katherine W Byington, and David C Schwebel. 2011. Distracted walking: cell phones increase injury risk for college pedestrians. Journal of safety research 42, 2 (2011), 101--107.Google ScholarCross Ref
- Anand Prabhu Subramanian, Pralhad Deshpande, Jie Gao, and Samir R Das. 2008. Drive-by localization of roadside WiFi networks. In INFOCOM 2008. The 27th Conference on Computer Communications. IEEE. IEEE, 718--725.Google ScholarCross Ref
- Maozhi Tang, Cam-Tu Nguyen, Xiaoliang Wang, and Sanglu Lu. 2016. An efficient walking safety service for distracted mobile users. In Mobile Ad Hoc and Sensor Systems (MASS), 2016 IEEE 13th International Conference on. IEEE, 84--91.Google ScholarCross Ref
- Leah L Thompson, Frederick P Rivara, Rajiv C Ayyagari, and Beth E Ebel. 2013. Impact of social and technological distraction on pedestrian crossing behaviour: an observational study. Injury prevention 19, 4 (2013), 232--237.Google Scholar
- Martin Tomitsch and Adrian B. Ellison. 2018. Pedestrian safety needs to catch up to technology and put people before cars. (May 2018). http://theconversation.com/pedestrian-safety-needs-to-catch-up-to-technology-and-put-people-before-cars-65225Google Scholar
- Yu-Chih Tung and Kang G Shin. 2017. Use of Phone Sensors to Enhance Distracted Pedestrians' Safety. IEEE Transactions on Mobile Computing (2017).Google Scholar
- Nisha Vinayaga-Sureshkanth, Anindya Maiti, Murtuza Jadliwala, Kirsten Crager, Jibo He, and Heena Rathore. 2017. Towards a Practical Pedestrian Distraction Detection Framework using Wearables. arXiv preprint arXiv:1710.03755 (2017).Google Scholar
- Christian Voigtmann, Sian Lun Lau, and Klaus David. 2012. Evaluation of a collaborative-based filter technique to proactively detect pedestrians at risk. In Vehicular Technology Conference (VTC Fall), 2012 IEEE. IEEE, 1--5.Google ScholarCross Ref
- Tianyu Wang, Giuseppe Cardone, Antonio Corradi, Lorenzo Torresani, and Andrew T Campbell. 2012. WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads. In Proceedings of the twelfth workshop on mobile computing systems & applications. ACM, 5. Google ScholarDigital Library
- Jiaqi Wen, Jiannong Cao, and Xuefeng Liu. 2015. We help you watch your steps: Unobtrusive alertness system for pedestrian mobile phone users. In Pervasive Computing and Communications (PerCom), 2015 IEEE International Conference on. IEEE, 105--113.Google ScholarCross Ref
- Slamet Widodo, Tomoo Shiigi, Naoki Hayashi, Hideo Kikuchi, Keigo Yanagida, Yoshiaki Nakatsuchi, Yuichi Ogawa, and Naoshi Kondo. 2013. Moving object localization using sound-based positioning system with doppler shift compensation. Robotics 2, 2 (2013), 36--53.Google ScholarCross Ref
- Jie Xiong and Kyle Jamieson. 2013. Arraytrack: a fine-grained indoor location system. Usenix.Google Scholar
- Jie Yang, Simon Sidhom, Gayathri Chandrasekaran, Tam Vu, Hongbo Liu, Nicolae Cecan, Yingying Chen, Marco Gruteser, and Richard P Martin. 2011. Detecting driver phone use leveraging car speakers. In Proceedings of the 17th annual international conference on Mobile computing and networking. ACM, 97--108. Google ScholarDigital Library
- Wenyi Zhang and Bhaskar D Rao. 2010. A two microphone-based approach for source localization of multiple speech sources. IEEE Transactions on Audio, Speech, and Language Processing 18, 8 (2010), 1913--1928.Google ScholarDigital Library
- Zengbin Zhang, Xia Zhou, Weile Zhang, Yuanyang Zhang, Gang Wang, Ben Y Zhao, and Haitao Zheng. 2011. I am the antenna: accurate outdoor AP location using smartphones. In Proceedings of the 17th annual international conference on Mobile computing and networking. ACM, 109--120. Google ScholarDigital Library
- Xiaojun Zhu, Qun Li, and Guihai Chen. 2013. APT: Accurate outdoor pedestrian tracking with smartphones. In INFOCOM, 2013 Proceedings IEEE. IEEE, 2508--2516.Google ScholarCross Ref
Index Terms
- ObstacleWatch: Acoustic-based Obstacle Collision Detection for Pedestrian Using Smartphone
Recommendations
Acoussist: An Acoustic Assisting Tool for People with Visual Impairments to Cross Uncontrolled Streets
To cross uncontrolled roadways, where no traffic-halting signal devices are present, pedestrians with visual impairments must rely on their other senses to detect oncoming vehicles and estimate the correct crossing interval in order to avoid potentially ...
Robust speaker localization for real-world robots
HighlightsWe look at the acoustic localization for real-world robots and conditions.We investigate the role of the microphones characteristics in the acoustic localization.We propose a time delay estimation smoothing which is based on the signal ...
Estimation of a nonvisible field-of-view mobile target incorporating optical and acoustic sensors
This paper presents a nonvisible field-of-view (NFOV) target estimation approach that incorporates optical and acoustic sensors. An optical sensor can accurately localize a target in its field-of-view whereas the acoustic sensor could estimate the ...
Comments