skip to main content
research-article

ObstacleWatch: Acoustic-based Obstacle Collision Detection for Pedestrian Using Smartphone

Authors Info & Claims
Published:27 December 2018Publication History
Skip Abstract Section

Abstract

Walking while using a smartphone is becoming a major pedestrian safety concern as people may unknowingly bump into various obstacles that could lead to severe injuries. In this paper, we propose ObstacleWatch, an acoustic-based obstacle collision detection system to improve the safety of pedestrians who are engaged in smartphone usage while walking. ObstacleWatch leverages the advanced audio hardware of the smartphone to sense the surrounding obstacles and infers fine-grained information about the frontal obstacle for collision detection. In particular, our system emits well-designed inaudible beep signals from the smartphone built-in speaker and listens to the reflections with the stereo recording of the smartphone. By analyzing the reflected signals received at two microphones, ObstacleWatch is able to extract fine-grained information of the frontal obstacle including the distance, angle and size for detecting the possible collisions and to alert users. Our experimental evaluation under two real-world environments with different types of phones and obstacles shows that ObstacleWatch achieves over 92% accuracy in predicting obstacle collisions with distance estimation errors at about 2 cm. Results also show that ObstacleWatch is robust to different sizes of objects and is compatible to different phone models with low energy consumption.

References

  1. 2018. New cars are quickly getting self-driving safety features. (Mar 2018). http://saudigazette.com.sa/article/531372/Life/Drive/New-cars-are-quickly-getting-self-driving-safety-featuresGoogle ScholarGoogle Scholar
  2. Corey H Basch, Danna Ethan, Sonali Rajan, and Charles E Basch. 2014. Technology-related distracted walking behaviours in Manhattan's most dangerous intersections. Injury prevention (2014), injuryprev--2013.Google ScholarGoogle Scholar
  3. Yiu-Tong Chan and JJ Towers. 1992. Passive localization from Doppler-shifted frequency measurements. IEEE Transactions on Signal Processing 40, 10 (1992), 2594--2598. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Klaus David and Alexander Flach. 2010. Car-2-x and pedestrian safety. IEEE Vehicular Technology Magazine 5, 1 (2010), 70--76.Google ScholarGoogle ScholarCross RefCross Ref
  5. Education.com. 2013. The High Frequency Hearing Test. https://www.scientificamerican.com/article/bring-science-home-high-frequency-hearing/. (2013).Google ScholarGoogle Scholar
  6. Edward C Farnett and George H Stevens. 1990. Pulse compression radar. Radar handbook 2 (1990), 10--1.Google ScholarGoogle Scholar
  7. Alexander Flach and Klaus David. 2010. Combining radio transmission with filters for pedestrian safety: Experiments and simulations. In Vehicular Technology Conference Fall (VTC 2010-Fall), 2010 IEEE 72nd. IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  8. Tarak Gandhi and Mohan Manubhai Trivedi. 2007. Pedestrian protection systems: Issues, survey, and challenges. IEEE Transactions on intelligent Transportation systems 8, 3 (2007), 413--430. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Bill Howard. 2014. Ford and Honda stop collisions before they happen with pedestrian detection. (Oct 2014). http://www.extremetech.com/extreme/192863-ford-and-honda-stop-collisions-before-they-happen-with-pedestrian-detectionGoogle ScholarGoogle Scholar
  10. Tsuyoshi Ishikawa and Kaori Fujinami. 2016. Smartphone-Based Pedestrian's Avoidance Behavior Recognition towards Opportunistic Road Anomaly Detection. ISPRS International Journal of Geo-Information 5, 10 (2016), 182.Google ScholarGoogle ScholarCross RefCross Ref
  11. Shubham Jain, Carlo Borgiattino, Yanzhi Ren, Marco Gruteser, Yingying Chen, and Carla Fabiana Chiasserini. 2015. Lookup: Enabling pedestrian safety services via shoe sensing. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 257--271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Shubham Jain and Marco Gruteser. 2017. Recognizing Textures with Mobile Cameras for Pedestrian Safety Applications. arXiv preprint arXiv:1711.00558 (2017).Google ScholarGoogle Scholar
  13. Kiran Raj Joshi, Steven Siying Hong, and Sachin Katti. 2013. PinPoint: Localizing Interfering Radios.. In NSDI. 241--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Keunseo Kim, Hengameh Zabihi, Heeyoung Kim, and Uichin Lee. 2017. TrailSense: A Crowdsensing System for Detecting Risky Mountain Trail Segments with Walking Pattern Analysis. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. John R Klauder, AC Price, Sidney Darlington, and Walter J Albersheim. 1960. The theory and design of chirp radars. Bell Labs Technical Journal 39, 4 (1960), 745--808.Google ScholarGoogle ScholarCross RefCross Ref
  16. Nicholas D Lane, Yohan Chon, Lin Zhou, Yongzhe Zhang, Fan Li, Dongwon Kim, Guanzhong Ding, Feng Zhao, and Hojung Cha. 2013. Piggyback CrowdSensing (PCS): energy efficient crowdsourcing of mobile sensor data by exploiting smartphone app opportunities. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. ACM, 7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Sugang Li, Xiaoran Fan, Yanyong Zhang, Wade Trappe, Janne Lindqvist, and Richard E Howard. 2017. Auto++: Detecting Cars Using Embedded Microphones in Real-Time. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Chi-Han Lin, Yi-Ting Chen, Jyun-Jie Chen, Wen-Chan Shih, and Wen-Tsuen Chen. 2016. psafety: A collision prevention system for pedestrians using smartphone. In Vehicular Technology Conference (VTC-Fall), 2016 IEEE 84th. IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  19. Jian Liu, Yan Wang, Gorkem Kar, Yingying Chen, Jie Yang, and Marco Gruteser. 2015. Snooping keystrokes with mm-level audio ranging on a single phone. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 142--154. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Xuefeng Liu, Jiannong Cao, Jiaqi Wen, and Shaojie Tang. 2017. Infrasee: An unobtrusive alertness system for pedestrian mobile phone users. IEEE Transactions on Mobile Computing 16, 2 (2017), 394--407. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Wenguang Mao, Mei Wang, and Lili Qiu. 2018. AIM: Acoustic Imaging on a Mobile. (2018).Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Satish Mohan, Michael E Lockwood, Michael L Kramer, and Douglas L Jones. 2008. Localization of multiple acoustic sources with small arrays using a coherence test. The Journal of the Acoustical Society of America 123, 4 (2008), 2136--2147.Google ScholarGoogle ScholarCross RefCross Ref
  23. Judith Mwakalonge, Saidi Siuhi, and Jamario White. 2015. Distracted walking: examining the extent to pedestrian safety problems. Journal of traffic and transportation engineering (English edition) 2, 5 (2015), 327--337.Google ScholarGoogle ScholarCross RefCross Ref
  24. Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 45--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1515--1525. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Rajalakshmi Nandakumar, Alex Takakuwa, Tadayoshi Kohno, and Shyamnath Gollakota. 2017. Covertband: Activity information leakage using music. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jack L Nasar and Derek Troyer. 2013. Pedestrian injuries due to mobile phone use in public places. Accident Analysis & Prevention 57 (2013), 91--95.Google ScholarGoogle ScholarCross RefCross Ref
  28. Dragoş Niculescu and Badri Nath. 2004. VOR base stations for indoor 802.11 positioning. In Proceedings of the 10th annual international conference on Mobile computing and networking. ACM, 58--69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. Beepbeep: a high accuracy acoustic ranging system using cots mobile devices. In Proceedings of the 5th international conference on Embedded networked sensor systems. ACM, 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Z Riaz, DJ Edwards, and A Thorpe. 2006. SightSafety: A hybrid information and communication technology system for reducing vehicle/pedestrian collisions. Automation in construction 15, 6 (2006), 719--728.Google ScholarGoogle Scholar
  31. HC Schau and AZ Robinson. 1987. Passive source localization employing intersecting spherical surfaces from time-of-arrival differences. IEEE Transactions on Acoustics, Speech, and Signal Processing 35, 8 (1987), 1223--1225.Google ScholarGoogle ScholarCross RefCross Ref
  32. Despina Stavrinos, Katherine W Byington, and David C Schwebel. 2011. Distracted walking: cell phones increase injury risk for college pedestrians. Journal of safety research 42, 2 (2011), 101--107.Google ScholarGoogle ScholarCross RefCross Ref
  33. Anand Prabhu Subramanian, Pralhad Deshpande, Jie Gao, and Samir R Das. 2008. Drive-by localization of roadside WiFi networks. In INFOCOM 2008. The 27th Conference on Computer Communications. IEEE. IEEE, 718--725.Google ScholarGoogle ScholarCross RefCross Ref
  34. Maozhi Tang, Cam-Tu Nguyen, Xiaoliang Wang, and Sanglu Lu. 2016. An efficient walking safety service for distracted mobile users. In Mobile Ad Hoc and Sensor Systems (MASS), 2016 IEEE 13th International Conference on. IEEE, 84--91.Google ScholarGoogle ScholarCross RefCross Ref
  35. Leah L Thompson, Frederick P Rivara, Rajiv C Ayyagari, and Beth E Ebel. 2013. Impact of social and technological distraction on pedestrian crossing behaviour: an observational study. Injury prevention 19, 4 (2013), 232--237.Google ScholarGoogle Scholar
  36. Martin Tomitsch and Adrian B. Ellison. 2018. Pedestrian safety needs to catch up to technology and put people before cars. (May 2018). http://theconversation.com/pedestrian-safety-needs-to-catch-up-to-technology-and-put-people-before-cars-65225Google ScholarGoogle Scholar
  37. Yu-Chih Tung and Kang G Shin. 2017. Use of Phone Sensors to Enhance Distracted Pedestrians' Safety. IEEE Transactions on Mobile Computing (2017).Google ScholarGoogle Scholar
  38. Nisha Vinayaga-Sureshkanth, Anindya Maiti, Murtuza Jadliwala, Kirsten Crager, Jibo He, and Heena Rathore. 2017. Towards a Practical Pedestrian Distraction Detection Framework using Wearables. arXiv preprint arXiv:1710.03755 (2017).Google ScholarGoogle Scholar
  39. Christian Voigtmann, Sian Lun Lau, and Klaus David. 2012. Evaluation of a collaborative-based filter technique to proactively detect pedestrians at risk. In Vehicular Technology Conference (VTC Fall), 2012 IEEE. IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  40. Tianyu Wang, Giuseppe Cardone, Antonio Corradi, Lorenzo Torresani, and Andrew T Campbell. 2012. WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads. In Proceedings of the twelfth workshop on mobile computing systems & applications. ACM, 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Jiaqi Wen, Jiannong Cao, and Xuefeng Liu. 2015. We help you watch your steps: Unobtrusive alertness system for pedestrian mobile phone users. In Pervasive Computing and Communications (PerCom), 2015 IEEE International Conference on. IEEE, 105--113.Google ScholarGoogle ScholarCross RefCross Ref
  42. Slamet Widodo, Tomoo Shiigi, Naoki Hayashi, Hideo Kikuchi, Keigo Yanagida, Yoshiaki Nakatsuchi, Yuichi Ogawa, and Naoshi Kondo. 2013. Moving object localization using sound-based positioning system with doppler shift compensation. Robotics 2, 2 (2013), 36--53.Google ScholarGoogle ScholarCross RefCross Ref
  43. Jie Xiong and Kyle Jamieson. 2013. Arraytrack: a fine-grained indoor location system. Usenix.Google ScholarGoogle Scholar
  44. Jie Yang, Simon Sidhom, Gayathri Chandrasekaran, Tam Vu, Hongbo Liu, Nicolae Cecan, Yingying Chen, Marco Gruteser, and Richard P Martin. 2011. Detecting driver phone use leveraging car speakers. In Proceedings of the 17th annual international conference on Mobile computing and networking. ACM, 97--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Wenyi Zhang and Bhaskar D Rao. 2010. A two microphone-based approach for source localization of multiple speech sources. IEEE Transactions on Audio, Speech, and Language Processing 18, 8 (2010), 1913--1928.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Zengbin Zhang, Xia Zhou, Weile Zhang, Yuanyang Zhang, Gang Wang, Ben Y Zhao, and Haitao Zheng. 2011. I am the antenna: accurate outdoor AP location using smartphones. In Proceedings of the 17th annual international conference on Mobile computing and networking. ACM, 109--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Xiaojun Zhu, Qun Li, and Guihai Chen. 2013. APT: Accurate outdoor pedestrian tracking with smartphones. In INFOCOM, 2013 Proceedings IEEE. IEEE, 2508--2516.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. ObstacleWatch: Acoustic-based Obstacle Collision Detection for Pedestrian Using Smartphone

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 4
      December 2018
      1169 pages
      EISSN:2474-9567
      DOI:10.1145/3301777
      Issue’s Table of Contents

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 December 2018
      • Accepted: 1 October 2018
      • Revised: 1 July 2018
      • Received: 1 May 2018
      Published in imwut Volume 2, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader