Qifan Pu
Sidhant Gupta
Shyamnath Gollakota
Shwetak Patel
ABSTRACT
This paper presents WiSee, a novel gesture recognition system that leverages wireless signals (e.g., Wi-Fi) to enable whole-home sensing and recognition of human gestures. Since wireless signals do not require line-of-sight and can traverse through walls, WiSee can enable whole-home gesture recognition using few wireless sources. Further, it achieves this goal without requiring instrumentation of the human body with sensing devices. We implement a proof-of-concept prototype of WiSee using USRP-N210s and evaluate it in both an office environment and a two- bedroom apartment. Our results show that WiSee can identify and classify a set of nine gestures with an average accuracy of 94%.
- ACQUITEK Inc. Fury GPS Disciplined Frequency Standard.Google Scholar
- R. Block. Toshiba Qosmio G55 features SpursEngine, Visual Gesture Controls.Google Scholar
- W. Carrara, R. Goodman, and R. Majewski. Spotlight Synthetic Aperture Radar: Signal Processing Algorithms. Artech House, 1995.Google Scholar
- G. Charvat, L. Kempel, E. Rothwell, C. Coleman, and E. Mokole. A Through-dielectric Radar Imaging System. In Trans. Antennas and Propagation, 2010.Google Scholar
- K. Chetty, G. Smith, and K. Woodbridge. Through-the-wall Sensing of Personnel Using Passive Bistatic WiFi Radar at Standoff Distances. In Trans. Geoscience and Remote Sensing, 2012.Google Scholar
- K. Chintalapudi, A. Iyer, and V. Padmanaban. Indoor Localization without the Pain. In NSDI, 2011.Google Scholar
- J. Choi, M. Jain, K. Srinivasan, P. Levis, and S. Katti. Achieving single channel full duplex wireless communication. In Mobicom'10. Google ScholarDigital Library
- G. Cohn, D. Morris, S. Patel, and D. Tan. Humantenna: using the body as an antenna for real-time whole-body interaction. In CHI'12. Google ScholarDigital Library
- M. Fisher. Sweet Moves: Gestures and Motion-Based Controls on the Galaxy S III.Google Scholar
- S. Gollakota, F. Adib, D. Katabi, and S. Seshan. Clearing the RF Smog: Making 802.11 Robust to Cross-Technology Interference. In SIGCOMM,2011. Google ScholarDigital Library
- S. Gollakota and D. Katabi. Zigzag decoding: combating hidden terminals in wireless networks. In ACM SIGCOMM, 2008. Google ScholarDigital Library
- S. Gupta, D. Morris, S. Patel, and D. Tan. Soundwave: using the doppler effect to sense gestures. In HCI 2012. Google ScholarDigital Library
- C. Harrison, D. Tan, and D. Morris. Skinput: appropriating the body as an input surface. In CHI 2010. Google ScholarDigital Library
- D. Kim, O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Olivier. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In UIST 2012. Google ScholarDigital Library
- Y. Kim and H. Ling. Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine. In Trans. Geoscience and Remote Sensing, 2012.Google Scholar
- K. Lin, S. Gollakota, and D. Katabi. Random Access Heterogeneous MIMO Networks. In SIGCOMM, 2011. Google ScholarDigital Library
- J. Paradiso, C. Abler, K.-y. Hsiao, and M. Reynolds. The magic carpet: physical sensing for immersive environments. In CHI, 1997. Google ScholarDigital Library
- T. Ralston, G. Charvat, and J. Peabody. Real-time through-wall imaging using an ultrawideband MIMO phased array radar system. In Array, 2010.Google Scholar
- A. Santos. Pioneer's latest Raku Navi GPS units take commands from hand gestures.Google Scholar
- M. Scholz, S. Sigg, H. R. Schmidkte, and M. Beigl. Challenges for device-free radio-based activity recognition. In CoSDEO workshop, 2007.Google Scholar
- S. Sen, B. Radunovic, R. R. Choudhury, and T. Minka. Spot localization using PHY layer information . In Mobisys, 2012. Google ScholarDigital Library
- J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In CVPR, 2011. Google ScholarDigital Library
- K. Tan, J. Fang, Y. Zhang, S. Chen, L. Shi, J. Zhang, and Y. Zhang. Fine-grained Channel Access in Wireles LAN. In SIGCOMM, 2010. Google ScholarDigital Library
- J. Wilson and N. Patwari. Radio Tomographic Imaging with Wireless Networks. In Trans. Mobile Computing, 2009. Google ScholarDigital Library
- J. Wilson and N. Patwari. Through-Wall Motion Tracking Using Variance-Based Radio Tomography Networks. In ARXIV, 2009.Google Scholar
- J. Xiong and K. Jamieson. Towards fine-grained radio-based indoor location. In HotMobile, 2012. Google ScholarDigital Library
- J. Xiong and K. Jamieson. ArrayTrack: A Fine-Grained Indoor Location System. In NSDI, 2013. Google ScholarDigital Library
- M. Youssef, M. Mah, and A. Agrawala. Challenges: Device-free passive localization for wireless environments. In Mobicom, 2007. Google ScholarDigital Library
- Y. Zhao and N. Patwari. Robust Estimators for Variance-Based Device-Free Localization and Tracking. In ARXIV, 2011.Google Scholar
Index Terms
- Whole-home gesture recognition using wireless signals
Recommendations
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Towards Robust Gesture Recognition by Characterizing the Sensing Quality of WiFi Signals
WiFi-based gesture recognition emerges in recent years and attracts extensive attention from researchers. Recognizing gestures via WiFi signal is feasible because a human gesture introduces a time series of variations to the received raw signal. The ...
Hand posture and gesture recognition technology
Hand gestures that are performed by one or two hands can be categorized according to their applications into different categories including conversational, controlling, manipulative and communicative gestures. Generally, hand gesture recognition aims to ...
Comments