He Wang
ABSTRACT
This paper develops techniques using which humans can be visually recognized. While face recognition would be one approach to this problem, we believe that it may not be always possible to see a person?s face. Our technique is complementary to face recognition, and exploits the intuition that human motion patterns and clothing colors can together encode several bits of information. Treating this information as a "temporary fingerprint", it may be feasible to recognize an individual with reasonable consistency, while allowing her to turn off the fingerprint at will.
One application of visual fingerprints relates to augmented reality, in which an individual looks at other people through her camera-enabled glass (e.g., Google Glass) and views information about them. Another application is in privacy-preserving pictures ? Alice should be able to broadcast her "temporary fingerprint" to all cameras in the vicinity along with a privacy preference, saying "remove me". If a stranger?s video happens to include Alice, the device can recognize her fingerprint in the video and erase her completely. This paper develops the core visual fingerprinting engine ? InSight ? on the platform of Android smartphones and a backend server running MATLAB and OpenCV. Results from real world experiments show that 12 individuals can be discriminated with 90% accuracy using 6 seconds of video/motion observations. Video based emulation confirms scalability up to 40 users.
- Qualcomm Vuforia. https://www.qualcomm.com/products/vuforia.Google Scholar
- Videoguide, Antoni Gaudi Modernist Museum in Barcelona. http://www.casabatllo.es/en/visit/videoguide.Google Scholar
- A. Ashok, M. Gruteser, N. Mandayam, J. Silva, M. Varga, and K. Dana. Challenge: mobile optical networks through visual MIMO. In ACM MobiCom, pages 105--112, 2010. Google ScholarDigital Library
- L. Bao and S. S. Intille. Activity recognition from user-annotated acceleration data. In Pervasive Computing, pages 1--17, 2004.Google ScholarCross Ref
- S. T. Birchfield and S. Rangarajan. Spatiograms versus histograms for region-based tracking. IEEE CVPR, 2:1158--1163, 2005. Google ScholarDigital Library
- C. Bo, G. Shen, J. Liu, X. Li, Y. Zhang, and F. Zhao. Privacy.tag: Privacy concern expressed and respected. In ACM SenSys, pages 163--176, 2014. Google ScholarDigital Library
- K. W. Bowyer. Face recognition technology: security versus privacy. IEEE Technology and Society Magazine, 23(1):9--19, 2004.Google ScholarCross Ref
- M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. Van Gool. Online multiperson tracking-by-detection from a single, uncalibrated camera. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(9):1820--1833, 2011. Google ScholarDigital Library
- C. O. Conaire, N. E. O'Connor, and A. F. Smeaton. An improved spatiogram similarity measure for robust object localisation. IEEE ICASSP, 1:1069--1072, 2007.Google Scholar
- E. Cuervo, A. Balasubramanian, D.-k. Cho, A. Wolman, S. Saroiu, R. Chandra, and P. Bahl. MAUI: making smartphones last longer with code offload. In MobiSys, pages 49--62, 2010. Google ScholarDigital Library
- P. Dollár. Piotr's Image and Video Matlab Toolbox (PMT). http://vision.ucsd.edu/~pdollar/toolbox/doc/index.html.Google Scholar
- P. Dollár, R. Appel, and W. Kienzle. Crosstalk cascades for frame-rate pedestrian detection. In ECCV, pages 645--659, 2012. Google ScholarDigital Library
- P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In IEEE VS-PETS, pages 65--72, 2005.Google ScholarCross Ref
- M. Eichner and V. Ferrari. Calvin upper-body detector. http://groups.inf.ed.ac.uk/calvin/calvin_upperbody_detector/.Google Scholar
- V. Ferrari, M. Marin-Jimenez, and A. Zisserman. Progressive search space reduction for human pose estimation. In IEEE CVPR, pages 1--8, 2008.Google ScholarCross Ref
- J. Han and B. Bhanu. Individual recognition using gait energy image. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(2):316--322, 2006. Google ScholarDigital Library
- A. Henrysson and M. Ollila. UMAR: Ubiquitous mobile augmented reality. In ACM MUM, pages 41--45, 2004. Google ScholarDigital Library
- A. K. Jain, A. Ross, and S. Prabhakar. An introduction to biometric recognition. Circuits and Systems for Video Technology, IEEE Transactions on, 14(1):4--20, 2004. Google ScholarDigital Library
- R. E. Kalman. A new approach to linear filtering and prediction problems. Journal of Fluids Engineering, 82(1):35--45, 1960.Google ScholarCross Ref
- A. Mayberry, P. Hu, B. Marlin, C. Salthouse, and D. Ganesan. iShadow: Design of a wearable, real-time mobile gaze tracker. In MobiSys, pages 82--94, 2014. Google ScholarDigital Library
- P. Mistry and P. Maes. SixthSense: A wearable gestural interface. In ACM SIGGRAPH ASIA 2009 Sketches, number 11, 2009. Google ScholarDigital Library
- W. Piekarski and B. Thomas. ARQuake: the outdoor augmented reality gaming system. Communications of the ACM, 45(1):36--38, 2002. Google ScholarDigital Library
- C. Qin, X. Bao, R. Roy Choudhury, and S. Nelakuditi. TagSense: A smartphone-based approach to automatic image tagging. In ACM MobiSys, pages 1--14, 2011. Google ScholarDigital Library
- N. Raval, A. Srivastava, K. Lebeck, L. Cox, and A. Machanavajjhala. MarkIt: Privacy markers for protecting visual secrets. In ACM UbiComp Adjunct, pages 1289--1295, 2014. Google ScholarDigital Library
- J. Rekimoto and Y. Ayatsuka. CyberCode: designing augmented reality environments with visual tags. In ACM DARE, pages 1--10, 2000. Google ScholarDigital Library
- N. Robertson and I. Reid. A general method for human activity recognition in video. Computer Vision and Image Understanding, 104(2-3):232--248, 2006. Google ScholarDigital Library
- M. Satyanarayanan, P. Bahl, R. Caceres, and N. Davies. The case for VM-based cloudlets in mobile computing. 8(4):14--23, 2009. Google ScholarDigital Library
- R. Tenmoku, M. Kanbara, and N. Yokoya. A wearable augmented reality system using positioning infrastructures and a pedometer. In IEEE ISWC, page 110, 2003. Google ScholarDigital Library
- M. A. Turk and A. P. Pentland. Face recognition using eigenfaces. In IEEE CVPR, pages 586--591, 1991.Google ScholarCross Ref
- D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg. Real-time detection and tracking for augmented reality on mobile phones. Visualization and Computer Graphics, IEEE Transactions on, 16(3):355--368, 2010. Google ScholarDigital Library
- H. Wang, X. Bao, R. Roy Choudhury, and S. Nelakuditi. Recognizing humans without face recognition. In ACM HotMobile, number 7, 2013. Google ScholarDigital Library
- H. Wang, Z. Wang, G. Shen, F. Li, S. Han, and F. Zhao. Wheelloc: Enabling continuous location service on mobile phone for outdoor scenarios. In IEEE INFOCOM, pages 2733--2741, 2013.Google ScholarCross Ref
- Y. Yang and D. Ramanan. Articulated pose estimation with flexible mixtures-of-parts. In IEEE CVPR, pages 1385--1392, 2011. Google ScholarDigital Library
- W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld. Face recognition: A literature survey. ACM Computing Surveys, 35(4):399--458, 2003. Google ScholarDigital Library
Index Terms
- Visually Fingerprinting Humans without Face Recognition
Recommendations
InSight: recognizing humans without face recognition
HotMobile '13: Proceedings of the 14th Workshop on Mobile Computing Systems and ApplicationsWearable cameras and displays, such as the Google Glass, are around the corner. This paper explores techniques that jointly leverage camera-enabled glasses and smartphones to recognize individuals in the visual surrounding. While face recognition would ...
Demo: Recognizing humans without face recognition
MobiSys '14: Proceedings of the 12th annual international conference on Mobile systems, applications, and servicesFace recognition on smartphones via optimised sparse representation classification
IPSN '14: Proceedings of the 13th international symposium on Information processing in sensor networksFace recognition is an element of many smartphone apps, e.g. face unlocking, people tagging and games. Sparse Representation Classification (SRC) is a state-of-the-art face recognition algorithm, which has been shown to outperform many classical face ...
Comments