Ye-Sheng Kuo
ABSTRACT
We explore the indoor positioning problem with unmodified smartphones and slightly-modified commercial LED luminaires. The luminaires-modified to allow rapid, on-off keying-transmit their identifiers and/or locations encoded in human-imperceptible optical pulses. A camera-equipped smartphone, using just a single image frame capture, can detect the presence of the luminaires in the image, decode their transmitted identifiers and/or locations, and determine the smartphone's location and orientation relative to the luminaires. Continuous image capture and processing enables continuous position updates. The key insights underlying this work are (i) the driver circuits of emerging LED lighting systems can be easily modified to transmit data through on-off keying; (ii) the rolling shutter effect of CMOS imagers can be leveraged to receive many bits of data encoded in the optical transmissions with just a single frame capture, (iii) a camera is intrinsically an angle-of-arrival sensor, so the projection of multiple nearby light sources with known positions onto a camera's image plane can be framed as an instance of a sufficiently-constrained angle-of-arrival localization problem, and (iv) this problem can be solved with optimization techniques. We explore the feasibility of the design through an analytical model, demonstrate the viability of the design through a prototype system, discuss the challenges to a practical deployment including usability and scalability, and demonstrate decimeter-level accuracy in both carefully controlled and more realistic human mobility scenarios.
- J. Armstrong, Y. A. Sekercioglu, and A. Neild. Visible light positioning: A roadmap for international standardization. IEEE Communications Magazine, 51(12), 2013.Google Scholar
Cross Ref
- P. Bahl and V. N. Padmanabhan. RADAR: An in-building RF-based user location and tracking system. In Proc. 19th Annual Joint Conference of the IEEE Computer and Communications Societies. (INFOCOM '00), volume 2, 2000.Google ScholarCross Ref
- J. Canny. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. Google ScholarDigital Library
- Y. Chen, D. Lymberopoulos, J. Liu, and B. Priyantha. FM-based indoor localization. In Proc. of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys '12), 2012. Google ScholarDigital Library
- K. Chintalapudi, A. Padmanabha Iyer, and V. N. Padmanabhan. Indoor localization without the pain. In Proc. of the 16th ACM Annual International Conference on Mobile Computing and Networking (MobiCom '10), 2010. Google ScholarDigital Library
- J. Chung, M. Donahoe, C. Schmandt, I.-J. Kim, P. Razavai, and M. Wiseman. Indoor location sensing using geo-magnetism. In Proc. of the 9th International Conference on Mobile Systems, Applications, and Services (MobiSys '11), 2011. Google ScholarDigital Library
- P. Connolly and D. Boone. Indoor location in retail: Where is the money? ABI Research Report, 2013.Google Scholar
- K. Cui, G. Chen, Z. Xu, and R. D. Roberts. Line-of-sight visible light communication system design and demonstration. 7th IEEE IET International Symposium on Communication Systems Networks and Digital Signal Processing, 2010.Google ScholarCross Ref
- C. Danakis, M. Afgani, G. Povey, I. Underwood, and H. Haas. Using a CMOS camera sensor for visible light communication. In IEEE Globecom Workshops, 2012.Google ScholarCross Ref
- M. C. Dean. Bearings-Only Localization and Mapping. PhD thesis, Carnegie Mellon University, 2005. Google ScholarDigital Library
- A. Jovicic, J. Li, and T. Richardson. Visible light communication: Opportunities, challenges and the path to market. IEEE Communications Magazine, 51(12), 2013.Google ScholarCross Ref
- T. Komine and M. Nakagawa. Fundamental analysis for visible-light communication system using LED lights. IEEE Transactions on Consumer Electronics, 50(1), 2004. Google ScholarDigital Library
- L. Li, P. Hu, C. Peng, G. Shen, and F. Zhao. Epsilon: A visible light based positioning system. In Proc. of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI '14), 2014. Google ScholarDigital Library
- K. Lorincz and M. Welsh. Motetrack: A robust, decentralized approach to RF-based location tracking. Personal Ubiquitous Computing, 11(6), Aug. 2007. Google ScholarDigital Library
- E. Martin, O. Vinyals, G. Friedland, and R. Bajcsy. Precise indoor localization using smart phones. In Proc. of the ACM International Conference on Multimedia, 2010. Google ScholarDigital Library
- Microsoft. PhotoCaptureDevice class. http://msdn.microsoft.com/en-us/library/windowsphone/develop/windows.phone.media.capture.photocapturedevice.Google Scholar
- Nokia. Camera explorer. https://github.com/nokia-developer/camera-explorer, 2013.Google Scholar
- N. Otsu. A Threshold Selection Method from Gray-level Histograms. IEEE Transactions on Systems, Man and Cybernetics, 9(1), 1979.Google ScholarCross Ref
- G. B. Prince and T. D. Little. A two phase hybrid RSS/AoA algorithm for indoor device localization using visible light. In IEEE Global Communication Conference (GLOBECOM '12), 2012.Google ScholarCross Ref
- M. S. Rahman, M. M. Haque, and K.-D. Kim. Indoor positioning by led visible light communication and image sensors. International Journal of Electrical and Computer Engineering (IJECE), 1(2), 2011.Google Scholar
- N. Rajagopal, P. Lazik, and A. Rowe. Visual light landmarks for mobile devices. In Proc. of the 13th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN '14), 2014. Google ScholarDigital Library
- S. Rajagopal, R. D. Roberts, and S.-K. Lim. IEEE 802.15.7 visible light communication: Modulation schemes and dimming support. IEEE Communications Magazine, 50(3), 2012.Google Scholar
- A. Richardson, J. Strom, and E. Olson. AprilCal: Assisted and repeatable camera calibration. In Proc. of International Conference on Intelligent Robots and Systems (IROS '13), 2013.Google ScholarCross Ref
- M. Sakata, Y. Yasumuro, M. Imura, Y. Manabe, and K. Chihara. Location system for indoor wearable PC users. In Workshop on Advanced Computing and Communicating Techniques for Wearable Information Playing, 2003.Google Scholar
- S. Suzuki et al. Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1), 1985.Google Scholar
- J. Tan and N. Narendran. A driving scheme to reduce AC LED flicker. Optical Engineering, 2013.Google Scholar
- J. Xiong and K. Jamieson. ArrayTrack: A fine-grained indoor location system. In Proc. of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI '13), 2013. Google ScholarDigital Library
- S.-H. Yang, E.-M. Jeong, D.-R. Kim, H.-S. Kim, Y.-H. Son, and S.-K. Han. Indoor three-dimensional location estimation based on LED visible light communication. Electronics Letters, 49(1), January 2013.Google ScholarCross Ref
- Z. Yang, C. Wu, and Y. Liu. Locating in fingerprint space: Wireless indoor localization with little human intervention. In Proc. of the 18th ACM Annual International Conference on Mobile Computing and Networking (MobiCom '12), 2012. Google ScholarDigital Library
- M. Yoshino, S. Haruyama, and M. Nakagawa. High-accuracy positioning system using visible LED lights and image sensor. In IEEE Radio and Wireless Symposium (RWS '08), 2008.Google Scholar
- M. A. Youssef and A. Agrawala. The Horus WLAN location determination system. In Proc. of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys '05), 2005. Google ScholarDigital Library
- Z. Zhou, M. Kavehrad, and P. Deng. Indoor positioning algorithm using light-emitting diode visible light communications. Optical Engineering, 51(8), 2012.Google Scholar
Index Terms
- Luxapose: indoor positioning with mobile phones and visible light
Recommendations
LiTell: robust indoor localization using unmodified light fixtures
MobiCom '16: Proceedings of the 22nd Annual International Conference on Mobile Computing and NetworkingOwing to dense deployment of light fixtures and multipath-free propagation, visible light localization technology holds potential to overcome the reliability issue of radio localization. However, existing visible light localization systems require ...
Demo: Luxapose: indoor positioning with mobile phones and visible light
MobiCom '14: Proceedings of the 20th annual international conference on Mobile computing and networkingWe explore the indoor positioning problem with unmodified smartphones and slightly-modified commercial LED luminaires. The luminaires - modified to allow rapid, on-off keying - transmit their identifiers and/or locations encoded in human-imperceptible ...
Dynamic-MUSIC: accurate device-free indoor localization
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingDevice-free passive indoor localization is playing a critical role in many applications such as elderly care, intrusion detection, smart home, etc. However, existing device-free localization systems either suffer from labor-intensive offline training or ...
Comments