Takayuki Akaguma
ABSTRACT
In the field of augmented reality (AR), geometric and photometric registration is routinely achieved in real time. However, real-time geometric registration often leads to misalignment (e.g., jitter and drift) due to the error from camera pose estimation. Due to limited resources on mobile devices, it is also difficult to implement state-of-the-art techniques for photometric registration on mobile AR systems. In order to solve these problems, we developed a mobile AR system in a significantly different way from conventional systems. In this system, captured omnidirectional images and virtual objects are registered geometrically and photometrically in an offline rendering process. The appropriate part of the prerendered omnidirectional AR image is shown to a user through a mobile device with online registration between the real world and the pre-captured image. In order to investigate the validity of our new framework for mobile AR, we conducted experiments using the prototype system on a real site in Todai-ji Temple, a famous world cultural heritage site in Japan.
- Arai, I., Hori, M., Kawai, N., Abe, Y., Ichikawa, M., Satonaka, Y., Nitta, T., Nitta, T., Fujii, H., Mukai, M., et al. 2010. Pano Umechika: A crowded underground city panoramic view system. In Proc. 7th Int'l Symp. Distributed Computing and Artificial Intelligence (DCAI'10). 173--180.Google Scholar
Cross Ref
- Azuma, R. T. 1997. A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 4, 355--385.Google ScholarDigital Library
- Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. ACM SIGGRAPH'98, 189--198. Google ScholarDigital Library
- Gruber, L., Richter-Trummer, T., and Schmalstieg, D. 2012. Real-time photometric registration from arbitrary geometry. In Proc. 11th IEEE Int'l Symp. Mixed and Augmented Reality (ISMAR'12), 91--97. Google ScholarDigital Library
- Hollerer, T., Feiner, S., and Pavlik, J. 1999. Situated documentaries: Embedding multimedia presentations in the real world. In Proc. 3rd IEEE Int'l Symp. Wearable Computers (ISWC'99), 79--86. Google ScholarDigital Library
- Kán, P., and Kaufmann, H. 2012. High-quality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence. In Proc. 11th IEEE Int'l Symp. Mixed and Augmented Reality (ISMAR'12), 99--108. Google ScholarDigital Library
- Kawai, N., Sato, T., and Yokoya, N. 2009. Image inpainting considering brightness change and spatial locality of textures and its evaluation. In Proc. 3rd Pacific-Rim Symp. Image and Video Technology (PSIVT'09), 271--282. Google ScholarDigital Library
- Klein, G., and Murray, D. 2009. Parallel tracking and mapping on a camera phone. In Proc. 8th IEEE Int'l Symp. Mixed and Augmented Reality (ISMAR'09), 83--86. Google ScholarDigital Library
- Lensing, P., and Broll, W. 2012. Instant indirect illumination for dynamic mixed reality scenes. In Proc. 11th IEEE Int'l Symp. Mixed and Augmented Reality (ISMAR'12), 109--118. Google ScholarDigital Library
- Okura, F., Kanbara, M., and Yokoya, N. 2012. Full spherical high dynamic range imaging from the sky. In Proc. 9th IEEE Int'l Conf. Multimedia and Expo (ICME'12), 325--332. Google ScholarDigital Library
- Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. In Proc. ACM SIGGRAPH'02, 267--276. Google ScholarDigital Library
- Taketomi, T., Sato, T., and Yokoya, N. 2011. Real-time and accurate extrinsic camera parameter estimation using feature landmark database for augmented reality. Int'l Journal of Computers and Graphics 35, 4, 768--777. Google ScholarDigital Library
- Tenmoku, R., Kanbara, M., and Yokoya, N. 2004. A positioning method combining specification of users absolute position and dead reckoning for wearable augmented reality systems. In Proc. 3rd CREST/ISWC Workshop on Advanced Computing and Communicating Techniques for Wearable Information Playing, 19--22.Google Scholar
- Ventura, J., and Hollerer, T. 2012. Wide-area scene mapping for mobile visual tracking. In Proc. 11th IEEE Int'l Symp. Mixed and Augmented Reality (ISMAR'12), 3--12. Google ScholarDigital Library
- Zoellner, M., Keil, J., Drevensek, T., and Wuest, H. 2009. Cultural heritage layers: Integrating historic media in augmented reality. In Proc. 15th Int'l Conf. Virtual Systems and Multimedia (VSMM'09), 193--196. Google ScholarDigital Library
Index Terms
- Mobile AR using pre-captured omnidirectional images
Recommendations
A Video Annotation Tool Using Vision-based AR Technology
CW '12: Proceedings of the 2012 International Conference on CyberworldsIn this paper, we present a video annotation tool using vision-based Augmented Reality (AR) technology. We apply AR technology and computer vision method for making videos with 3D annotations such as image textures, video clips, 3D objects and 3D text. ...
AR registration by merging multiple planar markers at arbitrary positions and poses via projective space
ICAT '05: Proceedings of the 2005 international conference on Augmented tele-existenceThis paper presents a vision-based registration method for Augmented Reality by merging multiple planar markers, which are placed at arbitrary positions and poses. In our approach, we use planar markers like AR-Toolkit markers. We need no information ...
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsThis demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
Comments