Abstract
In this paper we introduce an innovative application aiming at combining large, tablet-based and headmounted displays for collaborative mobile mixed reality design reviews. Our research and development is motivated by two use scenarios: automotive and architectural design review involving real users from Page/Park architects and Elasis FIAT. Our activities are supported by the EU IST project IMPROVE. It covers activities in the areas of: HMD development using unique OLED technology, markerless tracking, augmented reality rendering, image calibration for large tiled displays, collaborative tablet-based and projection wall oriented interaction and stereoscopic video streaming for mobile users. The paper gives an overview of the hardware and software developments within IMPROVE and concludes with results from first user test.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Klüger, K., Fröhlich, B., Hoffmann, J., Hochstrate, J.: Implementing multi-viewer time-sequential stereo displays based on shuttered lcd projectors. In: 4th Immersive Projection Technology Workshop, Ames, Iowa (2004)
Monno, G., Fiorentino, M., de Amicis, R., Stork, A.: Spacedesign: A mixed reality workspace for aesthetic industrial design. In: Symposium on Augmented and Mixed Reality, Darmstadt, ISMAR (2002)
Klinker, G., Dutoit, A.H., Bauer, M., Bayer, J., Novak, V., Matzke, D.: Fata Morgana—a presentation system for product design. In: International Symposium on Augmented and Mixed Reality, Darmstadt, ISMAR (2002)
Majumder A. and Stevens R. (2004). Color nonuniformity in projection-based displays: analysis and solutions. IEEE Trans. Vis. Comput. Graph. 10(2): 177–188
Beardsley, P., Willwacher, T., Rao, S., Raskar, R., van Baar, J., Forlines, C.: Ilamps: geometrically aware and selfconfiguring projectors. In: Proceedings of ACM SIGGRAPH (2003)
Majumder, A., Towles, H., Raji, A., Gill, G., Fuchs, H.: Pixelflex2: a comprehensive, automatic, casually-aligned multi-projector display. In: IEEE Workshop on Projector-Camera Systems (PROCAMS) (2003)
Majumder, A., Brown, M., Yang, R.: Camera-Based Calibration Techniques for Seamless Multi-Projector Displays, vol. 11 (2005)
Stone, M.C.: Color balancing experimental projection displays. In: Color Imaging Conference, pp. 342–347 (2001)
Stone and M.C. (2001). Color and brightness appearance issues in tiled displays. IEEE Comput. Graph. Appl. 21(5): 58–66
Chen, H., Wallace, G., Li, K.: Color gamut matching for tiled display walls. In: EGVE ’03: Proceedings of the Workshop on Virtual Environments, pp. 193–302 (2003)
Reiners, D., Kresse, W., Knoepfle, C.: Color consistency for digital multi-projector stereo display systems: the heyewall and the digital cave. In: EGVE’03: Proceedings of the Workshop on Virtual Environments 2003, pp. 271–279. ACM Press, Zurich, Switzerland (2003)
McCrory, M., Papka, M.E., Majumder, A., Jones, D., Stevens, R.: Using a camera to capture and correct spatial photometric variation in multi-projector displays.In: IEEE Workshop on Projector-Camera Systems (PROCAMS) (2003)
Majumder A. and Stevens R. (2005). Perceptual photometric seamlessness in projection-based tiled displays. ACM Trans. Graph. 24(1): 118–139
Towles, H., Majumder, A., He, Z., Welch, G.: Achieving color uniformity across multi-projector displays. In : IEEE Computer Society Press (ed.) VIS ’00 Proceedings of the Conference on Visualization ’00, pp. 117–124. Salt Lake City, Utah, United States (2000)
Debevec P.E. and Malik J. (1997). Recovering high dynamic range radiance maps from photographs. Comput. Graph. 31: 369–378
Bern, M., Eppstein, D.: Optimized color gamuts for tiled displays. In: SCG ’03: Proceedings of the Nineteenth Annual Symposium on Computational Geometry, pp. 274–281. ACM Press, San Diego, California, USA (2003)
Debevec, P.: Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. SIGGRAPH 98 (1998)
Kautz, J., Sloan, P.-P., Snyder, J.: Precomputed radiance transfer for real-time rendering in dynamic low-frequency lighting environments. SIGGRAPH (2002)
Lepetit, V., Fua, P.: Monocular Model-Based 3D Tracking of Rigid Objects: A survey (2005)
Poupyrev, I., Ikamoto, I., Kato, H., Billinghurst, M., Tachibana, K.: Virtual object manipulation on tabletop ar environment. In: International Symposium on Augmented Reality, pp. 111–119 (2000)
Drummond T. and Cipolla R. (2002). Real-time visual tracking of complex structures. IEEE Trans. Pattern Anal. Mach. Intell. 27: 932–946
Fitzgibbon, A., Simon, G., Zisserman, A.: Markerless tracking using planar structures in the scene. In: International Symposium on Mixed and Augmented Reality, pp. 120–128 (2000)
Zhang Z. (2000). A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22: 1330–1334
Stewart, C.V.: Robust parameter estimation. Soc. Ind. Appl. Math. 41(3), 513–537 (1999)
Schmalstieg, D.: Designing immersive virtual reality for geometry education. IEEE Virtual Real. Alexandria, VA, USA (2006)
Regenbrecht, H., Wagner, M.: Interaction in a collaborative augmented reality enviromnment. In: Proceeding of Chi 2002, pp. 504–505. ACM Press, Minneapolis, Minnesota, USA (2002)
Shi, J., Thomasi, C.: Good features to track. In: Conference on Computer Vision and Pattern Recognition (Seattle) (1994)
Lowe D. (2001) Distincitve image features from scale-invariant keypoints. Int J Comput Vis. 20(2): 91–110
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Santos, P., Stork, A., Gierlinger, T. et al. IMPROVE: An innovative application for collaborative mobile mixed reality design review. Int J Interact Des Manuf 1, 115–126 (2007). https://doi.org/10.1007/s12008-007-0010-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12008-007-0010-8