Lode Vanacken
ABSTRACT
The integration of semantic information in virtual environment interaction is mostly still ad-hoc. The system is usually designed in such a way that the design of the framework incorporates the semantic information which then can be used to utilise these semantics during interaction. We introduce a model-based user interface approach which introduces semantic information, represented using ontologies, during the modelling phase. This semantic information itself is created during the design of the virtual world. The approach we propose is system independent and makes it possible for the semantic information content to be chosen and adapted in complete freedom without considering the underlying framework. We incorporate semantics in NiMMiT, our notation for multimodal interaction modelling. We present two case studies which validate the flexibility of our approach.
- WordNet. http://wordnet.princeton.edu/, Sep. 2007.Google Scholar
- T. Abacý, J. Cýger, and D. Thalmann. Action semantics in smart objects. In Workshop towards SVE, pages 1--7, 2005.Google Scholar
- W. Bille, B. Pellens, F. Kleinermann, and O. De Troyer. Intelligent modelling of virtual worlds using domain ontologies. In Proceedings of WIC, pages 272--279, Mexico City, Mexico, 2004.Google Scholar
- D. Carr. Interaction object graphs: An executable graphical notation for specifying user interfaces. In Formal Methods for Computer-Human Interaction, pages 141--156. Springer-Verlag, 1997.Google Scholar
- K. Coninx, E. Cuppens, J. De Boeck, and C. Raymaekers. Integrating support for usability evaluation into high level interaction descriptions with NiMMiT. In Proceedings of 13th International Workshop on DSVIS'06, volume 4385, Dublin, Ireland, July 26--28 2006. Google ScholarDigital Library
- K. Coninx, O. De Troyer, C. Raymaekers, and F. Kleinermann. VR-DeMo: a tool-supported approach facilitating flexible development of virtual environments using conceptual modelling. In Virtual Concept 2006, Cancun, Mexico, Novembre 26 2006.Google Scholar
- G. Conti, G. Ucelli, and R. De Amicis. "verba volant scripta manent" a false axiom within virtual environments. a semi-automatic tool for retrieval of semantics understanding for speech-enabled vr applications. Computers & Graphics, 30(4):619--628, 2006.Google ScholarCross Ref
- J. Coutaz, L. Nigay, D. Salber, A. Blandford, J. May, and R. M. Young. Four easy pieces for assessing the usability of multimodal interaction: The CARE properties. In Proceedings of INTERACT95, pages 115--120, Lillehammer, June 1995.Google ScholarCross Ref
- E. Cuppens, C. Raymaekers, and K. Coninx. A model-based design process for interactive virtual environments. In Proceedings of 12th International Workshop on DSVIS'05, pages 225--236, Newcastle upon Tyne, UK, July 13-15 2005. Google ScholarDigital Library
- J. De Boeck, J. M. Gonzalez Calleros, K. Coninx, and J. Vanderdonckt. Open issues for the development of 3d multimodal applications from an MDE perspective. In MDDAUI workshop, Genova, Italy, October 2 2006.Google Scholar
- P. Dragicevic and J.-D. Fekete. Support for input adaptability in the ICON toolkit. In Proceedings of the 6th ICMI, pages 212--219, State College, USA, 2004. Google ScholarDigital Library
- P. Figueroa, M. Green, and H. J. Hoover. InTml: A description language for VR applications. In Proceedings of Web3D'02, pages 53--58, Februari 2002. Google ScholarDigital Library
- S. Irawati, D. Calderón, and H. Ko. Semantic 3d object manipulation using object ontology in multimodal interaction framework. In Proceedings of ICAT'05, pages 35--39, 2005. Google ScholarDigital Library
- S. Irawati, D. Calderón, and H. Ko. Spatial ontology for semantic integration in 3d multimodal interaction framework. In ACM International Conference on VRCIA, pages 129--135, 2006. Google ScholarDigital Library
- M. Kallmann and D. Thalmann. Direct 3d interaction with smart objects. In Proceedings of the ACM symposium VRST, pages 124--130, 1999. Google ScholarDigital Library
- F. Kleinermann, O. De Troyer, H. Mansouri, R. Romero, B. Pellens, and W. Bille. Designing semantic virtual reality applications. In Proceedings of the 2nd INTUITION International Workshop, 2005.Google Scholar
- C. Kulas, C. Sandor, and G. Klinker. Towards a development methodology for augmented reality user interfaces. In Proceedings of MIXER 2004, 2004.Google Scholar
- M. E. Latoschik and C. Frölich. Semantic reflection for intelligent virtual environments. In Virtual Reality Conference, 2007. VR '07. IEEE, pages 305--306, 2007.Google ScholarCross Ref
- F. V. Mario Gutiérrez, Daniel Thalmann. Semantic virtual environments with adaptive multimodal interfaces. In 11th International Conference on Multimedia Modelling, pages 277--283, 2005. Google ScholarDigital Library
- J. I. Martínez. An Intelligent Guide for Virtual Environments with Fuzzy Queries and Flexible Management of Stories. PhD thesis, Universidad de Murcia, 2004.Google Scholar
- D. Navarre, P. Palanque, R. Bastide, A. Schyn, M. Winckler, L. Nedel, and C. Freitas. A formal description of multimodal interaction techniques for immersive virtual reality applications. In Proceedings of Tenth IFIP TC13 International Conference on HCI, Rome, IT, September 12--16 2005. Google ScholarDigital Library
- K. A. Otto. The semantics of multi-user virtual environments. In Workshop towards SVE, pages 35--39, 2005.Google Scholar
- OWL Web Ontology Language. OWL. http://www.w3.org/TR/owl-features/, Sep. 2007.Google Scholar
- F. Paternò. Model-Based Design and Evaluation of Interactive Applications. Springer-Verlag, 2000. Google ScholarDigital Library
- T. Pfeiffer and M. E. Latoschik. Resolving object references in multimodal dialogues for immersive virtual environments. In Proceedings of the IEEE VR2004, pages 35--42, Chicago, USA, 2004. Google ScholarDigital Library
- Resource Description Framework (RDF). RDF. http://www.w3.org/RDF/, Sep. 2007.Google Scholar
- SPARQL Query Language for RDF. SPARQL. http://www.w3.org/TR/rdf-sparql-query/, Sep. 2007.Google Scholar
- D. Vanacken, J. De Boeck, C. Raymaekers, and K. Coninx. NiMMiT: A notation for modeling multimodal interaction techniques. In Proceedings of the International Conference GRAPP06, Setúbal, Portugal, Februari 25--28 2006.Google Scholar
- L. Vanacken, E. Cuppens, T. Clerckx, and K. Coninx. Extending a dialog model with contextual knowledge. In Tamodia 2007, Toulouse, France, Novembre 2007. Google ScholarDigital Library
- L. Vanacken, C. Raymaekers, and K. Coninx. Automatic speech grammar generation during conceptual modelling of virtual environments. In Intuition 2007, Athens, Greece, Octobre 2007.Google Scholar
- J. Willans and M. Harrison. A toolset supported approach for designing and testing virtual environment interaction techniques. International Journal of Human-Computer Studies, 55(2):145--165, August 2001. Google ScholarDigital Library
- C. Wingrave and D. Bowman. CHASM: Bridging description and implementation of 3D interfaces. In New Directions in 3DUI Workshop in IEEE VR, 2005.Google Scholar
Index Terms
- Introducing semantic information during conceptual modelling of interaction for virtual environments
Recommendations
Domain Ontology Component-Based Semantic Information Integration
ETCS '09: Proceedings of the 2009 First International Workshop on Education Technology and Computer Science - Volume 03Research on architecture of domain ontology component-based information semantic representation and integration is studied. Domain ontology component, a "loosely coupled" approach in the use of ontology, is advocated. As a case study, a prototype for ...
Semantic and Acoustic-Prosodic Entrainment of Dialogues in Service Scenarios
ICMI '21 Companion: Companion Publication of the 2021 International Conference on Multimodal InteractionAccording to the Communication Accommodation Theory, speakers dynamically adjust their communication behaviors, converging to or diverging from their interlocutors in order to diminish or increase social distance, which is called entrainment. Most of ...
Comments