Skip to main content
SpringerLink
Log in

Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment

  • Conference paper
Gesture-Based Human-Computer Interaction and Simulation (GW 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5085))

Included in the following conference series:

Abstract

In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multimodal based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of human-computer interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abowd, G.D., Mynatt, E.D.: Charting Past, Present, and Future Research in Ubiquitous Computing. ACM Transactions on Computer-Human Interaction (TOCHI) 7, 29–58 (2000)

    Article  Google Scholar 

  2. Segen, J., Kumar, S.: Look Ma, No Mouse! – Simplifying human-computer interaction by using hand gestures. Communications of the ACM 43(7), 102–109 (2000)

    Article  Google Scholar 

  3. Oviatt, S.L.: Multimodal interfaces. In: Jacko And, J., Sears, A. (eds.) The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, vol. 14, pp. 286–304. Lawrence Erlbaum Assoc., Mahwah (2003)

    Google Scholar 

  4. Elgammal, A., Shet, V., Yacoob, Y., Davis, L.: Learning dynamics for exemplar-based gesture recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 571–578 (2003)

    Google Scholar 

  5. Dias, J.M.S., Nande, P., Barata, N., Correia, N.: O.G.R.E. – open gestures recognition engine, a platform for gesture-based communication and interaction. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS, vol. 3881, pp. 129–132. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  6. Dias, J.M.S., Bastos, R., Santos, P., Monteiro, L., Silvestre, R.: Developing and Authoring Mixed Reality with MX Toolkit. In: ART 2003, Toki, Japan (2003)

    Google Scholar 

  7. Camurri, A., Mazzarino, A., Volpe, G.: Analysis of Expressive Gesture: The EyesWeb Expressive Gesture Processing Library. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915 (LNAI). Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  8. Jorge, J.A., Fonseca, M.: Using Fuzzy Logic to Recognize Gestures Interactively. In: FUZZ-IEEE 2000, vol. 1941, pp. 265–275 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ADETTI Av. das Forças Armadas, Edifício ISCTE, 1600-082, Lisboa, Portugal

    Miguel Sales Dias, Rafael Bastos, João Fernandes & João Tavares

  2. MLDC - Microsoft Language Development Center, Edifício Qualidade C1-C2, Av. Prof. Doutor Aníbal Cavaco Silva, Tagus Park, 2744-010, Porto Salvo, Portugal

    Miguel Sales Dias & Pedro Santos

Authors
  1. Miguel Sales Dias
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rafael Bastos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. João Fernandes
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. João Tavares
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pedro Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microsoft and ISCTE, Microsoft Language Development Center, C1 and C2, Av. Doutor Aníbal Cavaco Silva, Tagus Park, 2744-010, Porto Salvo, Portugal

    Miguel Sales Dias

  2. Laboratoire Valoria, Centre de Recherche Yves Coppens, Université de Bretagne-Sud, Campus de Tohannic, 56000, Vannes, France

    Sylvie Gibet

  3. Schulich School of Music, Centre for Interdisciplinary Research in Music Media and Technology (CIRMMT), McGill University, 555, Sherbrooke Street West, H3A 1E3, Montreal, QC, Canada

    Marcelo M. Wanderley

  4. ADETTI/ISCTE, Av. das Forças Armadas, 1600-082, Lisboa, Portugal

    Rafael Bastos

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sales Dias, M., Bastos, R., Fernandes, J., Tavares, J., Santos, P. (2009). Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds) Gesture-Based Human-Computer Interaction and Simulation. GW 2007. Lecture Notes in Computer Science(), vol 5085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92865-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-92865-2_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-92864-5

  • Online ISBN: 978-3-540-92865-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation