Skip to main content
SpringerLink
Log in

Measuring Communication Participation to Initiate Conversation in Human–Robot Interaction

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

Consider a situation where a robot initiates a conversation with a person. What is the appropriate timing for such an action? Where is a good position from which to make the initial greeting? In this study, we analyze human interactions and establish a model for a natural way of initiating conversation. Our model mainly involves the participation state and spatial formation. When a person prepares to participate in a conversation and a particular spatial formation occurs, he/she feels that he/she is participating in the conversation; once he/she perceives his/her participation, he/she maintains particular spatial formations. Theories have addressed human communication related to these concepts, but they have only covered situations after people start to talk. In this research, we created a participation state model for measuring communication participation and provided a clear set of guidelines for how to structure a robot’s behavior to start and maintain a conversation based on the model. Our model precisely describes the constraints and expected behaviors for the phase of initiating conversation. We implemented our proposed model in a humanoid robot and conducted both a system evaluation and a user evaluation in a shop scenario experiment. It was shown that good recognition accuracy of interaction state in a conversation was achieved with our proposed model, and the robot implemented with our proposed model was evaluated as best in terms of appropriateness of behaviors and interaction efficiency compared with other two alternative conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

References

  1. Clark HH (1996) Using language. Cambridge University Press, Cambridge

    Book  Google Scholar 

  2. Kendon A (1990) Spatial organization in social encounters: the F-formation system. In: Kendon A (ed) Conducting interaction: patterns of behavior in focused encounters. Cambridge University Press, Cambridge, pp 209–238

    Google Scholar 

  3. Kuzuoka H, Suzuki Y, Yamashita J, Yamazaki K (2010) Reconfiguring spatial formation arrangement by robot body orientation. In: ACM/IEEE international conference on human–robot interaction (HRI2010), pp 285–292

  4. Michalowski MP, Sabanovic S, Simmons R (2006) A spatial model of engagement for a social robot. In: IEEE international workshop on advanced motion control, pp 762–767

  5. Shiomi M, Kanda T, Ishiguro H, Hagita N (2010) A larger audience, Please!—encouraging people to listen to a guide robot. In: ACM/IEEE international conference on human–robot interaction (HRI2010), pp 31–38

  6. Sidner CL, Kidd CD, Lee C, Lesh N (2004) Where to look: a study of human–robot engagement. In: International conference on intelligent user interfaces (IUI 2004), pp 78–84

  7. Shi C, Shimada M, Kanda T, Ishiguro H, Hagita N (2011) Spatial formation model for initiating conversation. In: Proceedings of robotics: science and systems (RSS 2011)

  8. Kuzuoka H, Oyama S, Yamazaki K, Suzuki K, Mitsuishi M (2000) GestureMan: a mobile robot that embodies a remote instructor’s actions. In: ACM conference on computer-supported cooperative work (CSCW2000), pp 155–162

  9. Scassellati BM (2001) Foundations for a theory of mind for a humanoid, Robot edn. Massachusetts Institute of Technology, Cambridge

    Google Scholar 

  10. Breazeal C, Kidd CD, Thomaz AL, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human–robot teamwork. In: IEEE/RSJ international conference on intelligent robots and systems (IROS2005), pp 383–388

  11. Kuno Y, Sadazuka K, Kawashima M, Yamazaki K, Yamazaki A, Kuzuoka H ( 2007) Museum guide robot based on sociological interaction analysis. In: ACM conference on human factors in computing systems (CHI2007), pp 1191–1194

  12. Mutlu B, Forlizzi J, Hodgins J (2006) A storytelling robot: modeling and evaluation of human-like gaze behavior. In: IEEE-RAS international conference on humanoid robots (Humanoids’06), pp 518–523

  13. Mutlu B, Shiwa T, Kanda T, Ishiguro H, Hagita N (2009) Footing in human–robot conversations: how robots might shape participant roles using gaze cues. In: ACM/IEEE international conference on human–robot interaction (HRI2009), pp 61–68

  14. Nakano YI, Ishii R (2010) Estimating user’s engagement from eye-gaze behaviors in human–agent conversations. In: International conference on intelligent user interfaces, pp 139–148

  15. Rich C, Ponsler B, Holroyd A, Sidner CL (2010) Recognizing engagement in human–robot interaction. In: ACM/IEEE international conference on human–robot interaction (HRI2010), pp 375–382

  16. Mondada L (2009) Emergent focused interactions in public places: a systematic analysis of the multimodal achievement of a common interactional space. J Pragmat 41:1977–1997

    Article  Google Scholar 

  17. Hall ET (1966) The hidden dimension: man’s use of space in public and private. The Bodley Head Ltd, London

    Google Scholar 

  18. Goffman E (1963) Behavior in public place: notes on the social organization of gatherings. Free Press, New York

    Google Scholar 

  19. Kendon A (1980) Features of the structural analysis of human communicational behavior. In: von Raffler Engel W (ed) Aspects of nonverbal communication. Swets and Zeitlinger B.V, Lisse, Holland, pp 29–43

  20. Loth S, Huth K, De Ruiter JP (2013) Automatic detection of service initiation signals used in bars. Front Psychol 4:557. doi:10.3389/fpsyg.2013.00557

  21. Katagiri Y, Bono M, Suzuki N (2006) Conversational inverse information for context-based retrieval of personal experiences. Lect Notes Comput Sci 4012:365–376

    Article  Google Scholar 

  22. Hüttenrauch H, Eklundh KS, Green A, Topp EA (2006) Investigating spatial relationships in human-robot interactions. In: IEEE/RSJ international conference on intelligent robots and systems (IROS2006), pp 5052–5059

  23. Dautenhahn K, Walters ML, Woods S, Koay KL, Nehaniv CL, Sisbot EA, Alami R, Siméon T (2006) How may i serve you? A robot companion approaching a seated person in a helping context. In: ACM/IEEE international conference on human–robot interaction (HRI2006), pp 172–179

  24. Torta E, Cuijpers RH, Juola JF, Pol DVD (2011) Design of robust robotic proxemic behaviour. In: ICSR, pp 21–30

  25. Satake S, Kanda T, Glas DF, Imai M, Ishiguro H, Hagita N (2009) How to approach humans? Strategies for social robots to initiate interaction. In: ACM/IEEE international conference on human–robot interaction (HRI2009), pp 109–116

  26. Carton D, Turnwald A, Wollherr D, Buss M (2013) Proactively approaching pedestirans with an autonomous mobile robot in urban environments. In: The 13th international symposium on experimental robotics, pp 199–214

  27. Ciolek TM, Kendon A (1980) Environment and the spatial arrangement of conversational encounters. Sociol Inq 50:237–271

    Article  Google Scholar 

  28. Yamaoka F, Kanda T, Ishiguro H, Hagita N (2010) A model of proximity control for information-presenting robots. IEEE Trans Robot 26:187–195

    Article  Google Scholar 

  29. Pacchierotti E, Christensen HI, Jensfelt P (2006) Evaluation of passing distance for social robots. In: IEEE international symposium on robot and human interactive communication (RO-MAN2006), pp 315–320

  30. Gockley R, Forlizzi J, Simmons R (2007) Natural person-following behavior for social robots. In: ACM/IEEE international conference on human–robot interaction (HRI2007), pp 17–24

  31. Weiss A, Mirnig N, Buchner R, Förster F, Tscheligi M (2011) Transferring human–human interaction studies to hri scenarios in public space. INTERACT 2:230–247

    Google Scholar 

  32. Bergström N, Kanda T, Miyashita T, Ishiguro H, Hagita N (2008) Modeling of natural human–robot encounters. In: IEEE/RSJ international conference on intelligent robots and systems (IROS2008), pp 2623–2629

  33. Yamazaki K, Kawashima M, Kuno Y, Akiya N, Burdelski M, Yamazaki A, Kuzuoka H (2007) Prior-to-request and request behaviors within elderly day care: implications for developing service robots for use in multiparty settings. In: European conference on computer supported cooperative work (ECSCW2007), pp 61–78

  34. Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37–46

    Article  Google Scholar 

  35. Shi C, Kanda T, Shimada M, Yamaoka F, Ishiguro H, Hagita N (2010) Easy development of communicative behaviors in social robots. In: 2010 IEEE/RSJ international conference on intelligent robots and systems (IROS2010), pp 5302–5309

  36. Hartnett JJ, Bailey KG, Hartley CS (1974) Body height, position, and sex as determinants of personal space. J Psychol 87:129–136

  37. Woods SN, Dautenhahn K, Schulz J (2005) Child and adults’ perspectives on robot appearance. In: Proceedings of the symposium on robot companions: hard problems and open challenges in robot–human interaction, pp 126–132

  38. Woods SN, Dautenhahn K, Schulz J (2006) Exploring the design space of robots: children’s perspectives. Interact Comput 18(6):1390–1418

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Advanced Telecommunications Research Institute International IRC/HIL, 2-2-2 Hikaridai, Keihanna Science City, Kyoto, Japan

    Chao Shi, Masahiro Shiomi, Takayuki Kanda, Hiroshi Ishiguro & Norihiro Hagita

  2. Department of Systems Innovation, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 560-8531, Japan

    Chao Shi & Hiroshi Ishiguro

Authors
  1. Chao Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masahiro Shiomi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Takayuki Kanda
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hiroshi Ishiguro
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Norihiro Hagita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao Shi.

Additional information

We’d like to thank everyone who helped with this project. This research was supported by KAKENHI 25240042.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, C., Shiomi, M., Kanda, T. et al. Measuring Communication Participation to Initiate Conversation in Human–Robot Interaction. Int J of Soc Robotics 7, 889–910 (2015). https://doi.org/10.1007/s12369-015-0285-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-015-0285-z

Keywords

Search

Navigation