Leimin Tian
Sharon Oviatt
Skip Abstract Section
Abstract
Robotic applications have entered various aspects of our lives, such as health care and educational services. In such Human-robot Interaction (HRI), trust and mutual adaption are established and maintained through a positive social relationship between a user and a robot. This social relationship relies on the perceived competence of a robot on the social-emotional dimension. However, because of technical limitations and user heterogeneity, current HRI is far from error-free, especially when a system leaves controlled lab environments and is applied to in-the-wild conditions. Errors in HRI may either degrade a user’s perception of a robot’s capability in achieving a task (defined as performance errors in this work) or degrade a user’s perception of a robot’s socio-affective competence (defined as social errors in this work). The impact of these errors and effective strategies to handle such an impact remains an open question. We focus on social errors in HRI in this work. In particular, we identify the major attributes of perceived socio-affective competence by reviewing human social interaction studies and HRI error studies. This motivates us to propose a taxonomy of social errors in HRI. We then discuss the impact of social errors situated in three representative HRI scenarios. This article provides foundations for a systematic analysis of the social-emotional dimension of HRI. The proposed taxonomy of social errors encourages the development of user-centered HRI systems, designed to offer positive and adaptive interaction experiences and improved interaction outcomes.
- Carole Adam and Benoit Gaudou. 2016. BDI agents in social simulations: A survey. Knowl. Eng. Rev. 31, 3 (2016), 207--238.Google Scholar
Cross Ref
- Jason Aimone, Sheryl Ball, and Brooks King-Casas. 2015. The betrayal aversion elicitation task: An individual level betrayal aversion measure. PLoS ONE 10, 9 (2015), e0137491.Google ScholarCross Ref
- Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, et al. 2019. Guidelines for human-AI interaction. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. ACM.Google ScholarDigital Library
- James Andreoni and B. Douglas Bernheim. 2009. Social image and the 50-50 norm: A theoretical and experimental analysis of audience effects. Econometrica 77, 5 (2009), 1607--1636.Google ScholarCross Ref
- Mohd Anwar and Jim Greer. 2012. Facilitating trust in privacy-preserving e-learning environments. IEEE Trans. Learn. Technol. 5, 1 (2012), 62--73.Google ScholarDigital Library
- Michael Argyle and Janet Dean. 1965. Eye-contact, distance and affiliation. Sociometry 28, 3 (1965), 289--304.Google ScholarCross Ref
- R. Asaad Baksh, Sharon Abrahams, Bonnie Auyeung, and Sarah E. MacPherson. 2018. The Edinburgh social cognition test (ESCoT): Examining the effects of age on a new measure of theory of mind and social norm understanding. PLoS ONE 13, 4 (2018), 1--16.Google ScholarCross Ref
- Simon Baron-Cohen. 1996. Reading the mind in the face: A cross-cultural and developmental study. Vis. Cog. 3, 1 (1996), 39--60.Google ScholarCross Ref
- Simon Baron-Cohen, Michelle O’Riordan, Rosie Jones, Valerie Stone, and Kate Plaisted. 1999. A new test of social sensitivity: Detection of faux pas in normal children and children with Asperger syndrome. J. Autism Dev. Disord. 29, 5 (1999), 407--418.Google ScholarCross Ref
- Simon Baron-Cohen and Sally Wheelwright. 2004. The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J. Autism Dev. Disord. 34, 2 (2004), 163--175.Google ScholarCross Ref
- Lisa Feldman Barrett. 2017. How Emotions Are Made: The Secret Life of the Brain. Houghton Mifflin Harcourt.Google Scholar
- Christoph Bartneck, Marcel Verbunt, Omar Mubin, and Abdullah Al Mahmud. 2007. To kill a mockingbird robot. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 81--87.Google ScholarDigital Library
- Andrea Bauer, Dirk Wollherr, and Martin Buss. 2008. Human-robot collaboration: A survey. Int. J. Human. Robot. 5, 01 (2008), 47--66.Google ScholarCross Ref
- Matthew I. Beane. 2020. In storage, yet on display: An empirical investigation of robots’ value as social signals. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 83--91.Google ScholarDigital Library
- Casey C. Bennett, Selma Sabanovic, Jennifer A. Piatt, Shinichi Nagata, Lori Eldridge, and Natasha Randall. 2017. A robot a day keeps the blues away. In Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI’17). IEEE, 536--540.Google ScholarCross Ref
- Joyce Berg, John Dickhaut, and Kevin McCabe. 1995. Trust, reciprocity, and social history. Games Econ. Behav. 10, 1 (1995), 122--142.Google ScholarCross Ref
- David P. Biros, Mark Daly, and Gregg Gunsch. 2004. The influence of task load and automation trust on deception detection. Group Decis. Negot. 13, 2 (2004), 173--189.Google ScholarCross Ref
- Cynthia Breazeal, Cory D. Kidd, Andrea Lockerd Thomaz, Guy Hoffman, and Matt Berlin. 2005. Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 708--713.Google ScholarCross Ref
- Daniel J. Brooks. 2017. A Human-centric Approach to Autonomous Robot Failures. Ph.D. Dissertation. University of Massachusetts Lowell.Google Scholar
- Judee K. Burgoon, Joseph A. Bonito, Bjorn Bengtsson, Carl Cederberg, Magnus Lundeberg, and Lisa Allspach. 2000. Interactivity in human--computer interaction: A study of credibility, understanding, and influence. Comput. Hum. Behav. 16, 6 (2000), 553--574.Google ScholarCross Ref
- Brian L. Burke, Christopher W. Dunn, David C. Atkins, and Jerry S. Phelps. 2004. The emerging evidence base for motivational interviewing: A meta-analytic and qualitative inquiry. J. Cog. Psychother. 18, 4 (2004), 309--322.Google ScholarCross Ref
- Susan B. Campbell, Nina B. Leezenbaum, Amanda S. Mahoney, Elizabeth L. Moore, and Celia A. Brownell. 2016. Pretend play and social engagement in toddlers at high and low genetic risk for autism spectrum disorder. J. Autism Dev. Disord. 46, 7 (2016), 2305--2316.Google ScholarCross Ref
- Jennifer Carlson and Robin R. Murphy. 2005. How UGVs physically fail in the field. IEEE Trans. Robot. 21, 3 (2005), 423--437.Google ScholarDigital Library
- David Cesarini, Christopher T. Dawes, James H. Fowler, Magnus Johannesson, Paul Lichtenstein, and Björn Wallace. 2008. Heritability of cooperative behavior in the trust game. Proc. Nat. Acad. Sci. 105, 10 (2008), 3721--3726.Google ScholarCross Ref
- Nikhil Churamani, Paul Anton, Marc Brügger, Erik Fließwasser, Thomas Hummel, Julius Mayer, Waleed Mustafa, Hwei Geok Ng, Thi Linh Chi Nguyen, Quan Nguyen, et al. 2017. The impact of personalisation on human-robot interaction in learning scenarios. In Proceedings of the 5th International Conference on Human Agent Interaction. ACM, 171--180.Google ScholarDigital Library
- Sheldon Cohen. 2004. Social relationships and health. Amer. Psychol. 59, 8 (2004), 676.Google ScholarCross Ref
- Joe Connolly, Viola Mocz, Nicole Salomons, Joseph Valdez, Nathan Tsoi, Brian Scassellati, and Marynel Vázquez. 2020. Prompting prosocial human interventions in response to robot mistreatment. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 211--220.Google ScholarDigital Library
- Amy J. C. Cuddy, Susan T. Fiske, and Peter Glick. 2007. The BIAS map: Behaviors from intergroup affect and stereotypes. J. Personal. Soc. Psychol. 92, 4 (2007), 631.Google ScholarCross Ref
- Benjamin M. P. Cuff, Sarah J. Brown, Laura Taylor, and Douglas J. Howat. 2016. Empathy: A review of the concept. Emot. Rev. 8, 2 (2016), 144--153.Google ScholarCross Ref
- Mark H. Davis. 1980. Interpersonal Reactivity Index. Edwin Mellen Press.Google Scholar
- Mark H. Davis et al. 1980. A multidimensional approach to individual differences in empathy. JSAS Catalog of Selected Documents in Psychology 10 (1980), 85.Google Scholar
- Maartje De Graaf, Somaya Ben Allouch, and Jan Van Dijk. 2017. Why do they refuse to use my robot?: Reasons for non-use derived from a long-term home study. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 224--233.Google ScholarDigital Library
- Frits de Nijs. 2019. Resource-constrained Multi-agent Markov Decision Processes. Ph.D. Dissertation. Delft University of Technology. SIKS Dissertation Series.Google Scholar
- Jean Decety and Philip L. Jackson. 2004. The functional architecture of human empathy. Behav. Cog. Neurosci. Rev. 3, 2 (2004), 71--100.Google ScholarCross Ref
- Jean Decety and Meghan Meyer. 2008. From emotion resonance to empathic understanding: A social developmental neuroscience account. Dev. Psychopathol. 20, 4 (2008), 1053--1080.Google ScholarCross Ref
- Lambert Deckers and John Devine. 1981. Humor by violating an existing expectancy. J. Psychol. 108, 1 (1981), 107--110.Google ScholarCross Ref
- Graham Denyer. 2005. Davis Station Antarctica, Australian Antarctic Programme. Wikipedia. Retrieved from https://en.wikipedia.org/wiki/Davis_Station.Google Scholar
- Pieter T. M. Desmet, David De Cremer, and Eric van Dijk. 2011. Trust recovery following voluntary or forced financial compensations in the trust game: The role of trait forgiveness. Personal. Indiv. Diff. 51, 3 (2011), 267--273.Google ScholarCross Ref
- Joshua J. Diehl, Charles R. Crowell, Michael Villano, Kristin Wier, Karen Tang, and Laurel D. Riek. 2014. Clinical applications of robots in autism spectrum disorder diagnosis and treatment. In Comprehensive Guide to Autism. Springer, 411--422.Google Scholar
- Andreas Diekmann. 2004. The power of reciprocity: Fairness, reciprocity, and stakes in variants of the dictator game. J. Conflict Resol. 48, 4 (2004), 487--505.Google ScholarCross Ref
- Pierre Dillenbourg and David Traum. 2006. Sharing solutions: Persistence and grounding in multimodal collaborative problem-solving. J. Learn. Sci. 15, 1 (2006), 121--151.Google ScholarCross Ref
- Grazia D’Onofrio, Daniele Sancarlo, Francesco Ricciardi, Francesco Panza, Davide Seripa, Filippo Cavallo, Francesco Giuliani, and Antonio Greco. 2017. Information and communication technologies for the activities of daily living in older patients with dementia: A systematic review. J. Alzheim. Dis. 57, 3 (2017), 927--935.Google ScholarCross Ref
- Isabel Dziobek, Stefan Fleck, Elke Kalbe, Kimberley Rogers, Jason Hassenstab, Matthias Brand, Josef Kessler, Jan K. Woike, Oliver T. Wolf, and Antonio Convit. 2006. Introducing MASC: A movie for the assessment of social cognition. J. Autism Dev. Disord. 36, 5 (2006), 623--636.Google ScholarCross Ref
- Jon Elster. 1989. Social norms and economic theory. J. Econ. Perspect. 3, 4 (1989), 99--117.Google ScholarCross Ref
- Ernst Fehr and Urs Fischbacher. 2004. Social norms and human cooperation. Trends Cog. Sci. 8, 4 (2004), 185--190.Google ScholarCross Ref
- Oriel Feldman Hall and Luke J. Chang. 2018. Social learning: Emotions aid in optimizing goal-directed social behavior. In Goal-directed Decision Making. Elsevier, 309--330.Google Scholar
- Gary Alan Fine and Ugo Corte. 2017. Group pleasures: Collaborative commitments, shared narrative, and the sociology of fun. Sociol. Theor. 35, 1 (2017), 64--86.Google ScholarCross Ref
- Susan T. Fiske, Amy J. C. Cuddy, Peter Glick, and Jun Xu. 2002. A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. J. Personal. Soc. Psychol. 82, 6 (2002), 878.Google ScholarCross Ref
- Terrence Fong, Charles Thorpe, and Charles Baur. 2003. Collaboration, dialogue, human-robot interaction. In Robotics Research. Springer, 255--266.Google Scholar
- Laura Fratiglioni, Hui-Xin Wang, Kjerstin Ericsson, Margaret Maytan, and Bengt Winblad. 2000. Influence of social network on occurrence of dementia: A community-based longitudinal study. Lancet 355, 9212 (2000), 1315--1319.Google Scholar
- Uta Frith. 2003. Autism: Explaining the Enigma. Blackwell Publishing.Google Scholar
- Alastair Gale and Takashi Mochizuki. 2019. Robot hotel loses love for robots. The Wall Street Journal (Jan. 2019). Retrieved from https://www.wsj.com/articles/robot-hotel-loses-love-for-robots-11547484628.Google Scholar
- Jolene Galegher, Robert E. Kraut, and Carmen Egido. 2014. Intellectual Teamwork: Social and Technological Foundations of Cooperative Work. Psychology Press.Google ScholarCross Ref
- Denise Y. Geiskkovitch, Raquel Thiessen, James E. Young, and Melanie R. Glenwright. 2019. What? That’s not a chair!: How robot informational errors affect children’s trust towards robots. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 48--56.Google Scholar
- Andrew D. Gershoff and Jonathan J. Koehler. 2011. Safety first? The role of emotion in safety product betrayal aversion. J. Consum. Res. 38, 1 (2011), 140--150.Google ScholarCross Ref
- Manuel Giuliani, Nicole Mirnig, Gerald Stollnberger, Susanne Stadler, Roland Buchner, and Manfred Tscheligi. 2015. Systematic analysis of video data from different human-robot interaction studies: A categorization of social signals during error situations. Front. Psychol. 6 (2015), 931.Google ScholarCross Ref
- Ofer Golan, Simon Baron-Cohen, Jacqueline J. Hill, and Yael Golan. 2006. The “reading the mind in films” task: Complex emotion recognition in adults with and without autism spectrum conditions. Soc. Neurosci. 1, 2 (2006), 111--123.Google ScholarCross Ref
- Susel Góngora Alonso, Sofiane Hamrioui, Isabel de la Torre Díez, Eduardo Motta Cruz, Miguel López-Coronado, and Manuel Franco. 2018. Social robots for people with aging and dementia: A systematic review of literature. Telemed. e-Health 25, 7 (2018), 533--540.Google ScholarCross Ref
- Katherine Gotham, Susan Risi, Andrew Pickles, and Catherine Lord. 2007. The autism diagnostic observation schedule: Revised algorithms for improved diagnostic validity. J. Autism Dev. Disord. 37, 4 (2007), 613.Google ScholarCross Ref
- Cornelius T. Gross and Newton Sabino Canteras. 2012. The many paths to fear. Nat. Rev. Neurosci. 13, 9 (2012), 651.Google ScholarCross Ref
- Shang Guo, Jonathan Lenchner, Jonathan Connell, Mishal Dholakia, and Hidemasa Muta. 2017. Conversational bootstrapping and other tricks of a concierge robot. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 73--81.Google ScholarDigital Library
- Amy G. Halberstadt, Susanne A. Denham, and Julie C. Dunsmore. 2001. Affective social competence. Soc. Dev. 10, 1 (2001), 79--119.Google ScholarCross Ref
- Pippa Hall. 2005. Interprofessional teamwork: Professional cultures as barriers. J. Interprof. Care 19, sup1 (2005), 188--196.Google Scholar
- Peter A. Hancock, Deborah R. Billings, Kristin E. Schaefer, Jessie Y. C. Chen, Ewart J. De Visser, and Raja Parasuraman. 2011. A meta-analysis of factors affecting trust in human-robot interaction. Hum. Fact. 53, 5 (2011), 517--527.Google ScholarCross Ref
- Elaine Hatfield, John T. Cacioppo, and Richard L. Rapson. 1993. Emotional contagion. Curr. Direct. Psychol. Sci. 2, 3 (1993), 96--100.Google ScholarCross Ref
- Lisa Heavey, Wendy Phillips, Simon Baron-Cohen, and Michael Rutter. 2000. The awkward moments test: A naturalistic measure of social understanding in autism. J. Autism Dev. Disord. 30, 3 (2000), 225--236.Google ScholarCross Ref
- Marcel Heerink, Ben Krose, Vanessa Evers, and Bob Wielinga. 2006. The influence of a robot’s social abilities on acceptance by elderly users. In Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN’06). IEEE, 521--526.Google ScholarCross Ref
- Julia Hirschberg. 2011. Speaking more like you: Entrainment in conversational speech. In Proceedings of the 12th Conference of the International Speech Communication Association.Google Scholar
- Guy Hoffman and Cynthia Breazeal. 2004. Collaboration in human-robot teams. In Proceedings of the AIAA 1st Intelligent Systems Technical Conference. 6434.Google ScholarCross Ref
- Shanee Sarah Honig and Tal Oron-Gilad. 2018. Understanding and resolving failures in human-robot interaction: Literature review and model development. Front. Psychol. 9 (2018), 861.Google ScholarCross Ref
- Leonard M. Horowitz, Saul E. Rosenberg, Barbara A. Baer, Gilbert Ureño, and Valerie S. Villaseñor. 1988. Inventory of interpersonal problems: Psychometric properties and clinical applications. J. Consult. Clin. Psychol. 56, 6 (1988), 885.Google ScholarCross Ref
- James S. House, Cynthia Robbins, and Helen L. Metzner. 1982. The association of social relationships and activities with mortality: Prospective evidence from the Tecumseh Community Health Study. Amer. J. Epidem. 116, 1 (1982), 123--140.Google ScholarCross Ref
- Chien-Ming Huang and Bilge Mutlu. 2014. Learning-based modeling of multimodal behaviors for humanlike robots. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 57--64.Google ScholarDigital Library
- Bahar Irfan, Aditi Ramachandran, Samuel Spaulding, Dylan F. Glas, Iolanda Leite, and Kheng Lee Koay. 2019. Personalization in long-term human-robot interaction. In Proceedings of the 14th ACM/IEEE International Conference on Human-robot Interaction (HRI’19). IEEE, 685--686.Google ScholarDigital Library
- K. Izuma, K. Matsumoto, C. F. Camerer, and R. Adolphs. 2011. Insensitivity to social reputation in autism. Proc. Nat. Acad. Sci. 108, 42 (2011), 17302--17307.Google ScholarCross Ref
- John A. Johnson, Jonathan M. Cheek, and Robert Smither. 1983. The structure of empathy. J. Personal. Soc. Psychol. 45, 6 (1983), 1299--1312.Google ScholarCross Ref
- Gareth R. Jones and Jennifer M. George. 1998. The experience and evolution of trust: Implications for cooperation and teamwork. Acad. Manag. Rev. 23, 3 (1998), 531--546.Google ScholarCross Ref
- Malte F. Jung. 2017. Affective grounding in human-robot interaction. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 263--273.Google ScholarDigital Library
- Malte F. Jung, Nikolas Martelaro, and Pamela J. Hinds. 2015. Using robots to moderate team conflict: The case of repairing violations. In Proceedings of the 10th ACM/IEEE International Conference on Human-robot Interaction. ACM, 229--236.Google Scholar
- Daniel Kahneman, Jack L. Knetsch, and Richard Thaler. 1986. Fairness as a constraint on profit seeking: Entitlements in the market. Amer. Econ. Rev. 76, 4 (1986), 728--741.Google Scholar
- Daniel Kahneman, David Schkade, and Cass Sunstein. 1998. Shared outrage and erratic awards: The psychology of punitive damages. J. Risk Uncert. 16, 1 (1998), 49--86.Google ScholarCross Ref
- Yusuke Kato, Takayuki Kanda, and Hiroshi Ishiguro. 2015. May I help you?: Design of human-like polite approaching behavior. In Proceedings of the 10th ACM/IEEE International Conference on Human-robot Interaction. ACM, 35--42.Google ScholarDigital Library
- Richard Kelley, Alireza Tavakkoli, Christopher King, Monica Nicolescu, Mircea Nicolescu, and George Bebis. 2008. Understanding human intentions via hidden Markov models in autonomous mobile robots. In Proceedings of the 3rd ACM/IEEE International Conference on Human-robot Interaction. ACM, 367--374.Google ScholarDigital Library
- Adam Kendon. 1990. Conducting Interaction: Patterns of Behavior in Focused Encounters. Vol. 7. CUP Archive.Google Scholar
- Cory D. Kidd and Cynthia Breazeal. 2004. Effect of a robot on user perceptions. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’04). IEEE, 3559--3564.Google Scholar
- Charles E. Kimble and Steven D. Seidel. 1991. Vocal signs of confidence. J. Nonverb. Behav. 15, 2 (1991), 99--105.Google ScholarCross Ref
- Erik O. Kimbrough and Alexander Vostroknutov. 2016. Norms make preferences social. J. Eur. Econ. Assoc. 14, 3 (2016), 608--638.Google ScholarCross Ref
- Masanori Kimura and Ikuo Daibo. 2006. Interactional synchrony in conversations about emotional episodes: A measurement by “the between-participants pseudosynchrony experimental paradigm.”J. Nonverb. Behav. 30, 3 (2006), 115--126.Google ScholarCross Ref
- Kyveli Kompatsiari, Vadim Tikhanoff, Francesca Ciardo, Giorgio Metta, and Agnieszka Wykowska. 2017. The importance of mutual gaze in human-robot interaction. In Proceedings of the International Conference on Social Robotics. Springer, 443--452.Google ScholarCross Ref
- Dimosthenis Kontogiorgos, Andre Pereira, Boran Sahindal, Sanne van Waveren, and Joakim Gustafson. 2020. Behavioural responses to robot conversational failures. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 53--62.Google ScholarDigital Library
- Agnieszka Korchut, Sebastian Szklener, Carla Abdelnour, Natalia Tantinya, Joan Hernández-Farigola, Joan Carles Ribes, Urszula Skrobas, Katarzyna Grabowska-Aleksandrowicz, Dorota Szczęśniak-Stańczyk, and Konrad Rejdak. 2017. Challenges for service robots—Requirements of elderly adults with cognitive impairments. Front. Neurol. 8 (2017), 228.Google ScholarCross Ref
- Alyssa Kubota, Emma I. C. Peterson, Vaishali Rajendren, Hadas Kress-Gazit, and Laurel D. Riek. 2020. JESSIE: Synthesizing social robot behaviors for personalized neurorehabilitation and beyond. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 121--130.Google Scholar
- Sari Kujala. 2003. User involvement: A review of the benefits and challenges. Behav. Inf. Technol. 22, 1 (2003), 1--16.Google ScholarCross Ref
- J. C. Laprie. 1995. Dependable computing and fault tolerance: Concepts and terminology. In Proceedings of the 25th International Symposium on Fault-tolerant Computing, Highlights from Twenty-Five Years. IEEE, 2.Google ScholarCross Ref
- Nada Lavrac, Peter Ljubic, Tanja Urbancic, Gregor Papa, Mitja Jermol, and Stefan Bollhalter. 2007. Trust modeling for networked organizations using reputation and collaboration estimates. IEEE Trans. Syst. Man Cyber. Part C (Applic. Rev.) 37, 3 (2007), 429--439.Google ScholarDigital Library
- John O. Ledyard. 1994. Public goods: A survey of experimental research. Social Science Working Paper. California Institute of Technology, Pasadena, CA. Retrieved on January 21, 2021 from https://resolver.caltech.edu/CaltechAUTHORS:20170823-160736011.Google Scholar
- Min Kyung Lee, Sara Kiesler, Jodi Forlizzi, Siddhartha Srinivasa, and Paul Rybski. 2010. Gracefully mitigating breakdowns in robotic services. In Proceedings of the 5th ACM/IEEE International Conference on Human-robot Interaction (HRI’10). IEEE, 203--210.Google ScholarDigital Library
- Wendy Leeds-Hurwitz. 1987. The social history of the natural history of an interview: A multidisciplinary investigation of social communication. Res. Lang. Soc. Interact. 20, 1--4 (1987), 1--51.Google ScholarCross Ref
- Benedikt Leichtmann and Verena Nitsch. 2020. How much distance do humans keep toward robots? Literature review, meta-analysis, and theoretical considerations on personal space in human-robot interaction. J. Environ. Psychol. 68 (2020), 101386.Google ScholarCross Ref
- Sergey Levine, Peter Pastor, Alex Krizhevsky, Julian Ibarz, and Deirdre Quillen. 2018. Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. Int. J. Robot. Res. 37, 4--5 (2018), 421--436.Google ScholarCross Ref
- Rivka Levitan, Agustín Gravano, Laura Willson, Stefan Benus, Julia Hirschberg, and Ani Nenkova. 2012. Acoustic-prosodic entrainment and social behavior. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 11--19.Google Scholar
- J. David Lewis and Andrew Weigert. 1985. Trust as a social reality. Soc. Forces 63, 4 (1985), 967--985.Google ScholarCross Ref
- M. Lewis, J. M. Laviland-Jones, and L. Fildman Barret. 2012. Self-conscious emotions-embarrassment, pride, shame, and guilt. Handbook of Emotions. The Guilford Press.Google Scholar
- Chang Liu, Jessica B. Hamrick, Jaime F. Fisac, Anca D. Dragan, J. Karl Hedrick, S. Shankar Sastry, and Thomas L. Griffiths. 2016. Goal inference improves objective and perceived performance in human-robot collaboration. In Proceedings of the International Conference on Autonomous Agents 8 Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems. 940--948.Google Scholar
- Catherine Lord, Susan Risi, Linda Lambrecht, Edwin H. Cook, Bennett L. Leventhal, Pamela C. DiLavore, Andrew Pickles, and Michael Rutter. 2000. The autism diagnostic observation schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. J. Autism Dev. Disord. 30, 3 (2000), 205--223.Google ScholarCross Ref
- Maurice Lorr, Richard P. Youniss, and Edward C. Stefic. 1991. An inventory of social skills. J. Personal. Assess. 57, 3 (1991), 506--520.Google ScholarCross Ref
- Joseph Lyons, Charlene Stokes, David Garcia, Justin Adams, and Dave Ames. 2009. Trust and decision-making: An empirical platform (CCP 204). IEEE Aerosp. Electron. Syst. Mag. 24, 10 (2009), 36--41.Google ScholarCross Ref
- Michael A. Madaio, Rae Lasko, Justine Cassell, and Amy Ogan. 2017. Using temporal association rule mining to predict dyadic rapport in peer tutoring. In Proceedings of the 10th International Conference on Educational Data Mining.Google Scholar
- Bertram F. Malle and Stuti Thapa Magar. 2017. What kind of mind do I want in my robot?: Developing a measure of desired mental capacities in social robots. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 195--196.Google Scholar
- Stacy C. Marsella and Jonathan Gratch. 2009. EMA: A process model of appraisal dynamics. Cog. Syst. Res. 10, 1 (2009), 70--90.Google ScholarDigital Library
- Andrew Maul. 2012. The validity of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) as a measure of emotional intelligence. Emot. Rev. 4, 4 (2012), 394--402.Google ScholarCross Ref
- Maranda McBride and Shona Morgan. 2010. Trust calibration for automated decision aids. Institute for Homeland Security Solutions. Retrieved January 21, 2021 from https://www.researchgate.net/publication/303168234_Trust_calibration_for_automated_decision_aids.Google Scholar
- Albert Mehrabian and Norman Epstein. 1972. A measure of emotional empathy. J. Personal. 40, 4 (1972), 525--543.Google ScholarCross Ref
- Hannah Mieczkowski, Sunny Xun Liu, Jeffrey Hancock, and Byron Reeves. 2019. Helping not hurting: Applying the Stereotype content model and BIAS map to social robotics. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 222--229.Google ScholarCross Ref
- Nicole Mirnig, Manuel Giuliani, Gerald Stollnberger, Susanne Stadler, Roland Buchner, and Manfred Tscheligi. 2015. Impact of robot actions on social signals and reaction times in HRI error situations. In Proceedings of the International Conference on Social Robotics. Springer, 461--471.Google ScholarCross Ref
- Nicole Mirnig, Gerald Stollnberger, Markus Miksch, Susanne Stadler, Manuel Giuliani, and Manfred Tscheligi. 2017. To err is robot: How humans assess and act toward an erroneous social robot. Front. Robot. AI 4 (2017), 21.Google ScholarCross Ref
- Thomas M. Moerland, Joost Broekens, and Catholijn M. Jonker. 2018. Emotion in reinforcement learning agents and robots: A survey. Mach. Learn. 107, 2 (2018), 443--480.Google ScholarDigital Library
- Lorenza Mondada. 2016. Challenges of multimodality: Language and the body in social interaction. J. Socioling. 20, 3 (2016), 336--366.Google ScholarCross Ref
- Elaine Mordoch, Angela Osterreicher, Lorna Guse, Kerstin Roger, and Genevieve Thompson. 2013. Use of social commitment robots in the care of elderly people with dementia: A literature review. Maturitas 74, 1 (2013), 14--20.Google ScholarCross Ref
- Shrikanth Narayanan and Panayiotis G. Georgiou. 2013. Behavioral signal processing: Deriving human behavioral informatics from speech and language. Proc. IEEE 101, 5 (2013), 1203--1233.Google ScholarCross Ref
- Truong-Huy D. Nguyen, Elin Carstensdottir, Nhi Ngo, Magy Seif El-Nasr, Matt Gray, Derek Isaacowitz, and David Desteno. 2015. Modeling warmth and competence in virtual characters. In Proceedings of the International Conference on Intelligent Virtual Agents. Springer, 167--180.Google ScholarCross Ref
- Paula M. Niedenthal, Magdalena Rychlowska, Adrienne Wood, and Fangyun Zhao. 2018. Heterogeneity of long-history migration predicts smiling, laughter and positive emotion across the globe and within the United States. PLoS ONE 13, 8 (2018), e0197651.Google ScholarCross Ref
- Stefanos Nikolaidis, Yu Xiang Zhu, David Hsu, and Siddhartha Srinivasa. 2017. Human-robot mutual adaptation in shared autonomy. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 294--302.Google ScholarDigital Library
- Donald A. Norman and Stephen W. Draper. 1986. User Centered System Design: New Perspectives on Human-computer Interaction. CRC Press.Google ScholarDigital Library
- Carlo Nuccio, Agnese Augello, Salvatore Gaglio, and Giovanni Pilato. 2017. Interaction capabilities of a robotic receptionist. In Proceedings of the International Conference on Intelligent Interactive Multimedia Systems and Services. Springer, 171--180.Google Scholar
- Keith Oatley and Philip N. Johnson-Laird. 1987. Towards a cognitive theory of emotions. Cog. Emot. 1, 1 (1987), 29--50.Google ScholarCross Ref
- Anna Ogarkova. 2016. Translatability of emotions. In Emotion Measurement. Elsevier, 575--599.Google Scholar
- Sharon Oviatt. 2013. The Design of Future Educational Interfaces. Routledge.Google Scholar
- Sharon Oviatt, Margaret MacEachern, and Gina-Anne Levow. 1998. Predicting hyperarticulate speech during human-computer error resolution. Speech Commun. 24, 2 (1998), 87--110.Google ScholarDigital Library
- Maike Paetzel, Giulia Perugia, and Ginevra Castellano. 2020. The persistence of first impressions: The effect of repeated interactions on the perception of a social robot. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 73--82.Google ScholarDigital Library
- Ana Paiva, Iolanda Leite, Hana Boukricha, and Ipke Wachsmuth. 2017. Empathy in virtual agents and robots: A survey. ACM Trans. Interact. Intell. Syst. 7, 3 (2017), 11.Google ScholarDigital Library
- Lucas Paletta, Maria Fellner, Sandra Schüssler, Julia Zuschnegg, Josef Steiner, Alexander Lerch, Lara Lammer, and Dimitrios Prodromou. 2018. AMIGO: Towards social robot based motivation for playful multimodal intervention in dementia. In Proceedings of the 11th Pervasive Technologies Related to Assistive Environments Conference. ACM, 421--427.Google ScholarDigital Library
- Lawrence A. Palinkas and Peter Suedfeld. 2008. Psychological effects of polar expeditions. Lancet 371, 9607 (2008), 153--163.Google ScholarCross Ref
- Luiz Pessoa. 2018. Emotion and the interactive brain: Insights from comparative neuroanatomy and complex systems. Emot. Rev. 10, 3 (2018), 204--216.Google ScholarCross Ref
- Rosalind W. Picard. 2000. Affective Computing. The MIT Press.Google ScholarDigital Library
- Soujanya Poria, Erik Cambria, Rajiv Bajpai, and Amir Hussain. 2017. A review of affective computing: From unimodal analysis to multimodal fusion. Inf. Fus. 37 (2017), 98--125.Google ScholarDigital Library
- K. P. Rankin. 2008. Social norms questionaire. NINDS: Domain Specific Tasks of Executive Function. Retrieved January 21, 2021 from https://memory.ucsf.edu/sites/memory.ucsf.edu/files/wysiwyg/EXAMINER_UserManual_3.6r.pdf.Google Scholar
- K. P. Rankin, E. Baldwin, C. Pace-Savitsky, J. H. Kramer, and B. L. Miller. 2005. Self awareness and personality change in dementia. J. Neurol. Neurosurg. Psychia. 76, 5 (2005), 632--639.Google ScholarCross Ref
- P. L. Patrick Rau, Ye Li, and Dingjun Li. 2009. Effects of communication style and culture on ability to accept recommendations from robots. Comput. Hum. Behav. 25, 2 (2009), 587--595.Google ScholarDigital Library
- H. C. Ravichandar and A. Dani. 2017. Intention inference for human-robot collaboration in assistive robotics. In Human Modelling for Bio-inspired Robotics. Elsevier, 217--249.Google Scholar
- Harish Chaandar Ravichandar and Ashwin P. Dani. 2017. Human intention inference using expectation-maximization algorithm with online model learning. IEEE Trans. Automat. Sci. Eng. 14, 2 (2017), 855--868.Google ScholarCross Ref
- Laurel D. Riek. 2016. Robotics technology in mental health care. In Artificial Intelligence in Behavioral and Mental Health Care. Elsevier, 185--203.Google Scholar
- Ronald E. Riggio. 1986. Assessment of basic social skills. J. Personal. Soc. Psychol. 51, 3 (1986), 649.Google ScholarCross Ref
- Paul Robinette, Ayanna M. Howard, and Alan R. Wagner. 2017. Effect of robot performance on human-robot trust in time-critical situations. IEEE Trans. Hum.-mach. Syst. 47, 4 (2017), 425--436.Google ScholarCross Ref
- Howard J. Rosen, Katherine Pace-Savitsky, Richard J. Perry, Joel H. Kramer, Bruce L. Miller, and Robert W. Levenson. 2004. Recognition of emotion in the frontal and temporal variants of frontotemporal dementia. Dement. Geriat. Cog. Disord. 17, 4 (2004), 277--281.Google ScholarCross Ref
- Robert Ross, Rem Collier, and Gregory M. P. O’Hare. 2004. Demonstrating social error recovery with AgentFactory. In Proceedings of the 3rd International Joint Conference on Autonomous Agents and Multiagent Systems. IEEE Computer Society, 1424--1425.Google Scholar
- Alessandra Rossi, Kerstin Dautenhahn, Kheng Lee Koay, and Michael L. Walters. 2017. Human perceptions of the severity of domestic robot errors. In Proceedings of the International Conference on Social Robotics. Springer, 647--656.Google Scholar
- Silvia Rossi, Francois Ferland, and Adriana Tapus. 2017. User profiling and behavioral adaptation for HRI: A survey. Pattern Recog. Lett. 99 (2017), 3--12.Google ScholarDigital Library
- Mary Beth Rosson and John M. Carroll. 2009. Scenario based design. In Proceedings of the Conference on Human-computer Interaction. 145--162.Google Scholar
- James A. Russell. 1991. Culture and the categorization of emotions. Psychol. Bull. 110, 3 (1991), 426.Google ScholarCross Ref
- Mel D. Rutherford, Simon Baron-Cohen, and Sally Wheelwright. 2002. Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. J. Autism Dev. Disord. 32, 3 (2002), 189--194.Google ScholarCross Ref
- Magdalena Rychlowska, Rachael E. Jack, Oliver G. B. Garrod, Philippe G. Schyns, Jared D. Martin, and Paula M. Niedenthal. 2017. Functional smiles: Tools for love, sympathy, and war. Psychol. Sci. 28, 9 (2017), 1259--1270.Google ScholarCross Ref
- Selma Sabanovic, Casey C. Bennett, Wan-Ling Chang, and Lesa Huber. 2013. PARO robot affects diverse interaction modalities in group sensory therapy for older adults with dementia. In Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR’13). IEEE, 1--6.Google ScholarCross Ref
- Alessandra Maria Sabelli, Takayuki Kanda, and Norihiro Hagita. 2011. A conversational robot in an elderly care center: An ethnographic study. In Proceedings of the 6th ACM/IEEE International Conference on Human-robot Interaction (HRI’11). IEEE, 37--44.Google ScholarDigital Library
- Maha Salem, Gabriella Lakatos, Farshid Amirabdollahian, and Kerstin Dautenhahn. 2015. Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. In Proceedings of the 10th ACM/IEEE International Conference on Human-robot Interaction. ACM, 141--148.Google ScholarDigital Library
- Kristin Schaefer. 2013. The Perception and Measurement of Human-Robot Trust. Ph.D. Dissertation. University of Central Florida.Google Scholar
- Susanne Scheibe and Laura L. Carstensen. 2010. Emotional aging: Recent findings and future trends. J. Geront.: Series B 65, 2 (2010), 135--144.Google ScholarCross Ref
- Sarah Strohkorb Sebo, Priyanka Krishnamurthi, and Brian Scassellati. 2019. “I don’t believe you”: Investigating the effects of robot trust violation and repair. In Proceedings of the 14th ACM/IEEE International Conference on Human-robot Interaction (HRI’19). IEEE, 57--65.Google ScholarCross Ref
- Stela H. Seo, Keelin Griffin, James E. Young, Andrea Bunt, Susan Prentice, and Verónica Loureiro-Rodríguez. 2018. Investigating people’s rapport building and hindering behaviors when working with a collaborative robot. Int. J. Soc. Robot. 10, 1 (2018), 147--161.Google ScholarCross Ref
- Amanda Sharkey and Noel Sharkey. 2012. Granny and the robots: Ethical issues in robot care for the elderly. Ethics Inf. Technol. 14, 1 (2012), 27--40.Google ScholarDigital Library
- Thomas B. Sheridan. 2016. Human--robot interaction: Status and challenges. Hum. Fact. 58, 4 (2016), 525--532.Google ScholarCross Ref
- Herbert A. Simon. 1967. Motivational and emotional controls of cognition. Psychol. Rev. 74, 1 (1967), 29.Google ScholarCross Ref
- Dirk Sliwka. 2007. Trust as a signal of a social norm and the hidden costs of incentive schemes. Amer. Econ. Rev. 97, 3 (2007), 999--1012.Google ScholarCross Ref
- Paul Slovic, Ellen Peters, Melissa L. Finucane, and Donald G. MacGregor. 2005. Affect, risk, and decision making. Health Psychol. 24, 4S (2005), S35.Google ScholarCross Ref
- Rajka Smiljanic and Rachael C. Gilbert. 2017. Acoustics of clear and noise-adapted speech in children, young, and older adults. J. Speech, Lang. Hear. Res. 60, 11 (2017), 3081--3096.Google ScholarCross Ref
- Douglas K. Snyder, Richard E. Heyman, and Stephen N. Haynes. 2005. Evidence-based approaches to assessing couple distress. Psychol. Assess. 17, 3 (2005), 288.Google ScholarCross Ref
- Gerald Steinbauer. 2013. A survey about faults of robots used in RoboCup. In Proceedings of the Robot Soccer World Cup XVI (RoboCup’12). Springer, 344--355.Google ScholarCross Ref
- Dag Sverre Syrdal, Michael L. Walters, Nuno Otero, Kheng Lee Koay, and Kerstin Dautenhahn. 2007. He knows when you are sleeping—Privacy and the personal robot companion. In Proceedings of the Workshop on Human Implications of Human-robot Interaction, Association for the Advancement of Artificial Intelligence (AAAI’07). 28--33.Google Scholar
- Peggy A. Thoits. 2004. Emotion norms, emotion work, and social order. In Feelings and Emotions: The Amsterdam Symposium. Cambridge University Press, New York, NY, 359--378.Google ScholarCross Ref
- Suzanne Tolmeijer, Astrid Weiss, Marc Hanheide, Felix Lindner, Thomas M. Powers, Clare Dixon, and Myrthe L. Tielman. 2020. Taxonomy of trust-relevant failures and mitigation strategies. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. 3--12.Google Scholar
- Ha Trinh, Reza Asadi, Darren Edge, and T. Bickmore. 2017. Robocop: A robotic coach for oral presentations. Proc. ACM Interact. Mob. Wear. Ubiq. Technol. 1, 2 (2017), 1--24.Google ScholarDigital Library
- Tom Richard Tyler. 1996. Trust in Organizations: Frontiers of Theory and Research. Sage.Google Scholar
- Anouk van Maris, Hagen Lehmann, Lorenzo Natale, and Beata Grzyb. 2017. The influence of a robot’s embodiment on trust: A longitudinal study. In Proceedings of the ACM/IEEE International Conference on Human-robot Interaction. ACM, 313--314.Google ScholarDigital Library
- Fabio Vannucci, Alessandra Sciutti, Marco Jacono, Giulio Sandini, and Francesco Rea. 2017. Adaptation to a humanoid robot in a collaborative joint task. In Proceedings of the 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN’17). IEEE, 360--365.Google ScholarDigital Library
- Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D’Errico, and Marc Schroeder. 2012. Bridging the gap between social animal and unsocial machine: A survey of social signal processing. IEEE Trans. Affect. Comput. 3, 1 (2012), 69--87.Google ScholarDigital Library
- Ning Wang, David V. Pynadath, and Susan G. Hill. 2016. Trust calibration within a human-robot team: Comparing automatically generated explanations. In Proceedings of the 11th ACM/IEEE International Conference on Human-robot Interaction. IEEE Press, 109--116.Google ScholarDigital Library
- Kristine N. Williams, Ruth Herman, Byron Gajewski, and Kristel Wilson. 2009. Elderspeak communication: Impact on dementia care. Amer. J. Alzh. Dis. Other Dement. 24, 1 (2009), 11--20.Google ScholarCross Ref
- Anita Williams Woolley, Christopher F. Chabris, Alex Pentland, Nada Hashmi, and Thomas W. Malone. 2010. Evidence for a collective intelligence factor in the performance of human groups. Science 330, 6004 (2010), 686--688.Google ScholarCross Ref
- Jane Wu, Erin Paeng, Kari Linder, Piercarlo Valdesolo, and James C. Boerkoel. 2016. Trust and cooperation in human-robot decision making. In Proceedings of the AAAI Fall Symposium Series.Google Scholar
- Bo Xiao, Zac E. Imel, Panayiotis Georgiou, David C. Atkins, and Shrikanth S. Narayanan. 2016. Computational analysis and simulation of empathic behaviors: A survey of empathy modeling with behavioral signal processing framework. Curr. Psychiat. Rep. 18, 5 (2016), 49.Google ScholarCross Ref
- Akihito Yatsuda, Toshiyuki Haramaki, and Hiroaki Nishino. 2018. A robot gesture framework for watching and alerting the elderly. In Proceedings of the International Conference on Network-based Information Systems. Springer, 132--143.Google Scholar
- Zhou Yu, Vikram Ramanarayanan, Patrick Lange, and David Suendermann-Oeft. 2019. An open-source dialog system with real-time engagement tracking for job interview training applications. In Advanced Social Interaction with Agents. Springer, 199--207.Google Scholar
- Beste F. Yuksel, Penny Collisson, and Mary Czerwinski. 2017. Brains or beauty: How to engender trust in user-agent interactions. ACM Trans. Internet Technol. 17, 1 (2017), 2.Google ScholarDigital Library
- Shujie Zhou and Tian Leimin. 2020. Would you help a sad robot? Influence of robots’ emotional expressions on human-multi-robot collaboration. In Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN’20). IEEE.Google ScholarCross Ref
Index Terms
- A Taxonomy of Social Errors in Human-Robot Interaction
Recommendations
Evaluating Social Perception of Human-to-Robot Handovers Using the Robot Social Attributes Scale (RoSAS)
HRI '18: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot InteractionThis work explores social perceptions of robots within the domain of human-to-robot handovers. Using the Robotic Social Attributes Scale (RoSAS), we explore how users socially judge robot receivers as three factors are varied: initial position of the ...
Human-Robot Trust: Just a Button Press Away
HRI '17: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot InteractionMany of the benefits promised by human-robot interaction require successful continued interaction between a human and a robot; trust is a key component of such interaction. We investigate whether having a person "n the loop" with a robot---i.e., the ...
A Taxonomy of Robot Autonomy for Human-Robot Interaction
HRI '24: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot InteractionRobot autonomy is an influential and ubiquitous factor in human-robot interaction (HRI), but it is rarely discussed beyond a one-dimensional measure of the degree to which a robot operates without human intervention. As robots become more sophisticated, ...
Comments