Skip to main content

Humanoid Robot Assisted Training for Facial Expressions Recognition Based on Affective Feedback

  • Conference paper
  • First Online:
Social Robotics (ICSR 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9388))

Included in the following conference series:

Abstract

Different studies explore the use of electronic screen media to train specific social skills, since they provide visual elements which are well accepted by children with ASD. However, even if children have high levels of attention to the screen, this might also reduce the possibilities of interacting with others. The challenge lays on finding ways to encourage and motivate the child to keep learning and share the experience with others. For this reason, we propose a feasible framework composed of three technologies: a tablet to train facial expressions recognition, a humanoid robot as reinforcer, and a wearable device to quantify smiles. We did a feasibility test with adults not only to verify the machine response, but also to obtain qualitative data regarding the interaction with the robot. In this study we analyze the importance and the synergistic effect of combining screen media with the robot embodiment and affective computing technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Lal, R., Bali, M.: Effect of visual strategies on development of communication skills in children with autism. Asia Pacific Disability Rehabilitation Journal 18(2), 120–130 (2007)

    Google Scholar 

  2. Mineo, B.A., Ziegler, W., Gill, S., Salkin, D.: Engagement with electronic screen media among students with autism spectrum disorders. Journal of Autism and Developmental Disorders 39(1), 172–187 (2009)

    Article  Google Scholar 

  3. Miranda, J.C., Fernandes, T., Sousa, A., Orvalho, V.: Interactive technology: teaching people with autism to recognize facial emotions. In: Autism Spectrum Disorders-From Genes to Environment, pp. 299–312 (2011)

    Google Scholar 

  4. Kim, E., Berkovits, L., Bernier, E., Leyzberg, D., Shic, F., Paul, R., Scassellati, B.: Social robots as embedded reinforcers of social behavior in children with autism. Journal of Autism and Developmental Disorders 43(5), 1038–1049 (2013)

    Article  Google Scholar 

  5. Diehl, J., Schmitt, L., Villano, M., Crowell, C.: The clinical use of robots for individuals with autism spectrum disorders: A critical review. Research in Autism Sprectrum Disorders 6(1), 249–262 (2012)

    Article  Google Scholar 

  6. Ricks, D.J., Colton, M.B.: Trends and considerations in robot-assisted autism therapy. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 4354–4359 (2010)

    Google Scholar 

  7. Scassellati, B., Admoni, H., Mataric, M.: Robots for use in autism research. Annual Review of Biomedical Engineering 14, 275–294 (2012)

    Article  Google Scholar 

  8. Matsuda, S., Yamamoto, J.: Computer-based intervention for inferring facial expressions from the socio-emotional context in two children with autism spectrum disorders. Research in Autism Spectrum Disorders 8(8), 944–950 (2014)

    Article  Google Scholar 

  9. Hirokawa, M., Funahashi, A., Itoh, Y., Suzuki, K.: Design of affective robot-assisted activity for children with autism spectrum disorders. In: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 365–370 (2014)

    Google Scholar 

  10. Gruebler, A., Suzuki, K.: Design of a wearable device for reading positive expressions from facial emg signals. IEEE Transactions on Affective Computing 5(3), 227–237 (2014)

    Article  Google Scholar 

  11. Funahashi, A., Gruebler, A., Aoki, T., Kadone, H., Suzuki, K.: Brief report: the smiles of a child with autism spectrum disorder during an animal-assisted activity may facilitate social positive behaviors-quantitative analysis with smile-detecting interface. Journal of Autism and Developmental Disorders 44, 685–693 (2014)

    Article  Google Scholar 

  12. Vanderborght, B., Simut, R., Saldien, J., Pop, C., Rusu, A.S., Pintea, S., Lefeber, D., David, D.O.: Using the social robot probo as a social story telling agent for children with ASD. Interaction Studies 13(3), 348–372 (2012)

    Article  Google Scholar 

  13. Gillesen, J.C.C., Barakova, E.I., Huskens, B.E.B.M., Feijs, L.M.G.: From training to robot behavior: towards custom scenarios for robotics in training programs for ASD. In: IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–7 (2011)

    Google Scholar 

  14. Hamzah, M.S.J., Shamsuddin, S., Miskam, M.A., Yussof, H., Hashim, K.S.: Development of interaction scenarios based on pre-school curriculum in robotic intervention for children with autism. Procedia Computer Science 42, 214–221 (2014)

    Article  Google Scholar 

  15. Giullian, N., Ricks, D., Atherton, A., Colton, M., Goodrich, M., Brinton, B.: Detailed requirements for robots in autism therapy. In: IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2595–2602 (2010)

    Google Scholar 

  16. Watson, D., Clark, L.A., Tellegen, A.: Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 54(6), 1063–1070 (1988)

    Article  Google Scholar 

  17. Plant, R.W., Ryan, R.M.: Intrinsic motivation and the effects of self-consciousness, self-awareness, and ego-involvement: An investigation of internally controlling styles. Journal of Personality 53(3), 435–449 (1985)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eleuda Nunez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Nunez, E., Matsuda, S., Hirokawa, M., Suzuki, K. (2015). Humanoid Robot Assisted Training for Facial Expressions Recognition Based on Affective Feedback. In: Tapus, A., André, E., Martin, JC., Ferland, F., Ammi, M. (eds) Social Robotics. ICSR 2015. Lecture Notes in Computer Science(), vol 9388. Springer, Cham. https://doi.org/10.1007/978-3-319-25554-5_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25554-5_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25553-8

  • Online ISBN: 978-3-319-25554-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics