Skip to main content
SpringerLink
Log in
Book cover

Frontiers in Electronic Technologies pp 1–23Cite as

Nadine: A Social Robot that Can Localize Objects and Grasp Them in a Human Way

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 433))

Abstract

What makes a social humanoid robot behave like a human? It needs to understand and show emotions, has a chat box, a memory and also a decision-making process. However, more than that, it needs to recognize objects and be able to grasp them in a human way. To become an intimate companion, social robots need to behave the same way as real humans in all areas and understand real situations in order they can react properly. In this chapter, we describe our ongoing research on social robotics. It includes the making of articulated hands of Nadine Robot, the recognition of objects and their signification, as well as how to grasp them in a human way. State of the art is presented as well as some early results.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Uncanny valley, in Wikipedia. https://en.wikipedia.org/wiki/Uncanny_valley. Accessed 28 Nov 2016

  2. https://funwithluka.files.wordpress.com/2015/03/img2885.jpg. Accessed 13 Nov 2016

  3. Nadine social robot, in Wikipedia. https://en.wikipedia.org/wiki/Nadine_Social_Robot. Accessed 28 Nov 2016

  4. Atlas (robot), in Wikipedia. https://en.wikipedia.org/wiki/Atlas_(robot). Accessed 30 Nov 2016

  5. Y. Sakagami, R. Watanabe, C. Aoyama et al., The intelligent ASIMO: system overview and integration, in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2002, vol. 3, (IEEE, 2002), pp. 2478-2483

    Google Scholar 

  6. G. Metta, G. Sandini, D. Vernon, L. Natale, F. Nori, The iCub humanoid robot: an open platform for research in embodied cognition, in PerMIS’08 Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, pp. 50–56

    Google Scholar 

  7. Actroid, in Wikipedia. https://en.wikipedia.org/wiki/Actroid. Accessed 28 Nov 2016

  8. T. Times, Meet Jiajia, china’s new interactive robot. http://www.techtimes.com/articles/150827/20160416/meet-jiajia-chinas-new-interactive-robot.htm. Accessed 30 Nov 2016

  9. Home, http://www.rickyma.hk/. Accessed 30 Nov 2016

  10. R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in CVPR (2014)

    Google Scholar 

  11. R. Girshick, Fast r-cnn, in Proceedings of the IEEE International Conference on Computer Vision (2015), pp. 1440–1448

    Google Scholar 

  12. S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems (2015), pp. 91–99

    Google Scholar 

  13. J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in CVPR (2016)

    Google Scholar 

  14. W. Liu, D. Anguelov, D. Erhan et al., SSD: single shot multibox detector (2015). arXiv:1512.02325

  15. A. Saxena, J. Driemeyer, A.Y. Ng, Robotic grasping of novel objects using vision. Int. J. Rob. Res. 27(2), 157–173 (2008)

    Google Scholar 

  16. Q.V. Le, D. Kamm, A.F. Kara, A.Y. Ng, Learning to grasp objects with multiple contact points, in IEEE International Conference on Robotics and Automation (ICRA) (2010), pp. 5062–5069

    Google Scholar 

  17. Ian Lenz, Honglak Lee, Ashutosh Saxena, Deep learning for detecting robotic grasps. Int. J. Rob. Res. 34(4–5), 705–724 (2015)

    Article  Google Scholar 

  18. Y. Jiang, S. Moseson, A. Saxena, Efficient grasping from rgbd images: learning using a new rectangle representation, in IEEE International Conference on Robotics and Automation (ICRA) (2011), pp. 3304–3311

    Google Scholar 

  19. J. Redmon, A. Angelova, Real-time grasp detection using convolutional neural networks, in IEEE International Conference on Robotics and Automation (ICRA) (2015), pp. 1316–1322

    Google Scholar 

  20. D. Guo, T. Kong, F. Sun et al., Object discovery and grasp detection with a shared convolutional neural network, in 2016 IEEE International Conference on Robotics and Automation (ICRA). (IEEE, 2016), pp. 2038–2043

    Google Scholar 

  21. Adioshun, Results matching, https://adioshun.gitbooks.io/learning-opencv-3-computer-vision-with-python/content/learning_python_opencv_ch07.html. Accessed 21 Dec 2016

  22. G. Schreiber, A. Stemmer, R. Bischoff, The fast research interface for the kuka lightweight robot, in IEEE Workshop on Innovative Robot Control Architectures for Demanding (Research) Applications How to Modify and Enhance Commercial Controllers (ICRA 2010) (2010), pp. 15–21

    Google Scholar 

  23. S. Rueckhaus, MH24. http://www.motoman.com/industrial-robots/mh24 Accessed 28 Nov 2016

  24. Inmoov project, http://inmoov.fr/. Accessed 1 Dec 2016

  25. P. Slade et al., Tack: design an performance of an open-source, affordable, myoelectric prosthetic hand, in 2015 IEEE ICRA

    Google Scholar 

  26. J.T. Belter et al., Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. J. Rehabil. Res. Dev. 50(5) 2013

    Google Scholar 

  27. A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems (2012), pp. 1097–1105

    Google Scholar 

  28. Layer catalogue, http://caffe.berkeleyvision.org/tutorial/layers.html. Accessed 28 Dec 2016

  29. Theano 0.8.2 documentation (2008), http://deeplearning.net/software/theano/. Accessed 21 Dec 2016

  30. Deep learning framework (no date), http://caffe.berkeleyvision.org/. Accessed 21 Dec 2016

  31. A.M.R Agur, M.J. Lee, Grant’s Atlas of Anatomy 10th ed (1999)

    Google Scholar 

  32. J. Lin, Y. Wu, T.S. Huang, Modeling the constraints of human hand motion, in Workshop on Human Motion, 2000. Proceedings. (IEEE, 2000), pp. 121–126

    Google Scholar 

Download references

Acknowledgements

This research is supported by the BeingTogether Centre, a collaboration between Nanyang Technological University (NTU) Singapore and University of North Carolina (UNC) at Chapel Hill. The BeingTogether Centre is supported by the National Research Foundation, Prime Minister’s Office, Singapore under its International Research Centres in Singapore Funding Initiative.

Author information

Authors and Affiliations

  1. Institute for Media Innovation (IMI), Nanyang Technological University (NTU), Singapore, Singapore

    Nadia Magnenat Thalmann, Li Tian & Fupin Yao

Authors
  1. Nadia Magnenat Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Li Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fupin Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nadia Magnenat Thalmann .

Editor information

Editors and Affiliations

  1. School of Electronics Engineering (SENSE), VIT University, Chennai, Tamil Nadu, India

    S.R.S Prabaharan

  2. Institute for Media Innovation (IMI), Nanyang Technological University (NTU), Singapore, Singapore

    Nadia Magnenat Thalmann

  3. School of Electronics Engineering (SENSE), VIT University, Chennai, Tamil Nadu, India

    V. S Kanchana Bhaaskaran

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Thalmann, N.M., Tian, L., Yao, F. (2017). Nadine: A Social Robot that Can Localize Objects and Grasp Them in a Human Way. In: Prabaharan, S., Thalmann, N., Kanchana Bhaaskaran, V. (eds) Frontiers in Electronic Technologies. Lecture Notes in Electrical Engineering, vol 433. Springer, Singapore. https://doi.org/10.1007/978-981-10-4235-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4235-5_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4234-8

  • Online ISBN: 978-981-10-4235-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation