Yunjoo Kim
ABSTRACT
Grasping an object in the scene with multiple unknown objects requires both the knowledge of which object to be the target and the planning of grasping pose. However, teleoperating a robot hand to find a proper grasping pose in an unstructured environment is often too complicated and time-consuming to perform. In this study, we propose an aided-grasping algorithm which autonomously corrects the pose of a robot hand using an eye-in-hand camera. We used multiple cameras for a natural vision-based teleoperation interface with an aided-grasping algorithm. Experiments with objects placed in arbitrary positions and angles have shown a successful implementation of the algorithm.
- Staffan Ekvall and Danica Kragic. 2004. Interactive grasp learning based on human demonstration. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 , Vol. 4. IEEE, 3519--3524.Google Scholar
Cross Ref
- Scott A Green, Mark Billinghurst, XiaoQi Chen, and J Geoffrey Chase. 2008. Human-robot collaboration: A literature review and augmented reality approach in design. International journal of advanced robotic systems , Vol. 5, 1 (2008), 1.Google ScholarCross Ref
- Weston B Griffin, William R Provancher, and Mark R Cutkosky. 2003. Feedback strategies for shared control in dexterous telemanipulation. In Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453), Vol. 3. IEEE, 2791--2796.Google ScholarCross Ref
- Yingbai Hu, Zhijun Li, Guanglin Li, Peijiang Yuan, Chenguang Yang, and Rong Song. 2016. Development of sensory-motor fusion-based manipulation and grasping control for a robotic hand-eye system. IEEE Transactions on Systems, Man, and Cybernetics: Systems , Vol. 47, 7 (2016), 1169--1180.Google Scholar
- Hakan Karaoguz and Patric Jensfelt. 2019. Object Detection Approach for Robot Grasp Detection. In 2019 International Conference on Robotics and Automation (ICRA). IEEE, 4953--4959.Google Scholar
- Jonathan Kofman, Xianghai Wu, Timothy J Luu, and Siddharth Verma. 2005. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE transactions on industrial electronics , Vol. 52, 5 (2005), 1206--1219.Google ScholarCross Ref
- Jörg Krüger, Terje K Lien, and Alexander Verl. 2009. Cooperation of human and machines in assembly lines. CIRP annals , Vol. 58, 2 (2009), 628--646.Google Scholar
- Paul Michelman and Peter Allen. 1994. Shared autonomy in a robot hand teleoperation system. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94) , Vol. 1. IEEE, 253--259.Google ScholarCross Ref
- Iason Oikonomidis, Nikolaos Kyriazis, and Antonis A Argyros. 2011. Efficient model-based 3D tracking of hand articulations using Kinect.. In BmVC , Vol. 1. 3.Google Scholar
- J Shaw and KY Cheng. 2016. Object identification and 3-D position calculation using eye-in-hand single camera for robot gripper. In 2016 IEEE International Conference on Industrial Technology (ICIT). IEEE, 1622--1625.Google ScholarCross Ref
- Robert Y Wang and Jovan Popović. 2009. Real-time hand-tracking with a color glove. ACM transactions on graphics (TOG) , Vol. 28, 3 (2009), 63.Google Scholar
- Bao Xi, Shuo Wang, Xuemei Ye, Yinghao Cai, Tao Lu, and Rui Wang. 2019. A robotic shared control teleoperation method based on learning from demonstrations. International Journal of Advanced Robotic Systems , Vol. 16, 4 (2019), 1729881419857428.Google ScholarCross Ref
Index Terms
- Vision-based Aided-Grasping in Teleoperation with Multiple Unknown Objects
Recommendations
Grasping of Static and Moving Objects Using a Vision-Based Control Approach
Robotic systems require the use of sensing to enable flexible operation in uncalibrated or partially calibrated environments. Recent work combining robotics with vision has emphasized an active vision paradigm where the system changes the pose of the ...
Grasping of static and moving objects using a vision-based control approach
IROS '95: Proceedings of the International Conference on Intelligent Robots and Systems-Volume 1 - Volume 1Recent work combining robotics with vision has emphasized an active vision paradigm where the system changes the pose of the camera to improve environmental knowledge or to establish and presence a desired relationship between the robot and objects in ...
Autonomous vision-guided bi-manual grasping and manipulation
2017 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO)This paper describes the implementation, demonstration and evaluation of a variety of autonomous, vision-guided manipulation capabilities, using a dual-arm Baxter robot. Initially, symmetric coordinated bi-manual manipulation based on kinematic tracking ...
Comments