Abstract
This paper investigates how haptic interactions can be defined for enabling a single operator to control and interact with a team of mobile robots. Since there is no unique or canonical mapping from the swarm configuration to the forces experienced by the operator, a suitable mapping must be developed. To this end, multi-agent manipulability is proposed as a potentially useful mapping, whereby the forces experienced by the operator relate to how inputs, injected at precise locations in the team, translate to swarm-level motions. Small forces correspond to directions in which it is easy to move the swarm, while larger forces correspond to more costly directions. Initial experimental results support the viability of the proposed, haptic, human-swarm interaction mapping, through a user study where operators are tasked with driving a collection of robots through a series of way points.
- Arkin, R., & Ali, K. (1994). Integration of reactive and telerobotic control in multi- agent robotic systems. In Proceedings of the Third International Conference on Simulation of Adaptive Behavior (p. 473--478). Retrieved from https://www-robotics.jpl.nasa.gov Google ScholarDigital Library
- Atherton, A., & Goodrich, M. (2009). Supporting remote and mobile manipulation with an ecological augmented virtuality interface. In Proceedings of the AISB-HRI Symposium on New Frontiers in Human-Robot Interaction.Google Scholar
- Bicchi, A., Melchiorri, C., & Balluchi, D. (1995, Apr). On the mobility and manipulability of general multiple limb robots. IEEE Transactions on Robotics and Automation, 11(2), 215--228.Google ScholarCross Ref
- Bicchi, A., & Prattichizzo, D. (2000, Aug). Manipulability of cooperating robots with unactuated joints and closed-chain mechanisms. IEEE Transactions on Robotics and Automation, 16(4), 336--345.Google ScholarCross Ref
- Bullo, F., Cortes, J., & Martinez, S. (2009). Distributed control of robotic networks. Princeton, NJ: Princeton University Press. Google ScholarDigital Library
- Cummings, M. (2004, June). Human supervisory control of swarming networks. In Proceedings of the Conference on Autonomous Intelligent Networked Systems. Retrieved from http://web.mit.edu/Google Scholar
- de la Croix, J., & Egerstedt, M. (2012). Controllability characterizations of leader-based swarm interactions. In Proceedings of the AAAI Symposium on Human Control of Bio-Inspired Swarms. Retrieved from http://users.ece.gatech.edu/Google Scholar
- Desai, J. P., Ostrowski, J. P., & Kumar, V. (2001). Modeling and control of formations of nonholonomic mobile robots. IEEE Transactions on Robotics and Automation, 17(6), 905--908.Google ScholarCross Ref
- Farkhatdinov, I., & Ryu, J.-H. (2008, July). Teleoperation of multi-robot and multi-property systems. In Proceedings of the 6th IEEE International Conference on Industrial Informatics (p. 1453--1458).Google Scholar
- Fax, J. A., & Murray, R. M. (2002). Graph Laplacians and stabilization of vehicle formations. In Proceedings of the 15th IFAC World Congress (p. 283--288). Retrieved from http://authors.library.caltech.edu/Google ScholarCross Ref
- Jadbabaie, A., Lin, J., & Morse, A. S. (2003). Coordination of groups of mobile autonomous agents using nearest neighbor rules. IEEE Transactions on Automatic Control, 48(6), 988--1001.Google ScholarCross Ref
- Ji, M., Ferrari-Trecate, G., Egerstedt, M., & Buffa, A. (2008, september). Containment control in mobile networks. IEEE Transactions on Automatic Control, 53(8), 1972--1975.Google ScholarCross Ref
- Kawashima, H., & Egerstedt, M. (2011). Approximate manipulability of leader-follower networks. In Proceedings of the IEEE Conference on Decision and Control and European Control Conference (p. 6618--6623).Google ScholarCross Ref
- Kawashima, H., & Egerstedt, M. (2014). Manipulability of leader-follower networks with the rigid-link approximation. Automatica, 50(3), 695--706. Google ScholarDigital Library
- Kira, Z., & Potter, M. A. (2009). Exerting human control over decentralized robot swarms. In Proceedings of the International Conference on Autonomous Robots and Agents.Google ScholarCross Ref
- Lee, D., Martinez-Palafox, O., & Spong, M. (2005, April). Bilateral teleoperation of multiple cooperative robots over delayed communication networks: Application. In Proceedings of the IEEE International Conference on Robotics and Automation (p. 366--371).Google Scholar
- Lee, D., & Spong, M. (2005, April). Bilateral teleoperation of multiple cooperative robots over delayed communication networks: Theory. In Proceedings of the IEEE International Conference on Robotics and Automation (p. 360--365).Google Scholar
- McLurkin, J., Smith, J., Frankel, J., Sotkowitz, D., Blau, D., & Schmidt, B. (2006, March). Speaking swarmish: Human-robot interface design for large swarms of autonomous mobile robots. In Proceedings of the AAAI Spring Symposium. Stanford, CA, USA. Retrieved from http://mrsl.rice.edu/Google Scholar
- Mesbahi, M., & Egerstedt, M. (2010). Graph theoretic methods in multiagent networks. Princeton, NJ: Princeton University Press.Google Scholar
- Nunnally, S., Walker, P., Lewis, M., Chakraborty, N., & Sycara, K. (2013). Using haptic feedback in human robotic swarms interaction. In Proceedings of the Human Factors and Ergonomics Society (p. 1047--1051). Pittsburgh, PA: University of Pittsburgh.Google ScholarCross Ref
- Olfati-Saber, R., Fax, J. A., & Murray, R. M. (2007, Jan). Consensus and cooperation in networked multi-agent systems. Proceedings of the IEEE, 95(1), 215--233.Google ScholarCross Ref
- Rahmani, A., Ji, M., Mesbahi, M., & Egerstedt, M. (2009). Controllability of multi-agent systems from a graph-theoretic perspective. SIAM Journal on Control and Optimization, 48(1), 162--186. Google ScholarDigital Library
- Riedel, M., Franchi, A., Giordano, P. R., Bülthoff, H. H., & Son, H. I. (2013). Experiments on intercontinental haptic control of multiple uavs. In Intelligent Autonomous Systems 12 (p. 227--238). Springer.Google Scholar
- Rodriguez-Seda, E., Troy, J., Erignac, C., Murray, P., Stipanovic, D., & Spong, M. (2010, July). Bilateral tele-operation of multiple mobile agents: Coordinated motion and collision avoidance. IEEE Transactions on Control Systems Technology, 18(4), 984--992.Google ScholarCross Ref
- Secchi, C., Franchi, A., Bulthoff, H., & Robuffo Giordano, P. (2013, May). Bilateral control of the degree of connectivity in multiple mobile-robot teleoperation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), (p. 3645--3652).Google Scholar
- Yoshikawa, T. (1985). Manipulability of robotic mechanisms. The International Journal of Robotics Research, 4(2), 3--9.Google ScholarCross Ref
- Zhang, F., & Leonard, N. E. (2007). Coordinated patterns of unit speed particles on a closed curve. Systems and Control Letters, 56(6), 397--407.Google ScholarCross Ref
Index Terms
- Haptic interactions with multi-robot swarms using manipulability
Recommendations
Haptic techniques for media control
UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technologyWe introduce a set of techniques for haptically manipulating digital media such as video, audio, voicemail and computer graphics, utilizing virtual mediating dynamic models based on intuitive physical metaphors. For example, a video sequence can be ...
Robot Programming Using Augmented Reality
CW '09: Proceedings of the 2009 International Conference on CyberWorldsHuman-robot interaction issues, especially for industrial robots, have largely been confined to finding better ways to reconfigure or program the robots. In this paper, an Augmented Reality based Robot Programming (RPAR-II) system is proposed. A virtual ...
Using Haptic Forces Feedback for Immersive and Interactive Simulation in Industrial Context
Proceedings of the Second International Conference on Augmented and Virtual Reality - Volume 9254In a world in continuous evolution of information technology and computer science, virtual reality VR is a very important technological tool in several areas such as industrial simulations. In this paper, we will present some cases of the uses of VR, ...
Comments