Intelligent autonomous vehicles with an extendable knowledge base under meaningful human control

Guus Beckers; Joris Sijs; Jurriaan van Diggelen; Roelof J. E. van Dijk; Henri Bouma; Mathijs Lomme; Rutger Hommes; Fieke Hillerstrom; Jasper van der Waa; Anna van Velsen; Tommaso Mannucci; Jeroen Voogd; Wessel van Staal; Kim Veltman; Peter Wessels; Albert Huizing

doi:10.1117/12.2533740

7 October 2019 Intelligent autonomous vehicles with an extendable knowledge base under meaningful human control

Guus Beckers, Joris Sijs, Jurriaan van Diggelen, Roelof J. E. van Dijk, Henri Bouma, Mathijs Lomme, Rutger Hommes, Fieke Hillerstrom, Jasper van der Waa, Anna van Velsen, Tommaso Mannucci, Jeroen Voogd, Wessel van Staal, Kim Veltman, Peter Wessels, Albert Huizing

Author Affiliations +

Proceedings Volume 11166, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III; 111660C (2019) https://doi.org/10.1117/12.2533740
Event: SPIE Security + Defence, 2019, Strasbourg, France

Abstract

Intelligent robotic autonomous systems (unmanned aerial/ground/surface/underwater vehicles) are attractive for military application to relieve humans from tedious or dangerous tasks. These systems require awareness of the environment and their own performance to reach a mission goal. This awareness enables them to adapt their operations to handle unexpected changes in the environment and uncertainty in assessments. Components of the autonomous system cannot rely on perfect awareness or actuator execution, and mistakes of one component can affect the entire system. To obtain a robust system, a system-wide approach is needed and a realistic model of all aspects of the system and its environment. In this paper, we present our study on the design and development of a fully functional autonomous system, consisting of sensors, observation processing and behavior analysis, information database, knowledge base, communication, planning processes, and actuators. The system behaves as a teammate of a human operator and can perform tasks independently with minimal interaction. The system keeps the human informed about relevant developments that may require human assistance, and the human can always redirect the system with high-level instructions. The communication behavior is implemented as a Social AI Layer (SAIL). The autonomous system was tested in a simulation environment to support rapid prototyping and evaluation. The simulation is based on the Robotic Operating System (ROS) with fully modelled sensors and actuators and the 3D graphics-enabled physics simulation software Gazebo. In this simulation, various flying and driving autonomous systems can execute their tasks in a realistic 3D environment with scripted or user-controlled threats. The results show the performance of autonomous operation as well as interaction with humans.

Conference Presentation

Citation Download Citation

Guus Beckers, Joris Sijs, Jurriaan van Diggelen, Roelof J. E. van Dijk, Henri Bouma, Mathijs Lomme, Rutger Hommes, Fieke Hillerstrom, Jasper van der Waa, Anna van Velsen, Tommaso Mannucci, Jeroen Voogd, Wessel van Staal, Kim Veltman, Peter Wessels, and Albert Huizing "Intelligent autonomous vehicles with an extendable knowledge base under meaningful human control", Proc. SPIE 11166, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III, 111660C (7 October 2019); https://doi.org/10.1117/12.2533740

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available