Elsevier

Neurocomputing

Volume 74, Issues 14–15, July 2011, Pages 2314-2335
Neurocomputing

Robotic path planning in static environment using hierarchical multi-neuron heuristic search and probability based fitness

https://doi.org/10.1016/j.neucom.2011.03.006Get rights and content

Abstract

Path Planning is a classical problem in the field of robotics. The problem is to find a path of the robot given the various obstacles. The problem has attracted the attention of numerous researchers due to the associated complexities, uncertainties and real time nature. In this paper we propose a new algorithm for solving the problem of path planning in a static environment. The algorithm makes use of an algorithm developed earlier by the authors called Multi-Neuron Heuristic Search (MNHS). This algorithm is a modified A algorithm that performs better than normal A when heuristics are prone to sharp changes. This algorithm has been implemented in a hierarchical manner, where each generation of the algorithm gives a more detailed path that has a higher reaching probability. The map used for this purpose is based on a probabilistic approach where we measure the probability of collision with obstacle while traveling inside the cell. As we decompose the cells, the cell size reduces and the probability starts to touch 0 or 1 depending upon the presence or absence of obstacles in the cell. In this approach, it is not compulsory to run the entire algorithm. We may rather break after a certain degree of certainty has been achieved. We tested the algorithm in numerous situations with varying degrees of complexities. The algorithm was able to give an optimal path in all the situations given. The standard A algorithm failed to give results within time in most of the situations presented.

Introduction

Robotics is a highly multi-disciplinary field that incorporates inputs from wireless systems, networks, cognition, image processing, AI, electrical, electronics and other related fields [21]. The highly multi-disciplinary nature makes it an exciting playground for people from various fields to collaborate and contribute. The whole problem of robotics include taking input from sensors, making of robotic world map, path planning, robot control [20], multi-robot coordination, high-end planning, etc. [7]. The application of AI and Soft Computing techniques in the recent years deserves a special mention.

Path Planning [18] is a specific problem in case of robots where we are given a map of the world. Through this we can come to know about the various paths and obstacles. The problem is to compute a path for the robot that can make it reach a specific goal starting from a specific position. The solution of this problem is a path using which the robot can reach its goal without colliding with any of the obstacles. The problem is usually studied in two separate heads. These are path planning in static environment and path planning in dynamic environment. In static environment the obstacles are static and do not change their position with respect to time. On the other hand, in dynamic path planning the position of obstacles may change with time. A path planning algorithm must ensure that if a solution is possible, it is found and returned. This is called as completeness of the algorithm [2]. It must also ensure that the algorithm gives its result within the specified amount of time [16].

The problem of path planning takes its input a map. A robotic map is a representation of the world of the robot [23]. The map depicts the traversable path, obstacles, surface and other information. Various types of paths may be drawn depending upon the problem and solution requirements. Some of the commonly used maps include topological maps [34], voronoi maps [4], [33], hybrid maps [4], etc. The map is built using the results of the various sensors along with the output of the recognition systems [7].

Path planning usually gives its output to the robotic control. This consists of a robotic controller, which is supposed to move the robot in the desired path. Various robot controllers have been designed. Some of them are built using the Adaptive Neuro-Fuzzy architecture [24].

The problem of path planning has been a very active area of research especially during the last decade. The problem has seen numerous methods and means that solve the prevalent research issues to varying extents. A class of algorithms uses the potential method approach to navigate a robot [28]. In this approach, whenever the robot collides with a robot, a large potential is given. The potential increases if robot moves too close to the obstacle. The aim is the minimization of the potential.

Pozna et al. [28] solved the problem using a potential field approach for obstacle avoidance. Other potential field methods include [35]. Hui and Pratihar [11] gave a comparison between the Potential Field and the Soft Computing solutions. Various statistical approaches have also been used. This includes the work of Jolly et al. [14] who used Bezier Curve for path planning. Goel et al. [8] solved the problem for dynamic obstacles using an adaptive strategy. Quad tree [17], mesh [12], pyramid [36] are representations that have been tried for better performance. Another good amount of work exists using the Soft Computing approaches especially Genetic Algorithms [1], [15], [37], [22], A Algorithms [32] and artificial neural networks (ANN) [16]. Shibata et al. [30] used Fuzzy Logic for fitness evaluation of the paths generated. Various other approaches [6], [26] have also been proposed.

Zhu and Latombe [38] used the concepts of cell decomposition and hierarchal planning. Here they represented the cells in a similar concept of grayness denoting the obstacles. Urdylis et al. [36] used a multi-level probability based pyramid for solving the path planning problem. Hierarchical Planning can also be found in the work of Lai et al. [19] and Shibata et al. [30].

Along with the problem of path planning, the researchers have also studied the degrees of freedom and dimensionality as they have a deep impact on the problem. Jan et al. [13] presented his work for solving in 3 degrees of freedom.

Chen and Chiang [5] made an adaptive intelligent system and implemented using a Neuro-Fuzzy Controller and Performance Evaluator. Their system explored new actions using GA and generated new rules. In the field of multi-robot systems, Carpin and Pagello [3] used an approximation algorithm to solve the problem of robotic coordination using the space–time data structures. They showed a compromise between speed and quality. Pradhan et al. [29] solved a similar problem for unknown environments using Fuzzy Logic. Peasgood et al. [27] solved the multi-robot planning problem ensuring completeness using Spanning Trees. Hazon and Kaminka [9] analyzed the completeness of the multi-robot coverage problem. O' Hara et al. [25] gave the idea of using embedded networks as sensors for solving the problem.

It was earlier shown by the authors that A generates the best results for the problem of path planning [32]. However, the algorithm was found to be computationally very expensive. It was also earlier shown by the authors that A algorithm does not perform well in problems like maze solving [31]. The motivation behind this work is to adapt A algorithm in such a way that it becomes more scalable and performs well in finite time. We do this with the application of probability based map representation [17].

In this paper we have proposed the use of Multi-Neuron Heuristic Search (MNHS) for the purpose of solving the path planning problem [31]. This was an algorithm proposed earlier by the authors as an improvement over the standard A algorithm. This algorithm was found to perform better in situations where the heuristic function may fluctuate very quickly between adjacent nodes in the graph. The MNHS improves performance in situations where the heuristic function behavior is uncertain by expanding multiple heuristic nodes simultaneously, in place of the node with the best heuristic as was the case with conventional A algorithm.

The map in this paper has been modeled in a way similar to the quad tree approach as used by [17]. In this model the graph was divided into a set of nodes of varying sizes. All nodes are arranged in layered manner from top to bottom, each with different size of nodes, and different level of uncertainty. Here, at the top, the nodes have high degree of uncertainty regarding the presence or absence of the obstacles. This uncertainty is measured in terms of ‘greyness’ of the cell. A completely white cell denotes the absence of any kind of obstacle from the entire region. On the other hand full black color denotes the conformation of presence of obstacles in the cell. The grey denotes the intermediate values with the intensity denoting the probability of the cell being free from obstacles.

In practical problems, the map may be too large for the standard MNHS algorithm to perform. This problem is solved by making a hierarchical solution to the problem. The first little iterations are supposed to find the initial vague solutions with lesser details. The probability of collision with obstacles is undetermined to a large extent in the first little iteration. The size of the cells is quite large. Towards the later iterations of the algorithm the cells lying on the possibly optimal path are decomposed. As a result path keeps adding details. Also the presence or absence of the obstacles keeps getting clear.

This paper is organized as follows. Section 2 introduces the MNHS algorithm. In Section 3 we introduce the general outline of the algorithm. The hierarchical approach is introduced in Section 4. The concept of probability based fitness is discussed in Section 5. In Section 6 we discuss the simulation model and the results. Section 7 gives the comparative analysis and Section 8 presents the results.

Section snippets

Multi-neuron heuristic search (MNHS)

The MNHS is an improved form of A algorithm that works in the cases where the heuristics are prone to sudden fluctuations [31]. The main aim of heuristic based search algorithm is to constantly drive the system towards better states. But suppose you keep moving in the graph search minimizing the cost, and suddenly there is a sharp increase in the heuristic value of the traversed node. In such a case the entire path might becomes useless, and the algorithm might need to backtrack to find

Algorithm

In this section we give a general outline to the algorithm that we have developed for solving the problem of robotic path planning. The basic methodology is to use the MNHS algorithm in a hierarchical manner. The concept of probability based fitness has also been introduced. The general structure of the algorithm is given in Fig. 1.

The algorithm starts by taking as input the initial graph. This graph may be approximately built by the map building algorithm. This means that we do not know for

The hierarchical approach

We have already discussed some of the hierarchical concepts of the algorithm in terms of generation, map expansion, etc. In this section we study these concepts and the way they go with each other along with the motivation behind the approach. The basic approach used in the problem is that of the MNHS. The whole map has been generalized to reduce number of cells by introducing the probabilistic approach. The search on the reduced graph can hence be easily performed. In the previous sections we

Probability based fitness

The MNHS uses the fitness (also called as cost) for its functioning. The cost decides the goodness of the solution. The better solutions have lower costs. Hence the approach is generally to find smaller costs and expand them further.

This algorithm is based on probability that is denoted by the probability of finding obstacles in the cell. Hence each path we traverse has some probability of success associated with it. This probability for a path is given by:Grey(P)=Πigrey(pi)

Here pi are the

Simulation results

In order to test the working of the algorithm, we made our own simulation engine. Every attempt was made to ensure that the simulation engine behaves in a way similar to actual robot. This would ensure that the algorithm can be easily deployed to the real robot for the purpose of path planning.

All simulations were done on a 2.0 dual core system with 1 GB RAM using the self generated simulation engine. The simulation engine that was built had the functionality of on-demand cell decomposition,

Comparative analyses

In this section we compare the proposed algorithm with other commonly used approaches in the robotic literature. As most of the algorithms differ in regard to modeling scenarios, we restrict our discussion to theoretical concepts while comparing the advantages and disadvantages of the proposed approach over other algorithms. These may be easily verified by experimentation over the different modeling scenarios that the individual algorithms assume. The first class includes the potential methods

Conclusions

In this paper we had proposed a method to solve the problem of path planning in static environment using a hierarchical approach involving MNHS and probability based fitness. We tested the algorithm for various test cases. In all the test cases we observed that the algorithm was able to find the correct solution. The time required, number of generations, etc. depended upon the problem being considered.

We first saw the working of the algorithm in a plain environment without any collisions. We

Rahul Kala—Rahul Kala is pursuing PhD from School of Cybernetics at University of Reading. He did his Bachelors and Masters in Information Technology from Indian Institute of Information Technology and Management Gwalior. His areas of research are hybrid soft computing, robotic planning, biometrics, artificial intelligence and soft computing. He has published about 50 papers in various international and national journals/conferences and is the author of 2 books. He also takes a keen interest

References (38)

  • Bohlin, R., Kavraki, L.E., 2000. Path planning using lazy PRM. In: Proceedings of the IEEE International Robotics and...
  • Cristina Castejon et al.

    Voronoi-based outdoor traversable region modelling

    Innovations in Robot Mobility and Control

    (2005)
  • Liang-Hsuan Chen et al.

    New approach to intelligent control systems with self-exploring process

    IEEE Transactions on Systems, Man and Cybernetics—Part B: Cybernetics

    (2003)
  • Juan Cortes et al.

    Disassembly path planning for complex articulated objects

    IEEE Transactions on Robotics

    (2008)
  • Shuzhi Sam Ge et al.

    Autonomous Mobile Robot

    (2006)
  • A.K. Goel et al.

    Multistrategy adaptive path planning

    IEEE Expert

    (1994)
  • J.H. Holland

    Adaptation in Natural and Artificial Systems

    Ann Arbor

    (1975)
  • Joo Young Hwang et al.

    A fast path planning by path graph optimization

    IEEE Transaction on Systems, Man, and Cybernetics—Part A: Systems and Humans

    (2003)
  • Jan Gene Eu et al.

    Optimal path planning for mobile robot navigation

    IEEE/ASME Transactions on Mechatronics

    (2008)
  • Cited by (0)

    Rahul Kala—Rahul Kala is pursuing PhD from School of Cybernetics at University of Reading. He did his Bachelors and Masters in Information Technology from Indian Institute of Information Technology and Management Gwalior. His areas of research are hybrid soft computing, robotic planning, biometrics, artificial intelligence and soft computing. He has published about 50 papers in various international and national journals/conferences and is the author of 2 books. He also takes a keen interest toward free/opensource software. He is the recipient of Commonwealth Scholarship and Fellowship Program (2010)—UK and is the winner of Lord of the Code Scholarship Contest organized by KReSIT, IIT Bombay and Red Hat. He secured All India 8th position in Graduates Aptitude Test in Engineeging-2008 Examinations.

    Anupam Shukla—Anupam Shukla is serving as a Professor in Indian Institute of Information Technology and Management Gwalior. He heads the Soft Computing and Expert System Laboratory at the Institute. He has 20 years of teaching experience. His research interest includes Speech processing, Artificial Intelligence, Soft Computing, Biometrics and Bioinformatics. He has published over 150 papers in various national and international journals/conferences. He is editor and reviewer in various journals. He received Young Scientist Award from Madhya Pradesh Government and Gold Medal from JadavpurUniversity.

    Ritu Tiwari—Ritu Tiwari is serving as an Assistant Professor in Indian Institute of Information Technology and Management Gwalior. Her field of research includes Biometrics, Artificial Neural Networks, Speech Signal Processing, Robotics and Soft Computing. She has published over 75 research papers in various national and international journals/conferences. She has received Young Scientist Award from Chhattisgarh Council of Science & Technology and also received Gold Medal in her post graduation.

    View full text