Abstract
Evolutionary computation techniques, which are based on a powerful principle of evolution—survival of the fittest, constitute an interesting category of heuristic search. In other words, evolutionary techniques are stochastic algorithms whose search methods model some natural phenomena: genetic inheritance and Darwinian strife for survival.
Any evolutionary algorithm applied to a particular problem must address the issue of genetic representation of solutions to the problem and genetic operators that would alter the genetic composition of offspring during the reproduction process. However, additional heuristics should be incorporated in the algorithm as well; some of these heuristic rules provide guidelines for evaluating (feasible and infeasible) individuals in the population. This paper surveys such heuristics and discusses their merits and drawbacks.
Similar content being viewed by others
References
Antonisse, H.J., and K.S., Keller. (1987). “Genetic Operators for High Level Knowledge Representation.” In Proceedings of the Second International Conference on Genetic Algorithms (pp. 69–76). Cambridge, MA: Lawrence Erlbaum.
Bäck, T., F., Hoffmeister, and H.-P., Schwefel. (1991). “A Survey of Evolution Strategies.” In Proceedings of the Fourth International Conference on Genetic Algorithms (pp. 2–9). Los Altos, CA: Morgan Kaufmann.
Bean, J.C., and A.B. Hadj-Alouane. (1992). “A Dual Genetic Algorithm for Bounded Integer Programs.” Department of Industrial and Operations Engineering, University of Michigan, TR 92-53.
Bilchev, G., and I.C. Parmee. (1995). “Adaptive Search Strategies for Heavily Constrained Design Spaces.” In Proceedings of the Twenty-second International Conference CAD '95, Ukraine, Yalta, May 8–13.
Davis, L. (1987). Genetic Algorithms and Simulated Annealing. Los Altos, CA: Morgan Kaufmann.
Davis, L. (1989). “Adapting Operator Probabilities in Genetic Algorithms.” In Proceedings of the Third International Conference on Genetic Algorithms (pp. 61–69). Los Altos, CA: Morgan Kaufmann.
Davis, L. (1991). Handbook of Genetic Algorithms. New York: Van Nostrand Reinhold.
De Jong, K.A. (1975). “An Analysis of the Behavior of a Class of Genetic Adaptive System.” Doctoral dissertation, University of Michigan, Disseration Abstract International, 36(10), 5140B. (University Microfilms No. 76-9381).
De, Jong, K.A., and W.M., Spears. (1989). “Using Genetic Algorithms to Solve NP-Complete Problems.” In Proceedings of the Third International Conference on Genetic Algorithms (pp. 124–132). Los Altos, CA: Morgan Kaufmann.
Eiben, A.E., Raue, P.-E., and Ruttkay, Zs. (1994). “Genetic Algorithms with Multi-Parent Recombination.” In Y., Davidor, H.-P., Schwefel, and R., Manner (Eds.), Proceedings of the Third International Conference on Parallel Problem Solving from Nature (PPSN) (pp. 78–87). New York: Springer-Verlag.
Fogel, D.B. (1992). “Evolving Artificial Intelligence.” Ph.D. Thesis, University of California, San Diego.
Fogel, D.B. (1993). “Evolving Behaviours in the Iterated Prisoner's Dilemma.” Evolutionary Computation 1(1), 77–97.
Fogel, L.J., A.J., Owens, and M.J., Walsh. (1966). Artificial Intelligence through Simulated Evolution. New York: Wiley.
Forrest, S. (1985). “Implementing Semantic Networks Structures Using the Classifier System.” In Proceedings of the First International Conference on Genetic Algorithms (pp. 24–44). Pittsburgh, PA: Lawrence Erlbaum.
Fox, B.R., and M.B., McMahon. (1990). “Genetic Operators for Sequencing Problems.” In G., Rawlins (Ed.), Foundations of Genetic Algorithms: First Workshop on the Foundations of Genetic Algorithms and Classifier Systems. Los Altos, CA: Morgan Kaufmann.
Freville, A., and G., Plateau. (1986). “Heuristics and Reduction Methods for Multiple Constraint 0–1 Linear Programming Problems.” European Journal of Operational Research 24, 206–215.
Gendreau, M., A. Hertz, and G. Laporte. (1991). “A Tabu Search Heuristic for Vehicle Routing.” CRT-7777, Centre de Recherche sur les transports, Université de Montréal. To appear in Management Science.
Glover, F. (1977). “Heuristics for Integer Programming Using Surrogate Constraints.” Decision Sciences 8(1), 156–166.
Glover, F. (1994). “Genetic Algorithms and Scatter Search: Unsuspected Potentials.” Statistics and Computing 4, 131–140.
Glover, F. (1995). “Tabu Search Fundamentals and Uses.” Graduate School of Business, University of Colorado.
Glover, F., and G., Kochenberger. (1995). “Critical Event Tabu Search for Multidimensional Knapsack Problems.” In Metaheuristics for Optimization (pp. 113–133). Boston: Kluwer.
Goldberg, D.E. (1989). Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison Wesley.
Goldberg, D.E., and R., Lingle. (1985). “Alleles, Loci, and the TSP.’ In Proceedings of the First International Conference on Genetic Algorithms (pp. 154–159). Hillsdale, NJ: Lawrence Erlbaum.
Grefenstette, J.J. (1987). “Incorporating Problem Specific Knowledge into Genetic Algorithms.” In L., Davis (ed.), Genetic Algorithms and Simulated Annealing. Los Altos, CA: Morgan Kaufmann.
HadjpAlouane, A.B., and J.C. Bean. (1992). “A Genetic Algorithm for the Multiple-Choice Integer Program.” Department of Industrial and Operations Engineering, University of Michigan, TR 92-50.
Holland, J.H. (1975). Adaptation in Natural and Artificial Systems. Ann Arbor: University of Michigan Press.
Homaifar, A., S.H.-Y., Lai, and X., Qi. (1994). “Constrained Optimization via Genetic Algorithms.” Simulation 62, 242–254.
Joines, J.A., and C.R. Houck. (1994). “On the Use of Non-Stationary Penalty Functions to Solve Nonlinear Constrained Optimization Problems with GAs. “In Proceedings of the Evolutionary Computation Conference—Poster Sessions (pp. 579–584). Part of the IEEE World Congress on Computational Intelligence, Orlando, June 27–29.
Kelly, J.P., B.L., Golden, and A.A., Assad. (1993). “Large-Scale Controlled Rounding Using Tabu Search with Strategic Oscillation.” Annals of Operations Research 41, 69–84.
Koza, J.R. (1992). Genetic Programming. Cambridge, MA: MIT Press.
Le, Riche, R., C., Vayssade, R.T., Haftka. (1995). “A Segregated Genetic Algorithm for Constrained Optimization in Structural Mechanics.” Technical Report, Université de Technologie de Compiegne, France.
Michalewicz, Z. (1993). A Hierarchy of Evolution Programs: An Experimental Study.” Evolutionary Computation 1, 51–76.
Michalewicz, Z. (1994). Genetic Algorithms + Data Structures = Evolution Programs (2nd ed.). New York: Springer-Verlag.
Michalewicz, Z., and N., Attia. (1994). “In Evolutionary Optimzation of Constrained Problems.” In A.V., Sebald and L.J., Fogel (eds.), Proceedings of the Third Annual Conference on Evolutionary Programming (pp. 98–108). River Edge, NJ: World Scientific.
Michalewicz, Z., and C., Janikow. (1991). “Handling Constraints in Genetic Algorithms.” In Proceedings of the Fourth International Conference on Genetic Algorithms (pp. 151–157). Los Altos, CA: Morgan Kaufmann.
Michalewicz, Z., and G. Nazhiyath. (1995). “Genocop III: A Co-evolutionary Algorithm for Numerical Optimization Problems with Nonlinear Constraints.” Proceedings of the Second IEEE International Conference on Evolutionary Computation, perth, November 29–December 1.
Michalewicz, Z., G.A., Vignaux, and M., Hobbs. (1991). “A Non-Standard Genetic Algorithm for the Nonlinear Transportation Problem.” ORSA Journal on Computing 3(4), 307–316.
Michalewicz, A., and J. Xiao. (1995). “Evaluation of Paths in Evolutionary Planner/Navigator.” In Proceedings of the 1995 International Workshop on Biologically Inspired Evolutionary Systems, (pp. 45–52). Tokyo, Japan, May 30–31.
Orvosh, D., and L., Davis. (1993). “Shall We Repair? Genetic Algorithms, Combinatorial Optimization, and Feasibility Constraints.” In Proceedings of the Fifth International Conference on Genetic Algorithms (p. 650). Los Altos, CA: Morgan Kaufmann.
Paechter, B.A. Cumming, H. Luchian, and M. Petriuc. (1994). “Two Solutions to the General Timetable Problem Using Evolutionary Methods.” In Proceedings of the IEEE International Conference on Evolutionary Computation (pp. 300–305). June 27–29.
Palmer, C.C., and A. Kershenbaum. (1994). “Representing Trees in Genetic Algorithms.” In Proceedings of the IEEE International Conference on Evolutionary Computation (pp. 379–384). June 27–29.
Pardalos, P. (1994). “On the Passage from Local to Global in Optimization.” In J.R., Birge and K.G., Murty (eds.), Mathematical Programming. Ann Arbor: University of Michigan.
Paredis, J. (1994). “Co-evolutionary Constraint Satisfaction.” In Proceedings of the Third Conference on Parallel Problem Solving from Nature (pp. 46–55). New York: Springer-Verlag.
Parmee, I.C., M., Johnson, and S., Burt. (1994). “Techniques to Aid Global Search in Engineering Design.” In Proceedings of the Seventh International Conference IEA/AIE (pp. 377–385). Yverdon, Switzerland: Gordon and Breach Science.
Powell, D., and M.M., Skolnick. (1993). “Using Genetic Algorithms in Engineering Design Optimization with Non-Linear Constraints.” In Proceedings of the Fifth International Conference on Genetic Algorithms (pp. 424–430). Los Altos, CA: Morgan Kaufmann.
Reynolds, R.G. (1994). “An Introduction to Cultural Algorithms.” In Proceedings of the Third Annual Conference on Evolutionary Progamming (pp. 131–139). River Edge, NJ: World Scientific.
Reynolds, R.G., Z. Michalewicz, and M. Cavaretta. (1995). “Using Cultural Algorithms for Constraint Handling in Genocop.” In Proceedings of the Fourth Annual Conference on Evolutionary Programming, San Diego, CA, March 1–3.
Richardson, J.T., M.R., Palmer, G., Liepins, and M., Hillliard. (1989). “Some Guidelines for Genetic Algorithms with Penalty Functions.” In Proceedings of the Third International Conference on Genetic Algorithms (pp. 191–192). Los Altos, CA: Morgan Kaufmann.
Sarle, W. (1993). “Kangaroos.” Article posted on comp.ai.neural-nets on September 1.
Schoenauer, M., and S., Xanthakis. (1993). “Constrained GA Optimization.” In Proceedings of the Fifth International Conference on Genetic Algorithms (pp. 573–580). Los Altos, CA: Morgan Kaufmann.
Schweefel, H.-P. (1981). Numerical Optimization for Computer Models. Chichester, UK: Wiley.
Siedlecki, W. and J., Sklanski. (1989). “Constrained Genetic Optimization via Dynamic Reward—Penalty Balancing and Its Use in Pattern Recognition.” In Proceedings of the Third International Conference on Genetic Algorithms. (pp. 141–150). Los Altos, CA: Morgan Kaufmann.
Smith, A.E., and D.M., Tate. (1993). “Genetic Optimization Using a Penalty Function.” In Proceedings of the Fifth International Conference on Genetic Algorithms (pp. 499–503). Urbana-Champaign, CA: Morgan Kaufmann.
Starkweather, T., S., McDaniel, K., Mathias, C., Whitley, and D., Whitley. (1991). “A Comparison of Genetic Sequencing Operators.” In Proceedings of the Fourth International Conference on Genetic Algorithms (pp. 69–76). San Diego, CA: Morgan Kaufmann.
Surry, P.D., N.J. Radcliffe, and I.D. Boyd. (1995). “A Multi-objective Approach to Constrained Optimization of Gas Supply Networks.” Presented at the AISB-95 Workshop on Evolutionary Computing, Sheffield, UK, April 3–4.
Voss, S. (1993). “Tabu Search: Applications and Prospects.” Technical report, Technische Hochshule Darmstadt.
Whitley, D., V.S., Gordon, and K., Mathias. (1994). “Lamarckian Evolution, the Baldwin Effect and Function Optimization.” In Proceedings of the Parallel Problem Solving from Nature, 3 (pp. 6–15). New York: Springer-Verlag.
Xu, J., and J.P., Kelly. (1995). “A Robust Network Flow-Based Tabu Search Approach for the Vehicle Routing Problem.” Graduate School of Business, University of Colorado, Boulder.
Author information
Authors and Affiliations
Additional information
“An abridged version of this paper appears in the volume entitled META-HEURISTICS: Theory & Application, edited by Ibrahim H. Osman and James P. Kelly, to be published by Kluwer Academic Publishers in March 1996.”
Rights and permissions
About this article
Cite this article
Michalewicz, Z. Heuristic methods for evolutionary computation techniques. J Heuristics 1, 177–206 (1996). https://doi.org/10.1007/BF00127077
Issue Date:
DOI: https://doi.org/10.1007/BF00127077