Skip to main content

Optimization with noisy function evaluations

  • Conference paper
  • First Online:
Parallel Problem Solving from Nature — PPSN V (PPSN 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1498))

Included in the following conference series:

Abstract

In the optimization literature it is frequently assumed that the quality of solutions can be determined by calculating deterministic objective function values. Practical optimization problems, however, often require the evaluation of solutions through experimentation, stochastic simulation, sampling, or even interaction with the user. Thus, most practical problems involve noise. We empirically investigate the robustness of population-based versus point-based optimization methods on a range of parameter optimization problems when noise is added. Our results favor population-based optimization, and the evolution strategy in particular.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bäck, T.: Evolutionary Algorithms in Theory and Practice. Oxf. Univ. Press, N.Y. (1996)

    Google Scholar 

  2. Baker, J.E.: Reducing Bias and Inefficiency in the Selection Algorithm. In: Proceedings ICGA II, Lawrence Erlbaum, Hillsdale (1987) 14–21

    Google Scholar 

  3. Beyer, H.-G.: Toward a Theory of ES: Some Asymptotical Results from the (1,+λ)-Theory. Evolutionary Computation 1 (2) (1993) 165–188

    Google Scholar 

  4. Dueck, G.; Scheuer, T.: Threshold Accepting: A General Purpose Optimization Algorithm Appearing Superior to Simulated Annealing. Journal of Comp. Physics 90 (1990) 161–175

    Article  MATH  MathSciNet  Google Scholar 

  5. Fitzpatrick, J.M.; Grefenstette, J.J.: GA in Noisy Environments. Machine Learning 3 (1988) 101–120

    Google Scholar 

  6. Fogel, D.B.; Ghozeil, A.: Schema Processing Under Proportional Selection in the Presence of Random Effects. IEEE Transactions on Evolutionary Computation 1 (4) (1997) 290–293

    Article  Google Scholar 

  7. Goldberg, D.E.; Deb, K.; Clark, J.H.: Genetic Algorithms, Noise, and the Sizing of Populations. Complex Systems 6 (1992) 333–362

    MATH  Google Scholar 

  8. Grefenstette, J.J.; Fitzpatrick, J.M.: Genetic Search with Approximate Function Evalutations. In: Proceedings ICGA I, Lawrence Erlbaum, Hillsdale (1985) 112–120

    Google Scholar 

  9. Grefenstette, J.J.: Deception Considered Harmful. In: Whitley, D. (Ed.): Foundations of Genetic Algorithms 2, Morgan Kaufmann, San Mateo (1993) 75–91

    Google Scholar 

  10. Hammel, U.; Bäck, T.: Evolution Strategies on Noisy Functions. How to Improve Convergence Properties. In: Proceedings PPSN III, Springer, Berlin (1994) 159–168

    Google Scholar 

  11. Miller, B.: Noise, Sampling, and Efficient GAs, Doctoral Thesis, Urbana, Illinois (1997)

    Google Scholar 

  12. Mühlenbein, H.: Evolution in Time and Space. In: Rawlins, G. (ed.): Foundations of Genetic Algorithms, Morgan Kaufmann, San Mateo (1991) 316–337

    Google Scholar 

  13. Nissen, V.; Biethahn, J.: Determining a Good Inventory Policy with a GA. In: Biethahn and Nissen (eds.): Evolutionary Algorithms in Management Applications. Springer, Berlin (1995) 240–249

    Google Scholar 

  14. Nissen, V.; Paul, H.: A Modification of Threshold Accepting and its Application to the Quadratic Assignment Problem. OR Spektrum 17 (1995) 205–210

    Article  MATH  Google Scholar 

  15. Nissen, V.; Propach, J.: On the Robustness of Population-Based Versus Point-Based Optimization in the Presence of Noise. To appear in IEEE Transactions on EC

    Google Scholar 

  16. Rana, S.; Whitley, D.; Cogswell, R.: Searching in the Presence of Noise. In: Proceedings PPSN IV, Springer, Berlin (1996) 198–207

    Google Scholar 

  17. Rudolph, G.: Massively Parallel Simulated Annealing and Its Relation to Evolutionary Algorithms. Evolutionary Computation 1 (1993) 361–383

    Google Scholar 

  18. Schwefel, H.-P.: Evolution and Optimum Seeking. Wiley&Sons, New York (1995)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Agoston E. Eiben Thomas Bäck Marc Schoenauer Hans-Paul Schwefel

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nissen, V., Propach, J. (1998). Optimization with noisy function evaluations. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, HP. (eds) Parallel Problem Solving from Nature — PPSN V. PPSN 1998. Lecture Notes in Computer Science, vol 1498. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0056859

Download citation

  • DOI: https://doi.org/10.1007/BFb0056859

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65078-2

  • Online ISBN: 978-3-540-49672-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics