Abstract
The custom in surrogate-based modeling of complex engineering problems is to fit one or more surrogate models and select the one surrogate model that performs best. In this paper, we extend the utility of an ensemble of surrogates to (1) identify regions of possible high errors at locations where predictions of surrogates widely differ, and (2) provide a more robust approximation approach. We explore the possibility of using the best surrogate or a weighted average surrogate model instead of individual surrogate models. The weights associated with each surrogate model are determined based on the errors in surrogates. We demonstrate the advantages of an ensemble of surrogates using analytical problems and one engineering problem. We show that for a single problem the choice of test surrogate can depend on the design of experiments.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barthelemy J-FM, Haftka RT (1993) Approximation concepts for optimum structural design—a review. Struct Optim 5:129–144
Dixon LCW, Szegö GP (1978) Towards global optimization 2. North Holland, Amsterdam, The Netherlands
Fang H, Rais-Rohani M, Liu Z, Horstemeyer MF (2005) A comparative study of metamodeling methods for multi-objective crashworthiness optimization. Comput Struct 83:2121–2136
Giunta A, Watson LT (1998) A comparison of approximation modeling techniques: polynomial versus interpolating models. In: 7th AIAA/USAF/NASA/ISSMO symposium on multidisciplinary analysis & optimization, St. Louis, MO, 2–4 September 1998, 1:392–404, AIAA-98-4758
Hesterberg T, Moore DS, Monaghan S, Clipson A, Epsterin R (2005) Bootstrap methods and permutation tests. Freeman, New York (Chapter 14)
Huber F (2001) Turbine aerodynamic design tool development. In: Space transportation fluids workshop. Marshall Space Flight Center, AL
Jin R, Chen W, Simpson TW (2001) Comparative studies of meta-modeling techniques under multiple modeling criteria. Struct Multidisc Optim 23(1):1–13
Li W, Padula S (2005) Approximation methods for conceptual design of complex systems. In: Chui C, Neaumtu M, Schumaker L (eds) Approximation Theory XI: Gatlinburg 2004, Nashboro Press, Brentwood, TN, pp 241–278
Mack Y, Goel T, Shyy W, Haftka RT (2005a) Surrogate model-based optimization framework: a case study in aerospace design. In: Yang S, Ong YS, Jin Y (eds). Kluwer
Mack Y, Goel T, Shyy W, Haftka RT, Queipo NV (2005b) Multiple surrogates for shape optimization for bluff-body facilitated mixing. In: 43rd AIAA aerospace sciences meeting and exhibit, Reno, Nevada 10–13 January 2005, AIAA 2005–0333
Martin JD, Simpson TW (2005) Use of Kriging models to approximate deterministic computer models. AIAA J 43(4):853–863
MATLAB® (2002) The language of technical computing, Version 6.5 Release 13. © 1984–2002, The MathWorks Inc.
Myers RH, Montgomery DC (1995) Response surface methodology—process and product optimization using designed experiments. Wiley, New York
Orr MJL (1996) Introduction to radial basis neural networks. Technical report. Center for Cognitive Science, Edinburgh University, Scotland, UK. http://anc.ed.ac.uk/rbf/
Papila N, Shyy W, Griffin LW, Dorney DJ (2001) Shape optimization of supersonic turbines using response surface and neural network methods. J Propuls Power 18:509–518
Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, Tucker PK (2005) Surrogate-based analysis and optimization. Prog Aerosp Sci 41:1–28
Shyy W, Papila N, Vaidyanathan R, Tucker PK (2001) Global design optimization for aerodynamics and rocket propulsion components. Prog Aerosp Sci 37:59–118
Simpson TW, Peplinski JD, Koch PN, Allen JK (2001) Meta-models for computer based engineering design: survey and recommendations. Eng Comput 17:129–150
Sobieszczanski-Sobieski J, Haftka RT (1997) Multidisciplinary aerospace design optimization: survey of recent developments. Struct Optim 14:1–23
Stander N, Roux W, Giger M, Redhe M, Fedorova N, Haarhoff J (2004) A comparison of meta-modeling techniques for crashworthiness optimization. In: Proceedings of the 10th AIAA/ISSMO multidisciplinary analysis and optimization conference, Albany, NY, 30 August–1 September 2004, AIAA-2004-4489
Ueberhuber CW (1997) Numerical computation 2: methods, software and analysis. Springer, Berlin Heidelberg New York, p 71
Vaidyanathan R, Tucker PK, Papila N, Shyy W (2004) CFD based design optimization for a single element rocket injector. J Propuls Power 20(4):705–717 (also presented in 41st Aerospace sciences meeting and exhibit, Reno, NV, 2003)
Zerpa L, Queipo NV, Pintos S, Salager J (2005) An optimization methodology of alkaline–surfactant–polymer flooding processes using field scale numerical simulation and multiple surrogates. J Pet Sci Eng 47:197–208 (also presented at SPE/DOE 14th symposium on improved oil recovery, 2004, April 17–21, Tulsa)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Goel, T., Haftka, R.T., Shyy, W. et al. Ensemble of surrogates. Struct Multidisc Optim 33, 199–216 (2007). https://doi.org/10.1007/s00158-006-0051-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-006-0051-9