Constrained Optimization in Simulation: Efficient Global Optimization and Karush-Kuhn-Tucker Conditions

Jack Kleijnen, I. van Nieuwenhuyse, W.C.M. van Beers

Research output: Working paperDiscussion paperOther research output

44 Downloads (Pure)

Abstract

An important goal of simulation is optimization of the corresponding real system. We focus on simulation models with multiple responses (out-puts), selecting one response as the variable to be maximized or minimized while the remaining responses satisfy prespecified thresholds; i.e., we focus on constrained optimization problems. To solve this type of problem, we treat the simulation model as a black box. We assume that the simulation is computationally expensive; therefore, we use an inexpensive metamodel (approximation, emulator, surrogate) of the simulation model. A popular metamodel type is a Kriging or Gaussian process (GP) model (which is also used in supervised learning). For optimization with a single response, this GP is used in "efficient global optimization" (EGO) (which is also used in Bayesian optimization and is related to active learning). For simulation with multiple responses, there are several EGO variants. We develop an innovative EGO variant that uses the "Karush-Kuhn-Tucker" (KKT) conditions for constrained optimization. We combine these conditions with the "expected improvement" (EI) criterion, which is popular in EGO. To evaluate the performance of our KT-EGO variant, we apply this variant to several examples. These examples give promising numerical results.
Original languageEnglish
Place of PublicationTilburg
PublisherCentER, Center for Economic Research
Number of pages59
Volume2021-031
Publication statusPublished - 8 Nov 2021

Publication series

NameCentER Discussion Paper
Volume2021-031

Keywords

  • kriging
  • efficient global optimization
  • Karush-Kuhn-Tucker conditions

Fingerprint

Dive into the research topics of 'Constrained Optimization in Simulation: Efficient Global Optimization and Karush-Kuhn-Tucker Conditions'. Together they form a unique fingerprint.

Cite this