Efficiently minimizing expensive cost functions with a hybrid evolutionary algorithm using clustering and a derivative-free optimizer: Preliminary results

Yoel Tenne, S. W. Armfield

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

A novel hybrid algorithm is presented to efficiently locate the global minimum of a function where each function evaluation is expensive and no expression is available for the function nor its derivatives. The hybrid employs an evolutionary algorithm, a density cluster analysis algorithm and a derivate-free optimizer in a multi-level hierarchical structure. The hybrid algorithm utilizes information generated during the minimization to reduce the number of function evaluations and to improve its domain exploration. The hybrid was compared to an evolutionary algorithm and to a multi-start derivative-free optimizer since both are candidate algorithms to handle this global minimization problem. The algorithms were tested using a small and a large domain. Test results showed that while the evolutionary algorithm did not progress much after an initial phase the hybrid maintained a high rate of minimization throughout and accordingly provided a final result which was on average ο(10 6) more accurate for the small domain and ο(108) more accurate for the large domain. Furthermore, the number of function evaluations required by the multi-start derivative-free optimizer was affected by the initial random population and accordingly by an increase in the domain size. In contrast the hybrid was not affected since it employed the explorative evolutionary algorithm phase and thus was able to locate better starting nodes in a larger domain.

Original languageEnglish
Title of host publication2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005. Proceedings
Pages1937-1944
Number of pages8
StatePublished - 2005
Externally publishedYes
Event2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005 - Edinburgh, Scotland, United Kingdom
Duration: 2 Sep 20055 Sep 2005

Publication series

Name2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005. Proceedings
Volume3

Conference

Conference2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005
Country/TerritoryUnited Kingdom
CityEdinburgh, Scotland
Period2/09/055/09/05

Fingerprint

Dive into the research topics of 'Efficiently minimizing expensive cost functions with a hybrid evolutionary algorithm using clustering and a derivative-free optimizer: Preliminary results'. Together they form a unique fingerprint.

Cite this