Lyapunov design of a simple step-size adaptation strategy based on success

Abstract

A simple success-based step-size adaptation rule for singleparent Evolution Strategies is formulated, and the setting of the corresponding parameters is considered. Theoretical convergence on the class of strictly unimodal functions of one variable that are symmetric around the optimum is investigated using a stochastic Lyapunov function method developed by Semenov and Terkel [5] in the context of martingale theory. General expressions for the conditional expectations of the next values of step size and distance to the optimum under (1 +, λ)-selection are analytically derived, and an appropriate Lyapunov function is constructed. Convergence rate upper bounds, as well as adaptation parameter values, are obtained through numerical optimization for increasing values of λ. By selecting the number of offspring that minimizes the bound on the convergence rate with respect to the number of function evaluations, all strategy parameter values result from the analysis.

Publication DOI: https://doi.org/10.1007/978-3-319-45823-6_10
Divisions: College of Engineering & Physical Sciences
Event Title: 14th International Conference on Parallel Problem Solving from Nature
Event Type: Other
Event Dates: 2016-09-17 - 2016-09-21
Uncontrolled Keywords: convergence rate,evolution strategy,Lyapunov function theory,step-size adaptation,Theoretical Computer Science,General Computer Science
ISBN: 978-3-319-45822-9, 978-3-319-45823-6
Last Modified: 08 Oct 2024 07:08
Date Deposited: 16 Mar 2017 09:50
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Conference contribution
Published Date: 2016-08-31
Published Online Date: 2016-08-31
Accepted Date: 2016-06-17
Authors: Correa, Claudia R.
Wanner, Elizabeth F. (ORCID Profile 0000-0001-6450-3043)
Fonseca, Carlos M.

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record