Lyapunov design of a simple step-size adaptation strategy based on success

Correa, Claudia R., Wanner, Elizabeth F. and Fonseca, Carlos M. (2016). Lyapunov design of a simple step-size adaptation strategy based on success. IN: Parallel Problem Solving from Nature – PPSN XIV. Handl, Julia; Hart, Emma; Lewis, Peter R. and et al (eds) Lecture Notes in Computer Science . Cham (CH): Springer.

Abstract

A simple success-based step-size adaptation rule for singleparent Evolution Strategies is formulated, and the setting of the corresponding parameters is considered. Theoretical convergence on the class of strictly unimodal functions of one variable that are symmetric around the optimum is investigated using a stochastic Lyapunov function method developed by Semenov and Terkel [5] in the context of martingale theory. General expressions for the conditional expectations of the next values of step size and distance to the optimum under (1 +, λ)-selection are analytically derived, and an appropriate Lyapunov function is constructed. Convergence rate upper bounds, as well as adaptation parameter values, are obtained through numerical optimization for increasing values of λ. By selecting the number of offspring that minimizes the bound on the convergence rate with respect to the number of function evaluations, all strategy parameter values result from the analysis.

Publication DOI: https://doi.org/10.1007/978-3-319-45823-6_10
Divisions: Engineering & Applied Sciences
Event Title: 14th International Conference on Parallel Problem Solving from Nature
Event Type: Other
Event Dates: 2016-09-17 - 2016-09-21
Uncontrolled Keywords: convergence rate,evolution strategy,Lyapunov function theory,step-size adaptation,Theoretical Computer Science,Computer Science(all)
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
Published Date: 2016
Authors: Correa, Claudia R.
Wanner, Elizabeth F. ( 0000-0001-6450-3043)
Fonseca, Carlos M.

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record