Tuning metaheuristics by sequential optimisation of regression models

Abstract

Tuning parameters is an important step for the application of metaheuristics to specific problem classes. In this work we present a tuning framework based on the sequential optimisation of perturbed regression models. Besides providing algorithm configurations with good expected performance, the proposed methodology can also provide insights on the relevance of each parameter and their interactions, as well as models of expected algorithm performance for a given problem class, conditional on the parameter values. A number of test cases are presented, including the use of a simulation model in which the true optimal parameters of a hypothetical algorithm are known, as well as usual tuning scenarios for different problem classes. Comparative analyses are presented against Iterated Racing, SMAC, and ParamILS. The results suggest that the proposed approach returns high quality solutions in terms of mean performance of the algorithms equipped with the resulting configurations, with the advantage of providing additional information on the relevance and effect of each parameter on the expected performance.

Publication DOI: https://doi.org/10.1016/j.asoc.2019.105829
Divisions: College of Engineering & Physical Sciences
Additional Information: © 2019, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Uncontrolled Keywords: Metaheuristics,Parameter tuning,Regression modelling,Software
Publication ISSN: 1872-9681
Last Modified: 26 Feb 2024 08:33
Date Deposited: 07 Oct 2019 09:28
Full Text Link: https://arxiv.o ... /abs/1809.03646
Related URLs: https://linking ... 568494619306106 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2019-12-01
Published Online Date: 2019-10-09
Accepted Date: 2019-10-01
Authors: Trindade, Áthila
Campelo, Felipe (ORCID Profile 0000-0001-8432-4325)

Export / Share Citation


Statistics

Additional statistics for this record