JANKOVIC Anja
Supervision : Carola DOERR
Towards Online Landscape-Aware Algorithm Selection in Numerical Black-Box Optimization
Black-box optimization algorithms (BBOAs) are conceived for settings in which exact problem formulations are non-existent or inaccessible, or in which problems are too complex to be solved analytically, thus requiring users to treat it as a black box. In those scenarios, BBOAs are essentially the only means of finding a good solution to such a problem. Due to their general applicability, BBOAs can exhibit different behaviors when optimizing different types of problems. This yields a meta-optimization problem of choosing the best suited algorithm for a particular problem at hand, called the algorithm selection problem.
By reason of inherent bias and limited knowledge of the complex relationship between algorithms, problems, and performance, a manual selection of the algorithms is undesirable. In consequence, the vision of automating the selection process has quickly gained traction in the evolutionary computation community. One prominent way of doing so is via so-called landscape-aware algorithm selection, where the choice of the algorithm is based on predicting its performance by means of numerical problem instance representations called features. There exists a large body of work in this very domain. However, a key challenge that landscape-aware algorithm selection faces is the computational overhead of extracting the features, a step typically designed to precede the actual optimization, which reduces the computational budget that can be allocated to the optimization algorithm.
In this thesis, we propose a novel trajectory-based landscape-aware algorithm selection approach which incorporates the feature extraction step within the optimization process. We show that the features computed using the search trajectory samples can lead to very robust and reliable predictions of algorithm performance, and consequently to powerful algorithm selection models built atop. We also present several preparatory analyses, including a novel perspective of combining two complementary regression strategies that outperforms any of the classical, single regression models, to amplify the quality of the final selector.
Defence : 12/17/2021
Jury members :
Marie-Eléonore Kessaci, Université de Lille – CRIStAL [Rapporteur]
Heike Trautmann, University of Münster – Department of Information Systems [Rapporteur]
Jamal Atif, Université Paris-Dauphine – LAMSADE
Evripidis Bampis, Sorbonne Université – LIP6
Christoph Dürr, CNRS, Sorbonne Université – LIP6
Alberto Tonda, INRAE, AgroParisTech – EKINOCS
Carola Doerr, CNRS, Sorbonne Université - LIP6
2019-2023 Publications
-
2023
- A. Kostovska, A. Janković, D. Vermetten, S. Dzeroski, T. Eftimov, C. Doerr : “Comparing Algorithm Selection Approaches on Black-Box Optimization Problems”, GECCO '23 Companion: Companion Conference on Genetic and Evolutionary Computation, Lisbon, Portugal, pp. 495-498, (ACM) (2023)
- C. Benjamins, E. Raponi, A. Janković, C. Doerr, M. Lindauer : “Towards Self-Adjusting Weighted Expected Improvement for Bayesian Optimization”, GECCO '23 Companion: Companion Conference on Genetic and Evolutionary Computation, Lisbon, Portugal, pp. 483-486, (ACM) (2023)
- A. Kostovska, G. Cenikj, D. Vermetten, A. Janković, A. Nikolikj, U. Skvorc, P. Korosec, C. Doerr, T. Eftimov : “PS-AAS: Portfolio Selection for Automated Algorithm Selection in Black-Box Optimization”, Proceedings of Machine Learning Research (PMLR), Potsdam, Germany (2023)
- C. Benjamins, E. Raponi, A. Janković, C. Doerr, M. Lindauer : “Self-Adjusting Weighted Expected Improvement for Bayesian Optimization”, Proceedings of Machine Learning Research (PMLR), Potsdam, Germany (2023)
-
2022
- C. Benjamins, E. Raponi, A. Janković, K. Van der Blom, M. Santoni, M. Lindauer, C. Doerr : “PI is back! Switching Acquisition Functions in Bayesian Optimization”, 2022 NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, New Orleans, United States (2022)
- C. Benjamins, A. Janković, E. Raponi, K. Van der Blom, M. Lindauer, C. Doerr : “Towards Automated Design of Bayesian Optimization via Exploratory Landscape Analysis”, 6th Workshop on Meta-Learning at NeurIPS 2022, New Orleans, United States (2022)
- A. Janković, D. Vermetten, A. Kostovska, J. De Nobel, T. Eftimov, C. Doerr : “Trajectory-based Algorithm Selection with Warm-starting”, 2022 IEEE Congress on Evolutionary Computation (CEC), 2022 IEEE Congress on Evolutionary Computation (CEC), Padua, Italy, pp. 1-8, (IEEE) (2022)
- A. Kostovska, A. Janković, D. Vermetten, J. De Nobel, H. Wang, T. Eftimov, C. Doerr : “Per-run Algorithm Selection with Warm-starting using Trajectory-based Features”, 17th Proceedings of Parallel Problem Solving from Nature - (PPSN) 2022, Dortmund, Germany, pp. 46-60 (2022)
-
2021
- A. Jankovic : “Towards Online Landscape-Aware Algorithm Selection in Numerical Black-Box Optimization”, thesis, phd defence 12/17/2021, supervision Doerr, Carola (2021)
- T. Eftimov, A. Janković, G. Popovski, C. Doerr, P. Korosec : “Personalizing Performance Regression Models to Black-Box Optimization Problems”, Genetic and Evolutionary Computation Conference (GECCO 2021), Proc. of Genetic and Evolutionary Computation Conference (GECCO 2021), Lille, France (2021)
- A. Janković, G. Popovski, T. Eftimov, C. Doerr : “The Impact of Hyper-Parameter Tuning for Landscape-Aware Performance Regression and Algorithm Selection”, Genetic and Evolutionary Computation Conference (GECCO 2021), Lille, France, pp. 687-696, (Association for Computing Machinery) (2021)
- A. Janković, T. Eftimov, C. Doerr : “Towards Feature-Based Performance Regression Using Trajectory Data”, Applications of Evolutionary Computation 24th International Conference, EvoApplications 2021, Held as Part of EvoStar 2021, Virtual Event, April 7–9, 2021, Proceedings, vol. 12694, Lecture Notes in Computer Science, Sevilla (on line), Spain, pp. 601-617, (Springer) (2021)
-
2020
- A. Janković, C. Doerr : “Landscape-Aware Fixed-Budget Performance Regression and Algorithm Selection for Modular CMA-ES Variants”, GECCO'20 Proceedings of the ACM Genetic and Evolutionary Computation Conference, GECCO 2020 Proceedings, Cancun, Mexico, (ACM) (2020)
-
2019
- A. Janković, C. Doerr : “Adaptive landscape analysis (student workshop paper)”, Genetic and Evolutionary Computation Conference, Companion Material, Prague, Czechia, pp. 2032-2035, (ACM Press) (2019)