1. Generalization ability of feature-based performance prediction models : a statistical analysis across benchmarksAna Nikolikj, Ana Kostovska, Gjorgjina Cenikj, Carola Doerr, Tome Eftimov, 2024, published scientific conference contribution Abstract: This study examines the generalization ability of algorithm performance prediction models across various bench-mark suites. Comparing the statistical similarity between the problem collections with the accuracy of performance prediction models that are based on exploratory landscape analysis features, we observe that there is a positive correlation between these two measures. Specifically, when the high-dimensional feature value distributions between training and testing suites lack statistical significance, the model tends to generalize well, in the sense that the testing errors are in the same range as the training errors. Two experiments validate these findings: one involving the standard benchmark suites, the BBOB and CEC collections, and another using five collections of affine combinations of BBOB problem instances.
Keywords: meta-learning, single-objective optimization, module importance
Published in DiRROS: 16.09.2024; Views: 153; Downloads: 74
 Full text (1,29 MB)
This document has many files! More... |
2. |
3. PS-AAS : portfolio selection for automated algorithm selection in black-box optimizationAna Kostovska, Gjorgjina Cenikj, Diederick Vermetten, Anja Janković, Ana Nikolikj, Urban Škvorc, Peter Korošec, Carola Doerr, Tome Eftimov, 2023, published scientific conference contribution Keywords: automated algorithm selection, portfolio selection, black box optimization
Published in DiRROS: 11.12.2023; Views: 718; Downloads: 274
Full text (1,90 MB)
This document has many files! More... |
4. Sensitivity analysis of RF+clust for leave-one-problem-out performance predictionAna Nikolikj, Michal Pluhacek, Carola Doerr, Peter Korošec, Tome Eftimov, 2023, published scientific conference contribution Keywords: automated performance prediction, autoML, single-objective black-box optimization, zero-shot learning
Published in DiRROS: 13.11.2023; Views: 668; Downloads: 422
Full text (4,94 MB)
This document has many files! More... |
5. Algorithm instance footprint : separating easily solvable and challenging problem instancesAna Nikolikj, Sašo Džeroski, Mario Andrés Muñoz, Carola Doerr, Peter Korošec, Tome Eftimov, 2023, published scientific conference contribution Keywords: black-box optimization, algorithms, problem instances, machine learning
Published in DiRROS: 15.09.2023; Views: 613; Downloads: 341
Full text (2,03 MB)
This document has many files! More... |
6. Assessing the generalizability of a performance predictive modelAna Nikolikj, Gjorgjina Cenikj, Gordana Ispirova, Diederick Vermetten, Ryan Dieter Lang, Andries Petrus Engelbrecht, Carola Doerr, Peter Korošec, Tome Eftimov, 2023, published scientific conference contribution Keywords: algorithms, predictive models, machine learning
Published in DiRROS: 15.09.2023; Views: 677; Downloads: 405
Full text (935,67 KB)
This document has many files! More... |
7. |
8. DynamoRep : trajectory-based population dynamics for classification of black-box optimization problemsGjorgjina Cenikj, Gašper Petelin, Carola Doerr, Peter Korošec, Tome Eftimov, 2023, published scientific conference contribution Keywords: black-box single-objective optimization, optimization problem classification, problem representation, meta-learning
Published in DiRROS: 30.08.2023; Views: 662; Downloads: 409
Full text (650,13 KB)
This document has many files! More... |
