| Title: | Generalization ability of feature-based performance prediction models : a statistical analysis across benchmarks |
|---|
| Authors: | ID Nikolikj, Ana, Institut Jožef Stefan (Author)
ID Kostovska, Ana, Institut Jožef Stefan (Author)
ID Cenikj, Gjorgjina, Institut Jožef Stefan (Author)
ID Doerr, Carola (Author)
ID Eftimov, Tome, Institut Jožef Stefan (Author) |
|---|
| Files: |  URL - Source URL, visit https://ieeexplore.ieee.org/document/10611952
 PDF - Presentation file, download (1,29 MB)
MD5: CFAE608E802112036A4DFAC6B41B8FAB
|
|---|
| Language: | English |
|---|
| Typology: | 1.08 - Published Scientific Conference Contribution |
|---|
| Organization: |  IJS - Jožef Stefan Institute
|
|---|
| Abstract: | This study examines the generalization ability of algorithm performance prediction models across various bench-mark suites. Comparing the statistical similarity between the problem collections with the accuracy of performance prediction models that are based on exploratory landscape analysis features, we observe that there is a positive correlation between these two measures. Specifically, when the high-dimensional feature value distributions between training and testing suites lack statistical significance, the model tends to generalize well, in the sense that the testing errors are in the same range as the training errors. Two experiments validate these findings: one involving the standard benchmark suites, the BBOB and CEC collections, and another using five collections of affine combinations of BBOB problem instances. |
|---|
| Keywords: | meta-learning, single-objective optimization, module importance |
|---|
| Publication status: | Published |
|---|
| Publication version: | Author Accepted Manuscript |
|---|
| Publication date: | 08.08.2024 |
|---|
| Publisher: | IEEE |
|---|
| Year of publishing: | 2024 |
|---|
| Number of pages: | 8 str. |
|---|
| Source: | ZDA |
|---|
| PID: | 20.500.12556/DiRROS-20434  |
|---|
| UDC: | 004.85 |
|---|
| DOI: | 10.1109/CEC60901.2024.10611952 |
|---|
| COBISS.SI-ID: | 206945027 |
|---|
| Copyright: | © 2024 IEEE |
|---|
| Note: | Nasl. z nasl. zaslona;
Opis vira z dne 10. 9. 2024;
|
|---|
| Publication date in DiRROS: | 16.09.2024 |
|---|
| Views: | 247 |
|---|
| Downloads: | 110 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
