| Title: | A cross-benchmark examination of feature-based algorithm selector generalization in single-objective numerical optimization |
|---|
| Authors: | ID Cenikj, Gjorgjina, Institut Jožef Stefan (Author)
ID Petelin, Gašper, Institut Jožef Stefan (Author)
ID Eftimov, Tome, Institut Jožef Stefan (Author) |
|---|
| Files: |  URL - Source URL, visit https://www.sciencedirect.com/science/article/pii/S2210650224000725?ref=pdf_download&fr=RR-2&rr=88747ba19cc40e85
 PDF - Presentation file, download (2,49 MB)
MD5: 419C0FFF6D0C63381D3BF48BAB80CFFE
|
|---|
| Language: | English |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: |  IJS - Jožef Stefan Institute
|
|---|
| Abstract: | The task of selecting the best optimization algorithm for a particular problem is known as algorithm selection (AS). This involves training a model using landscape characteristics to predict algorithm performance, but a key challenge remains: making AS models generalize effectively to new, untrained benchmark suites. This study assesses AS models’ generalizability in single-objective numerical optimization across diverse benchmark suites. Using Exploratory Landscape Analysis (ELA) and transformer-based (TransOpt) features, the research investigates their individual and combined effectiveness in AS across four benchmarks: BBOB, AFFINE, RANDOM, and ZIGZAG. AS models perform differently based on benchmark suite similarities in algorithm performance distributions and single-best solvers. When suites align, these models underperform against a baseline predicting mean algorithm performance; yet, they outperform the baseline when suites differ in performance distributions and solvers. The AS models trained using the ELA landscape features are better than the models trained using the TransOpt features on the BBOB and AFFINE benchmark suites, while the opposite is true for the RANDOM benchmark suite. Ultimately, the study reveals challenges in accurately capturing algorithm performance through problem landscape features (ELA or TransOpt), impacting AS model applicability. |
|---|
| Keywords: | algorithm selection, multi-target regression, generalization, benchmarking |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Submitted for review: | 06.02.2024 |
|---|
| Article acceptance date: | 06.03.2024 |
|---|
| Publication date: | 11.04.2024 |
|---|
| Publisher: | Elsevier |
|---|
| Year of publishing: | 2024 |
|---|
| Number of pages: | 1-17 str. |
|---|
| Numbering: | Vol. 87 |
|---|
| Source: | Nizozemska |
|---|
| PID: | 20.500.12556/DiRROS-18964  |
|---|
| UDC: | 004 |
|---|
| ISSN on article: | 2210-6510 |
|---|
| DOI: | 10.1016/j.swevo.2024.101534 |
|---|
| COBISS.SI-ID: | 192973315 |
|---|
| Copyright: | © 2024 The Authors. |
|---|
| Note: | Opis vira z dne 18. 4. 2024;
Nasl. z nasl. zaslona;
|
|---|
| Publication date in DiRROS: | 21.05.2024 |
|---|
| Views: | 490 |
|---|
| Downloads: | 503 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
