| Naslov: | Evaluating feature-based machine-learning models with post hoc explainability for eye-tracking-based task type and workload inference |
|---|
| Avtorji: | ID Božak, Tomi, Institut "Jožef Stefan" (Avtor)
ID Goyal, Shivalika (Avtor)
ID Langheinrich, Marc (Avtor)
ID Gjoreski, Martin (Avtor)
ID Slapničar, Gašper, Institut "Jožef Stefan" (Avtor) |
|---|
| Datoteke: |  URL - Izvorni URL, za dostop obiščite https://www.mdpi.com/2673-2688/7/8/325
 PDF - Predstavitvena datoteka, prenos (4,16 MB)
MD5: AD1E3FCBD1A9F794C445C1BD907A0E68
|
|---|
| Jezik: | Angleški jezik |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: |  IJS - Institut Jožef Stefan
|
|---|
| Povzetek: | Eye tracking is a valuable behavioral signal for human-centered AI, yet the reliability of feature-based machine-learning models for inferring task type and workload across users and tasks remains uncertain, because experimentally defined workload labels may reflect task type and visual structure as much as cognitive demand. The practical problem is that designers of gaze-adaptive systems need to know which inferences are dependable enough to act on, and reported accuracies alone do not answer this, because the choice of prediction target and validation split can determine the result. This study systematically evaluates feature-based machine-learning models with post hoc explainability across three prediction targets: task type, binary load-versus-rest, and three-level workload. Eye-movement features derived from fixations, saccades, pupils, and blinks were extracted from short temporal windows collected from 54 participants performing attention, visual-spatial, and memory tasks under rest, easy, and difficult conditions, and evaluated using leave-one-subject-out (LOSO) and leave-one-group-out (LOGO) validation. Task type was classified most reliably (85.9% LOSO, 83.4% LOGO), binary load-versus-rest showed moderate, validation-sensitive robustness (81.4% LOSO, 63.9% LOGO), and three-level workload classification was substantially more challenging (56.4% LOSO, 44.3% LOGO). SHAP and statistical analyses consistently identified fixation dispersion, pupil-related measures, and subject-normalized features as the strongest contributors across all three targets. These findings show that prediction target definition, validation strategy, and post hoc explainability jointly determine what can be reliably inferred from gaze-based machine-learning models. Eye tracking alone therefore appears promising for task-type recognition and may support coarse engagement-related inference when the deployment task family is represented during model development, whereas task-independent fine-grained workload estimation remains unsupported by the present evidence. |
|---|
| Ključne besede: | eye tracking, task-type inference, workolad inference, post hoc explainability |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 19.07.2026 |
|---|
| Datum sprejetja članka: | 18.08.2026 |
|---|
| Datum objave: | 21.08.2026 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2026 |
|---|
| Št. strani: | str. 1-26 |
|---|
| Številčenje: | Vol. 7, iss. 8, [article no.] 325 |
|---|
| Izvor: | Švica |
|---|
| PID: | 20.500.12556/DiRROS-32396  |
|---|
| UDK: | 004.8 |
|---|
| ISSN pri članku: | 2673-2688 |
|---|
| DOI: | 10.3390/ai7080325 |
|---|
| COBISS.SI-ID: | 289335043 |
|---|
| Avtorske pravice: | © 2026 by the authors. |
|---|
| Opomba: | Nasl. z nasl. zaslona;
Soavtor iz Slovenije: Gašper Slapničar;
Opis vira z dne 28. 8. 2026;
|
|---|
| Datum objave v DiRROS: | 09.09.2026 |
|---|
| Število ogledov: | 32 |
|---|
| Število prenosov: | 15 |
|---|
| Metapodatki: |    |
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
