| Title: | Assessment of model accuracy in eyes open and closed EEG data : effect of data pre-processing and validation methods |
|---|
| Authors: | ID Jamolbek Maqsudovich, Mattiev (Author)
ID Sajovic, Jakob (Author)
ID Drevenšek, Gorazd (Author)
ID Rogelj, Peter (Author) |
|---|
| Files: |  PDF - Presentation file, download (5,68 MB)
MD5: 9D29E2366A9F68BC88BCCE0B41C78023
 URL - Source URL, visit https://www.mdpi.com/2306-5354/10/1/42
|
|---|
| Language: | English |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: |  UKC LJ - Ljubljana University Medical Centre
|
|---|
| Abstract: | Eyes open and eyes closed data is often used to validate novel human brain activity classification methods. The cross-validation of models trained on minimally preprocessed data is frequently utilized, regardless of electroencephalography data comprised of data resulting from muscle activity and environmental noise, affecting classification accuracy. Moreover, electroencephalography data of a single subject is often divided into smaller parts, due to limited availability of large datasets. The most frequently used method for model validation is cross-validation, even though the results may be affected by overfitting to the specifics of brain activity of limited subjects. To test the effects of preprocessing and classifier validation on classification accuracy, we tested fourteen classification algorithms implemented in WEKA and MATLAB, tested on comprehensively and simply preprocessed electroencephalography data. Hold-out and cross-validation were used to compare the classification accuracy of eyes open and closed data. The data of 50 subjects, with four minutes of data with eyes closed and open each was used. The algorithms trained on simply preprocessed data were superior to the ones trained on comprehensively preprocessed data in cross-validation testing. The reverse was true when hold-out accuracy was examined. Significant increases in hold-out accuracy were observed if the data of different subjects was not strictly separated between the test and training datasets, showing the presence of overfitting. The results show that comprehensive data preprocessing can be advantageous for subject invariant classification, while higher subject-specific accuracy can be attained with simple preprocessing. Researchers should thus state the final intended use of their classifier. |
|---|
| Keywords: | electroencephalography (EEG), machine learning, model validation |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Year of publishing: | 2023 |
|---|
| Number of pages: | str. 1-21 |
|---|
| Numbering: | Vol. 10, iss. 1 |
|---|
| PID: | 20.500.12556/DiRROS-31518  |
|---|
| UDC: | 61 |
|---|
| ISSN on article: | 2306-5354 |
|---|
| DOI: | 10.3390/bioengineering10010042 |
|---|
| COBISS.SI-ID: | 136025091 |
|---|
| Note: | Nasl. z nasl. zaslona;
Opis vira z dne 4. 1. 2023;
Št. članka: 42;
|
|---|
| Publication date in DiRROS: | 04.08.2026 |
|---|
| Views: | 175 |
|---|
| Downloads: | 96 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
