| Title: | Can AI-assisted Essay Assessment Support Teachers? : A Cross-sectional Mixed-methods Research Conducted at the University of Montenegro |
|---|
| Authors: | ID Ivanović, Igor (Author) |
|---|
| Files: |  PDF - Presentation file, download (2,66 MB)
MD5: B305036F19C46B8EE6AF0BA05F141A67
 URL - Source URL, visit https://publ.zdjp.si/index.php/ashs/issue/view/2
|
|---|
| Language: | English |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: |  IRRIS - Institute IRRIS for Research, Development and Strategies of Society, Culture and Environment
|
|---|
| Abstract: | In this study, we will try to answer the question if an AI language model can provide teachers with essay assessment solutions that are on a par with the solutions provided by experienced professors. We designed a study with the aim of comparing the essay assessment outputs of the AI language model and three of our colleagues working at the University of Montenegro. The main aim of this paper is to investigate if this AI language model can be a viable teachers’ assistance tool that provides immediate and meaningful feedback to teachers and students. Our hypothesis is, with some caveats, that the AI language model is more than a viable and useful tool, capable of providing meaningful and immediate feedback, greatly reducing the assessment time, and thus helping the teachers become more efficient and consistent. We will compare the results of 78 essays assessed by three teachers with the results provided by ChatGPT and see where the two sets of results converge or diverge in terms of their individual and overall scores. |
|---|
| Keywords: | ChatGPT, automated grading, AI language models, essay assessment, essay feedback, assessment metrics, natural language processing |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Publication date: | 01.01.2023 |
|---|
| Year of publishing: | 2023 |
|---|
| Number of pages: | 571-590 |
|---|
| Numbering: | 33, 3 |
|---|
| PID: | 20.500.12556/DiRROS-30956  |
|---|
| UDC: | 009, 004.89:37.091.26 |
|---|
| ISSN on article: | 1408-5348 |
|---|
| DOI: | 10.19233/ASHS.2023.30 |
|---|
| COBISS.SI-ID: | 201637123 |
|---|
| Copyright: | Imetniki avtorskih pravic na prispevkih so avtorji. CC BY-NC 4.0 |
|---|
| Publication date in DiRROS: | 09.07.2026 |
|---|
| Views: | 155 |
|---|
| Downloads: | 94 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
