| Naslov: | Evaluating chatbot assistance in historical document analysis |
|---|
| Avtorji: | ID Hazemali, David (Avtor)
ID Osojnik, Janez (Avtor)
ID Onič, Tomaž (Avtor)
ID Todorović, Tadej (Avtor)
ID Borovič, Mladen (Avtor) |
|---|
| Datoteke: |  URL - Izvorni URL, za dostop obiščite https://www.pokarh-mb.si/storage/app/media/Moderna_arhivistika_2024_2/05_Hazemali_2024.pdf
 PDF - Predstavitvena datoteka, prenos (1,20 MB)
MD5: 286E7A62A58FC84C08EA65D9D61AE515
|
|---|
| Jezik: | Angleški jezik |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: |  PAM - Pokrajinski arhiv Maribor
|
|---|
| Povzetek: | The article explores the potential of PDFGear Copilot, a chatbot-based PDF editing tool, in assisting with the analysis of historical documents. We evaluated the chatbot's performance on a document relating to the Slovenian War of Independence. We included 25 factual and 5 interpretative questions to address its formal characteristics and content details, assess its capacity for in-depth interpretation and contextualized critical analysis, and evaluate the chatbot’s language use and robustness. The chatbot exhibited some ability to answer factual questions, even though its performance varied. It demonstrated proficiency in navigating document structure, named entity recognition, and extracting basic document information. However, performance declined significantly in tasks such as document type identification, content details, and tasks requiring deeper text analysis. For interpretative questions, the chatbot's performance was notably inadequate, failing to link cause-and-effect relationships and provide the depth and nuance required for historical inquiries. |
|---|
| Ključne besede: | chatbots, historical document analyses, Yugoslavia, wars, generative, artificial intelligence, large language models |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Datum objave: | 01.01.2024 |
|---|
| Leto izida: | 2024 |
|---|
| Št. strani: | str. 53-83 |
|---|
| Številčenje: | Letn. 7, št. 2 |
|---|
| PID: | 20.500.12556/DiRROS-31586  |
|---|
| UDK: | 004.8:930.25 |
|---|
| ISSN pri članku: | 2591-0884 |
|---|
| DOI: | 10.54356/MA/2024/BIUB3010 |
|---|
| COBISS.SI-ID: | 219271683 |
|---|
| Opomba: | Nasl. z nasl. zaslona;
Soavtorji: Janez Osojnik, Tomaž Onič, Tadej Todorović, Mladen Borovič;
Opis vira z dne 16. 12. 2024;
|
|---|
| Datum objave v DiRROS: | 05.08.2026 |
|---|
| Število ogledov: | 192 |
|---|
| Število prenosov: | 88 |
|---|
| Metapodatki: |    |
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
