| Title: | Computational methods for detecting insect vibrational signals in field vibroscape recordings |
|---|
| Authors: | ID Marolt, Matija (Author)
ID Pesek, Matevž (Author)
ID Šturm, Rok (Author)
ID López Díez, Juan José (Author)
ID Rexhepi, Behare (Author)
ID Virant-Doberlet, Meta (Author) |
|---|
| Files: |  URL - Source URL, visit https://doi.org/10.1016/j.ecoinf.2025.103003
 PDF - Presentation file, download (3,46 MB)
MD5: 7D2C956DAB368BEB63B3E0E38FAAF7E7
|
|---|
| Language: | English |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: |  NIB - National Institute of Biology
|
|---|
| Abstract: | The ecological significance of vibroscape has been largely overlooked, excluding an important part of the available information from ecosystem assessment. Insects rely primarily on substrate-borne vibrational signalling in their communication, which is why the majority of terrestrial insects are excluded from passive acoustic monitoring. The ability to monitor the biological component of the natural vibroscape has been limited due to a lack of data and methods to analyse the data. In this paper, we evaluate the use of deep learning models to automatically detect and classify vibrational signals from field recordings obtained with laser vibrometry. We created a dataset of annotated vibroscape recordings of meadow habitats, containing vibrational signals categorized as pulses, harmonic signals, pulse trains, and complex signals. We compared different deep neural network architectures for the detection and classification of vibrational signals, including convolutional and transformer models. The PaSST transformer architecture, which was fine-tuned from a pre-trained checkpoint demonstrated the highest performance on all tasks, achieving an average precision of 0.79 in signal detection. For signals with more than one hour of annotated data, the classification models achieved instance-based F1-scores above 0.8, enabling automatic analysis of activity patterns. In our case study, where 24-hour field recordings were analysed, the trained models (even those with lower precision) revealed interesting activity patterns of different species. The presented study, together with the dataset we publish with this paper, lays the foundation for further analysis of the vibroscape and the development of automated methods for ecotremological monitoring that complement passive acoustic monitoring and provide a comprehensive approach to ecosystem assessment. |
|---|
| Keywords: | vibroscape, ecotremology, deep learning, automatic classification, biotremology, insects, zoology, laser vibrometry, ecosystem assessment |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Publication date: | 01.05.2025 |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | str. 1-10 |
|---|
| Numbering: | Vol. 86, [art. no.] ǂ103003 |
|---|
| PID: | 20.500.12556/DiRROS-21258  |
|---|
| UDC: | 591 |
|---|
| ISSN on article: | 1878-0512 |
|---|
| DOI: | 10.1016/j.ecoinf.2025.103003 |
|---|
| COBISS.SI-ID: | 223198211 |
|---|
| Note: | Nasl. z nasl. zaslona;
Opis vira z dne 21. 1. 2025;
Soavtorji: Matevž Pesek, Rok Šturm, Juan José López Díez, Behare Rexhepi, Meta Virant-Doberlet;
|
|---|
| Publication date in DiRROS: | 21.01.2025 |
|---|
| Views: | 627 |
|---|
| Downloads: | 341 |
|---|
| Metadata: |    |
|---|
|
:
|
Copy citation |
|---|
| | | | Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
