19–21 Nov 2026
"Alexandru Ioan Cuza" University of Iasi and "Gheorghe Asachi" Technical University of Iași
Europe/Bucharest timezone

Audio Event Detection with Foundation Models: Zero-Shot and Fine-Tuned CLAP versus Template-Based Approaches

19 Nov 2026, 17:00
15m
Room 2

Room 2

Paper presentation Doctoral Symposium Doctoral Symposium

Speaker

Lavinia-Ștefana Dragne (National University of Science and Technology Politehnica Bucharest)

Description

Audio event detection often relies on labelled or cu-
rated audio examples of the target event, which limits deployment
when representative recordings are scarce or costly to obtain.
We investigate whether foundation audio-language models can
replace such audio references with natural-language descriptions,
using cattle vocalization detection for welfare monitoring in
Precision Livestock Farming as a case study. Using CLAP
(Contrastive Language–Audio Pretraining), we score each 1-
second window by its similarity to a positive description against
negative descriptions of farm background, and then adapt the
model with a language-preserving linear adapter that leaves the
text interface intact. Both variants are evaluated within the
detection pipeline of our previously published template-based
detectors, on the same corpus and timestamps, with all
thresholds selected using leave-one-animal-out cross-validation.
Across 20 animals, zero-shot CLAP achieves 69.5% precision,
66.7% recall, and an F1 score of 67.2%, compared with 63.7%
for the audio-template YAMNet baseline; the paired difference is
not statistically significant (p = 0.23). Thus, a natural-language
description achieves comparable detection performance without
requiring an audio exemplar of the target event. The adapter
raises F1 to 70.6% by increasing precision to 81.8% at a
small cost in recall, and is the only evaluated configuration to
significantly outperform the baseline. Further experiments show
that the tested bioacoustics-specialised backbone provides no
improvement in this setting, while negative prompts carry most of
the discriminative signal, highlighting background descriptions as
an important target for prompt engineering in language-guided
audio event detection.

Authors

Lavinia-Ștefana Dragne (National University of Science and Technology Politehnica Bucharest) Mr Alexandru-Corneliu Olteanu (National University of Science and Technology POLITEHNICA Bucharest, Romania) Ms Mădălina Mincu-Iorga (Research and Development Institute for Bovine Balotesti - ICDCB, Balotești, Romania) Mr Dinu Gavojdian (Research and Development Institute for Bovine Balotesti – ICDCB, Balotes, ti, Romania) Nicolae ȚĂPUȘ (National University of Science and Technology POLITEHNICA Bucharest, Romania)

Presentation materials