Metrics for Polyphonic Sound Event Detection
AbstractThis paper presents and discusses various metrics proposed for evaluation of polyphonic sound event detection systems used in realistic situations where there are typically multiple sound sources active simultaneously. The system output in this case contains overlapping events, marked as multiple sounds detected as being active at the same time. The polyphonic system output requires a suitable procedure for evaluation against a reference. Metrics from neighboring fields such as speech recognition and speaker diarization can be used, but they need to be partially redefined to deal with the overlapping events. We present a review of the most common metrics in the field and the way they are adapted and interpreted in the polyphonic case. We discuss segment-based and event-based definitions of each metric and explain the consequences of instance-based and class-based averaging using a case study. In parallel, we provide a toolbox containing implementations of presented metrics. View Full-Text
A printed edition of this Special Issue is available here.
Share & Cite This Article
Mesaros, A.; Heittola, T.; Virtanen, T. Metrics for Polyphonic Sound Event Detection. Appl. Sci. 2016, 6, 162.
Mesaros A, Heittola T, Virtanen T. Metrics for Polyphonic Sound Event Detection. Applied Sciences. 2016; 6(6):162.Chicago/Turabian Style
Mesaros, Annamaria; Heittola, Toni; Virtanen, Tuomas. 2016. "Metrics for Polyphonic Sound Event Detection." Appl. Sci. 6, no. 6: 162.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.