When using automated detection of focal species sounds, when and why should we focus on characterizing probability of detection and probability of false alarm, vs. focusing on precision and recall? What are the pros and cons of either set of evaluation metrics, and are there heuristics for when to use one over the other?
I would like to consider this question under two different motivating examples:
- Using an automated detection system to detect a species of interest for use in an occupancy modeling framework (i.e., detection/non-detection data are needed within selected survey periods)
- Using an automated detection system to characterize phenological trends for a species of interest (i.e., number of detections per day over the course of a breeding season)
Inspired by discussion here: Why report SNR, and what SNR is acceptable? (specifically, this answer) and here: When assessing automated detector performance, how much manual checking of the detections is "enough"?
ETA: My experience is in terrestrial bioacoustics (largely an avian lens) which affects my system assumptions. If there is nuance in how to consider this question for terrestrial vs. underwater problems, it will be worth including that in any answers.