ROC = (True Positives + True Negatives) / Number of evaluation files
Sample detections of false positives were manually verified. To determine the source of false positive, files that the recognisers deemed as having the frog species present were cross-examined against the manual detection list provided by the Forestry Corporation. This presented a list of unverified false positive detections – where the recognisers identified a call, but the original manual detection list indicated the frog species was not present. A subsample of these false positive detections was manually verified through audio and visual cues on Adobe Audition CC. The false positive detection files were reviewed until the source categories of these false positive detections were considered consistent.