Table 2 Performance evaluation of final recognisers. Counts are the count of call detections in sound files where the species was absent (Count FP) or present (Count TP). Presence-absence (PA) values are the number of sound files where the species was missed (PA FN), correctly detected (PA TP), incorrectly detected (PA FP) or correctly undetected (PA TN). Performance metrics are precision (TP/TP+FP) for calls (Call Precision) and PA in files (Survey Precision), recall (TP/TP+FN) for PA in files and ROC. * Template excluded from final analyses.
Species Template name Count FP Count TP Call Precision PA FP PA TP PA FN PA TN Survey Precision Survey Recall ROC
Crinia signifera -43_129_SM4S 1048 7963 0.884 28 116 34 122 0.806 0.773 0.793
Crinia signifera -46_130_SM4S* 4432 18488 0.807 41 127 23 109 0.756 0.847 0.787
Crinia signifera -47_183_SM4H 2211 18609 0.894 40 120 30 110 0.750 0.800 0.767
Limnodynastes tasmaniensis 512 5khz_-27_95_SM3-E+0 10509 4245 0.288 37 46 27 36 0.554 0.630 0.562
Limnodynastes tasmaniensis 512 5khz_-32_45_SM4G* 18671 9747 0.343 46 60 13 27 0.566 0.822 0.596
Limnodynastes tasmaniensis 512 5khz_-32_90_SM3-E+0 1807 1134 0.386 25 37 36 48 0.597 0.507 0.582
Limnodynastes fletcherii -23_95_SM3-E 52 9438 0.995 7 36 3 32 0.837 0.923 0.872
Limnodynastes fletcherii -25_29_SM4G 2 1041 0.998 1 27 12 38 0.964 0.692 0.833
Limnodynastes fletcherii -31_54_SM4G 381 6531 0.945 6 37 2 33 0.860 0.949 0.897
Limnodynastes fletcherii -34_3_SM3-E* 903 1866 0.674 14 38 1 25 0.731 0.974 0.808
Limnodynastes dumerilii -18_104_SM3-E* 47 3253 0.986 11 35 2 26 0.761 0.946 0.824
Limnodynastes dumerilii -18_106_SM3-E 7 1964 0.996 4 32 5 33 0.889 0.865 0.878
Limnodynastes dumerilii -28_97_20181022 (SM4G) 3 4043 0.999 2 33 4 35 0.943 0.892 0.919
Limnodynastes dumerilii -35_30_SM4G 19 3452 0.995 5 36 1 32 0.878 0.973 0.919
Litoria peronii -30_256_60_SM3-E 31 1874 0.984 9 45 14 50 0.833 0.763 0.805
Litoria peronii -31_512_65_SM3-E 9 806 0.989 5 46 13 54 0.902 0.780 0.847
Litoria peronii -38_256_75_SM3-E 2 678 0.997 1 42 17 58 0.977 0.712 0.847
Crinia parinsignifera -30_37_SM4S 1273 6201 0.830 33 100 49 116 0.752 0.671 0.725
Crinia parinsignifera -33_38_SM4S 1520 4563 0.750 26 91 58 123 0.778 0.611 0.718
Crinia parinsignifera -41_47_SM3-E0+1* 6707 10575 0.612 58 109 40 91 0.653 0.732 0.671
Neobatrachus sudelli -23_512_94_SM4M 105 3032 0.967 1 31 0 30 0.969 1.000 0.984
Neobatrachus sudelli -39_512_100_SM4M 36 2645 0.987 1 31 0 30 0.969 1.000 0.984
Neobatrachus sudelli -52_512_1_SM4M 3 2097 0.999 1 31 0 30 0.969 1.000 0.984
Litoria raniformis -36_512_24_SM4R 0 28 1.000 0 10 2 12 1.000 0.833 0.917
Litoria raniformis -42_512_85_SM4R 8 962 0.992 2 12 0 10 0.857 1.000 0.917
Litoria raniformis -44_512_99_SM4R 0 100 1.000 0 10 2 12 1.000 0.833 0.917