Table 2 Performance evaluation of final recognisers. Counts are the
count of call detections in sound files where the species was absent
(Count FP) or present (Count TP). Presence-absence (PA) values are the
number of sound files where the species was missed (PA FN), correctly
detected (PA TP), incorrectly detected (PA FP) or correctly undetected
(PA TN). Performance metrics are precision (TP/TP+FP) for calls (Call
Precision) and PA in files (Survey Precision), recall (TP/TP+FN) for PA
in files and ROC. * Template excluded from final analyses.
Species |
Template name |
Count FP |
Count TP |
Call Precision |
PA FP |
PA TP |
PA FN |
PA TN |
Survey
Precision |
Survey Recall |
ROC |
Crinia signifera |
-43_129_SM4S |
1048 |
7963 |
0.884 |
28 |
116 |
34 |
122 |
0.806 |
0.773 |
0.793 |
Crinia signifera |
-46_130_SM4S* |
4432 |
18488 |
0.807 |
41 |
127 |
23 |
109 |
0.756 |
0.847 |
0.787 |
Crinia signifera |
-47_183_SM4H |
2211 |
18609 |
0.894 |
40 |
120 |
30 |
110 |
0.750 |
0.800 |
0.767 |
Limnodynastes tasmaniensis |
512 5khz_-27_95_SM3-E+0 |
10509 |
4245 |
0.288 |
37 |
46 |
27 |
36 |
0.554 |
0.630 |
0.562 |
Limnodynastes tasmaniensis |
512 5khz_-32_45_SM4G* |
18671 |
9747 |
0.343 |
46 |
60 |
13 |
27 |
0.566 |
0.822 |
0.596 |
Limnodynastes tasmaniensis |
512 5khz_-32_90_SM3-E+0 |
1807 |
1134 |
0.386 |
25 |
37 |
36 |
48 |
0.597 |
0.507 |
0.582 |
Limnodynastes fletcherii |
-23_95_SM3-E |
52 |
9438 |
0.995 |
7 |
36 |
3 |
32 |
0.837 |
0.923 |
0.872 |
Limnodynastes fletcherii |
-25_29_SM4G |
2 |
1041 |
0.998 |
1 |
27 |
12 |
38 |
0.964 |
0.692 |
0.833 |
Limnodynastes fletcherii |
-31_54_SM4G |
381 |
6531 |
0.945 |
6 |
37 |
2 |
33 |
0.860 |
0.949 |
0.897 |
Limnodynastes fletcherii |
-34_3_SM3-E* |
903 |
1866 |
0.674 |
14 |
38 |
1 |
25 |
0.731 |
0.974 |
0.808 |
Limnodynastes dumerilii |
-18_104_SM3-E* |
47 |
3253 |
0.986 |
11 |
35 |
2 |
26 |
0.761 |
0.946 |
0.824 |
Limnodynastes dumerilii |
-18_106_SM3-E |
7 |
1964 |
0.996 |
4 |
32 |
5 |
33 |
0.889 |
0.865 |
0.878 |
Limnodynastes dumerilii |
-28_97_20181022 (SM4G) |
3 |
4043 |
0.999 |
2 |
33 |
4 |
35 |
0.943 |
0.892 |
0.919 |
Limnodynastes dumerilii |
-35_30_SM4G |
19 |
3452 |
0.995 |
5 |
36 |
1 |
32 |
0.878 |
0.973 |
0.919 |
Litoria peronii |
-30_256_60_SM3-E |
31 |
1874 |
0.984 |
9 |
45 |
14 |
50 |
0.833 |
0.763 |
0.805 |
Litoria peronii |
-31_512_65_SM3-E |
9 |
806 |
0.989 |
5 |
46 |
13 |
54 |
0.902 |
0.780 |
0.847 |
Litoria peronii |
-38_256_75_SM3-E |
2 |
678 |
0.997 |
1 |
42 |
17 |
58 |
0.977 |
0.712 |
0.847 |
Crinia parinsignifera |
-30_37_SM4S |
1273 |
6201 |
0.830 |
33 |
100 |
49 |
116 |
0.752 |
0.671 |
0.725 |
Crinia parinsignifera |
-33_38_SM4S |
1520 |
4563 |
0.750 |
26 |
91 |
58 |
123 |
0.778 |
0.611 |
0.718 |
Crinia parinsignifera |
-41_47_SM3-E0+1* |
6707 |
10575 |
0.612 |
58 |
109 |
40 |
91 |
0.653 |
0.732 |
0.671 |
Neobatrachus sudelli |
-23_512_94_SM4M |
105 |
3032 |
0.967 |
1 |
31 |
0 |
30 |
0.969 |
1.000 |
0.984 |
Neobatrachus sudelli |
-39_512_100_SM4M |
36 |
2645 |
0.987 |
1 |
31 |
0 |
30 |
0.969 |
1.000 |
0.984 |
Neobatrachus sudelli |
-52_512_1_SM4M |
3 |
2097 |
0.999 |
1 |
31 |
0 |
30 |
0.969 |
1.000 |
0.984 |
Litoria raniformis |
-36_512_24_SM4R |
0 |
28 |
1.000 |
0 |
10 |
2 |
12 |
1.000 |
0.833 |
0.917 |
Litoria raniformis |
-42_512_85_SM4R |
8 |
962 |
0.992 |
2 |
12 |
0 |
10 |
0.857 |
1.000 |
0.917 |
Litoria raniformis |
-44_512_99_SM4R |
0 |
100 |
1.000 |
0 |
10 |
2 |
12 |
1.000 |
0.833 |
0.917 |