loading page

Application of a Deep Learning Image Classifier for Identification of Amazonian Fishes
  • +5
  • Alex Robillard,
  • Mike Trizna,
  • Kevin Ruiz-Tafur,
  • Edgard Dávila Panduro,
  • C David de Santana,
  • Alexander E. White,
  • Rebecca Dikow,
  • Jessica Deichmann
Alex Robillard
Smithsonian Institution Office of the Chief Information Officer

Corresponding Author:[email protected]

Author Profile
Mike Trizna
Smithsonian Institution Office of the Chief Information Officer
Author Profile
Kevin Ruiz-Tafur
Smithsonian National Zoo and Conservation Biology Institute
Author Profile
Edgard Dávila Panduro
Smithsonian National Zoo and Conservation Biology Institute
Author Profile
C David de Santana
Smithsonian Institution
Author Profile
Alexander E. White
Smithsonian Institution Office of the Chief Information Officer
Author Profile
Rebecca Dikow
Smithsonian Institution Office of the Chief Information Officer
Author Profile
Jessica Deichmann
Smithsonian National Zoo and Conservation Biology Institute
Author Profile

Abstract

1. Given the sharp increase in agricultural and infrastructure development and the paucity of widespread data available for making conservation management decisions, a more rapid and accurate tool for identifying fish fauna in the world’s largest freshwater ecosystem, the Amazon, is needed. 2. Current strategies for identification of freshwater fishes require high levels of training and taxonomic expertise for morphological identification or genetic testing for species recognition at a molecular level. 3. To overcome these challenges, we built an image masking model (U-Net) and a convolutional neural net (CNN) to classify Amazonian fish in photographs. Fish used as training data were collected and photographed in tributaries in seasonally flooded forests of the upper Morona River valley in Loreto, Peru in 2018 and 2019. 4. Species identifications in the training images (n = 3,068) were verified by expert ichthyologists. These images were supplemented with photographs taken of additional Amazonian fish specimens housed in the ichthyological collection of the Smithsonian’s National Museum of Natural History. 5. We generated a CNN model that identified 33 genera of fishes with a mean accuracy of 97.9%. Wider availability of accurate freshwater fish image recognition tools, such as the one described here, will enable fishermen, local communities and community scientists to more effectively participate in collecting and sharing data from their territories to inform policy and management decisions that impact them directly.
22 Aug 2022Submitted to Ecology and Evolution
23 Aug 2022Submission Checks Completed
23 Aug 2022Assigned to Editor
31 Aug 2022Reviewer(s) Assigned
09 Dec 2022Review(s) Completed, Editorial Evaluation Pending
20 Dec 2022Editorial Decision: Revise Minor
10 Mar 20231st Revision Received
11 Mar 2023Submission Checks Completed
11 Mar 2023Assigned to Editor
11 Mar 2023Review(s) Completed, Editorial Evaluation Pending
24 Mar 2023Editorial Decision: Accept