loading page

Autonomous Dishwasher Loading from Cluttered Trays using Pre-trained Deep Neural Networks
  • Isobel Voysey,
  • Thomas George Thuruthel,
  • Fumiya Iida
Isobel Voysey
University of Cambridge

Corresponding Author:[email protected]

Author Profile
Thomas George Thuruthel
University of Cambridge
Author Profile
Fumiya Iida
University of Cambridge
Author Profile


Autonomous dishwasher loading is a benchmark problem in robotics that highlights the challenges of robotic perception, planning and manipulation in an unstructured environment. Current approaches resort to a specialized solution, however, these technologies are not viable in a domestic setting. Learning-based solutions seem promising for a general purpose solutions, however, they require large amounts of catered data, to be applied in real-world scenarios. This paper presents a novel solution based on pre-trained object detection networks. By developing a perception, planning and manipulation framework around an off-the-shelf object detection network, we are able to develop robust pick-and-place solutions that are easy to develop and general purpose requiring only a RGB feedback and a pinch gripper. Analysis of a real-world canteen tray data is first performed and used for developing our in-lab experimental setup. Our results obtained from real-world scenarios indicate that such approaches are highly desirable for plug-and-play domestic applications with limited calibration. All the associated data and code of this work is shared in a public repository.
24 Jun 2020Submitted to Engineering Reports
24 Jun 2020Submission Checks Completed
24 Jun 2020Assigned to Editor
24 Jun 2020Reviewer(s) Assigned
17 Aug 2020Editorial Decision: Revise Major
10 Oct 20201st Revision Received
10 Oct 2020Submission Checks Completed
10 Oct 2020Assigned to Editor
11 Oct 2020Editorial Decision: Accept
11 Nov 2020Published in Engineering Reports. 10.1002/eng2.12321