Abstract

In order to reduce the error transfer existing in the application of knowledge distillation network in the previous knowledge question answering model, a multi-path reasoning teacher network model is proposed. The basic reasoning model is obtained according to the idea of bidirectional reasoning, and then two sets of bidirectional reasoning answer search paths are added to improve the accuracy of the intermediate supervision signal generated by the teacher network and reduce the negative effect of the teacher network on the student network. The experimental results have proved the effectiveness of this method. In addition, the multi-path reasoning method proposed in this paper can provide ideas for knowledge reasoning, knowledge question answering and other fields.