3-1-3. Optimization:
The optimization process involves identifying the optimal solution out of all possible solutions for a problem in mathematics and computer science. In the context of machine learning, it entails modifying the model’s parameters in order to reduce the loss function and enhance the accuracy of the model’s predictions. Also Optimization plays a vital role in the training phase of machine learning models and has a significant impact on their effectiveness. The optimization procedure is usually a repeated process of modifying the model parameters until the loss function reaches its minimum value. In our research, we apply the Adaptive Moment Estimation(Adam) optimizer [14].