3-1-3. Optimization:
The optimization process involves identifying the optimal solution out
of all possible solutions for a problem in mathematics and computer
science. In the context of machine learning, it entails modifying the
model’s parameters in order to reduce the loss function and enhance the
accuracy of the model’s predictions. Also Optimization plays a vital
role in the training phase of machine learning models and has a
significant impact on their effectiveness. The optimization procedure is
usually a repeated process of modifying the model parameters until the
loss function reaches its minimum value. In our research, we apply the
Adaptive Moment Estimation(Adam) optimizer [14].