Neural network training involves adjusting network parameters to minimise a loss function and thereby enable models to extract meaningful patterns from data. Fundamental optimisation schemes include ...