Training a neural network involves some form of optimisation (minimisation) of an objective function. The root strategy from which all...

I’ve just stumbled upon this wiki page which describes optimisation methods that can be used for optimising functions (or programs) where...